Helicone
An open-source AI gateway with request monitoring, cost tracking, caching, fallbacks, prompts, and evaluations
Helicone combines multi-provider routing and observability behind a familiar API, but proxy trust, logged payloads, retention, usage-based costs, and gateway dependency need careful architecture review.