An open-source and managed gateway for model routing, reliability, observability, and governance
Who should use this?
Multi-provider teams and Central AI budgets and keys.
Who should avoid it?
Simple one-provider apps, Sensitive logs without controls
What problem does it solve?
Portkey centralizes model access, fallbacks, caching, guardrails, keys, budgets, and traces, but a gateway becomes a critical data and availability boundary that needs failure testing.
Would I recommend it?
Portkey earns a shortlist for teams needing shared model governance and able to engineer the gateway as critical infrastructure. Start with shadow traffic, restrict keys, define fail-open policy, validate cache isolation, and keep a recovery path.
Advisor score
Premium review framework
Portkey centralizes model access, fallbacks, caching, guardrails, keys, budgets, and traces, but a gateway becomes a critical data and availability boundary that needs failure testing.
Portkey earns a shortlist for teams needing shared model governance and able to engineer the gateway as critical infrastructure. Start with shadow traffic, restrict keys, define fail-open policy, validate cache isolation, and keep a recovery path.
Replay 500 synthetic requests across two providers with outages, limits, slow responses, malformed outputs, injection, PII, changed prices, cache collisions, budget exhaustion, and key revocation. Measure success, fallback drift, cost, latency, guardrail errors, exposure, isolation, and gateway outage behavior.
Personal Recommendation
Portkey earns a shortlist for teams needing shared model governance and able to engineer the gateway as critical infrastructure. Start with shadow traffic, restrict keys, define fail-open policy, validate cache isolation, and keep a recovery path.
Try the recommendation
Open-source data plane
Overall Score
Editorial Review Framework
Who should use this?
Multi-provider teams, Central AI budgets and keys, Production routing and observability.
Who should avoid it?
Simple one-provider apps, Sensitive logs without controls
What problem does it solve?
Portkey centralizes model access, fallbacks, caching, guardrails, keys, budgets, and traces, but a gateway becomes a critical data and availability boundary that needs failure testing.
Would I recommend it?
Portkey earns a shortlist for teams needing shared model governance and able to engineer the gateway as critical infrastructure. Start with shadow traffic, restrict keys, define fail-open policy, validate cache isolation, and keep a recovery path.
Overall Score
8.0
Ease of Use
7.6
AI Quality
8.0
Features
8.4
Speed
8.0
Integrations
8.4
Value for Money
8.0
Customer Support
7.6
Learning Curve
7.4
Recommended Because…
Open-source data plane
Scores use a 0-10 editorial scale. The source data is maintained as 5-point review dimensions, then normalized for reader-friendly comparison.
Evaluation
Research-based
Price posture
From $49/month
Reviewed
2026-09-01
No authentic product screenshot is published for this review. DiscoverAI does not use generated interface images as product evidence.
The open-source gateway is free. Managed Dev includes 10,000 monthly requests and three-day retention. Pro is $49 monthly for 100,000 requests, with published overage and 30-day retention. Enterprise uses custom volume, retention, security, and deployment terms. Model usage is separate. Reviewed September 1, 2026.
Free plan: Yes. Self-host the gateway or use managed Dev within its limits.
The gateway is open source, and managed Dev includes 10,000 monthly requests.
Pro is $49 monthly for 100,000 requests, with model usage and overage separate.
No. It routes to providers and adds control; underlying terms and charges still apply.
The open-source gateway runs locally; broader private and air-gapped deployments use enterprise packaging.
Keep Deciding
Best AI Coding Tools
AI coding assistants ranked by real developer workflow fit, not demo magic.
Best AI Tools for Code & Development
A practical shortlist of AI tools for ai coding assistants, code generators, and developer tools.
Code & Development
AI coding assistants, code generators, and developer tools.
See how similar tools stack up
An open-source AI gateway with request monitoring, cost tracking, caching, fallbacks, prompts, and evaluations
Helicone combines multi-provider routing and observability behind a familiar API, but proxy trust, logged payloads, retention, usage-based costs, and gateway dependency need careful architecture review.
Open-source tracing, evaluation, prompt management, and metrics for LLM applications
Langfuse unifies traces, costs, prompts, datasets, and evaluation with cloud and self-hosted options, but telemetry sensitivity, retention, operational load, and fast-rising plan costs demand a scoped pilot.
An evaluation, prompt, dataset, and observability platform for AI product development
Braintrust connects production traces, datasets, experiments, scorers, prompts, and human review, but judge validity, sensitive logs, retention, score volume, and release-gate design require calibration.