> /v1/alternatives/cloudflare-ai-gateway
Open source alternatives to Cloudflare AI Gateway[005]
Cloudflare AI Gateway sits in front of LLM providers to cache, rate limit, log and analyze AI requests without changing application code. Below are 5 self-hostable open source alternatives, ranked by GitHub popularity.
LiteLLM
Call every LLM API like it's OpenAI [100+ LLMs]
★ STARS
46.2k
⑂ FORKS
7.9k
portkey-ai-gateway
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
★ STARS
11.6k
⑂ FORKS
1.0k
Bifrost
Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.
★ STARS
4.7k
⑂ FORKS
557
envoy-ai-gateway
Manages Unified Access to Generative AI Services built on Envoy Gateway
★ STARS
1.6k
⑂ FORKS
241
llm-gateway
Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.
★ STARS
1.2k
⑂ FORKS
130
// EDITOR'S TAKE
LiteLLM is the most complete replacement, covering routing, caching, budgets and logging in one proxy, but you take on the uptime Cloudflare was handling for free at the edge. envoy-ai-gateway is the right call if you already run Envoy or Kubernetes and want AI traffic under the same policy layer, while llm-gateway is a much lighter option for teams that only need routing and per-provider analytics.
// FREQUENTLY ASKED
What is the best open source Cloudflare AI Gateway alternative?
LiteLLM is the most popular open source Cloudflare AI Gateway alternative by GitHub stars (46,158 stars). The other 4 options are ranked above.
Are these Cloudflare AI Gateway alternatives self-hostable?
Yes — every project listed here is open source and runs on your own infrastructure. Click into a project to see its license, stars, language, and current health status.
Are they free?
All projects shown are free and open source. Check each project's license page for the terms — most are MIT, Apache 2.0, or AGPL.