Best Open Source Alternatives to Cloudflare AI Gateway

LiteLLM is a self-hosted AI gateway replacing OpenRouter with a unified OpenAI-compatible API, spend tracking, and private VPC deployment.

vs Cloudflare AI Gateway: a free, open-source option you fully control.

Portkey AI Gateway replaces proprietary routing proxies with an open-source, self-hosted control plane for over 1,600 models and automated guardrails.

vs Cloudflare AI Gateway: a free, open-source option you fully control, licensed MIT.

Bifrost is a self-hosted Go AI gateway replacing hosted proxies with private multi-provider routing, virtual keys, and sub-100-microsecond overhead.

vs Cloudflare AI Gateway: a free, open-source option you fully control, licensed Apache-2.0.

Envoy AI Gateway replaces proprietary AI gateways like Kong with self-hosted, Envoy-native LLM routing, token rate limiting, and credential isolation.

vs Cloudflare AI Gateway: a free, open-source option you fully control, licensed Apache-2.0.

Open-source LLM Gateway routes, caches, and monitors AI traffic across 35+ providers, replacing Vercel AI Gateway with self-hosted privacy and control.

vs Cloudflare AI Gateway: a free, open-source option you fully control, licensed MIT.