LiteLLM
Independent gateway · no token markup · BYOK 0% · hosted or self-host · open source
Unverified
What it costs on real workloads
| Model | Direct | Through LiteLLM |
|---|---|---|
| $400.00 | $400.00vs $400.00 direct | |
| $400.00 | $400.00vs $400.00 direct | |
| $150.00 | $150.00vs $150.00 direct | |
| $10.50 | $10.50vs $10.50 direct |
100M input and 20M output tokens a month, paying with gateway credits. A dash: not on its model list.
Carries 235 of the models tracked here, from its own model catalog, checked Nov 9, 2026.
About LiteLLM
Open source Python SDK and proxy server that calls 100+ LLM providers in the OpenAI format, with an enterprise tier for SSO, audit logs and support.
- Fee on tokens
- None
- Pricing model
- Open source, self-hosted with your own keys; enterprise license by quote
- Bring your own key
- 0% fee
- Entry plan
- Enterprise
- Hosting
- Hosted or self-host
- License
- MIT (enterprise features under LiteLLM Commercial License)
Features stated: Fallbacks, Load balancing, Caching, Guardrails, Observability, Rate limits, Budgets, Prompts, OpenAI-compatible, Bring your own key. Not stated: Data residency, Private networking.
The terms, in their words
- Markup
- Self-hosted proxy calls providers with your own keys; no token markup stated. Hosted proxy offered via enterprise.
- Free tier
- Open source gateway free to self-host
- Providers
- 100+ LLM providers
- Deploy the open-source gateway in an afternoon
- Virtual keys with per-key/team/user budgets
- Drop-in replacement for any OpenAI-compatible client
Source: www.litellm.ai/enterprise
LiteLLM vsHeliconeKong AI GatewayNeon AI GatewayVercel AI GatewayCloudflare AI GatewayRequesty