Skip to main content

LiteLLM vs OpenRouter: Run Your Own Gateway or Rent One?

Run LiteLLM to keep prompts in your network at no fee; rent OpenRouter to skip operating a gateway. Team accounts, a monthly bill at one workload, fees, data handling, and spend controls compared.

Reading time
6 min read
Sources
28 cited
In this piece

GILD verdict

Pick LiteLLM when prompts and keys must stay in your network and you can staff a gateway, as Okta and Zalando do.

It charges nothing on model spend and caps it per person and team. OpenRouter is the better choice when you would rather pay 5.5% on credits than run, upgrade, and patch the gateway yourself: at 1 million Sonnet 5.5 requests a month that fee is about US$196 more than LiteLLM's VM, far less than an engineer's time. Teams that need both keep LiteLLM in front and route to OpenRouter behind it, with fallbacks to a direct provider.

Teams report reliability trouble on both sides. A developer moved from LiteLLM to OpenRouter over repeated outages (Mar 2026), while a DevOps engineer kept LiteLLM in front of OpenRouter and added direct OpenAI fallbacks after OpenRouter returned 429 errors in test production (Jul 2026). On GILD's workload of 1 million Claude Sonnet 5.5 requests a month, LiteLLM costs US$4,024 on one self-run VM and OpenRouter US$4,220 with its 5.5% fee on credits, so the real difference is the staff time LiteLLM needs. LiteLLM uses your provider keys inside your infrastructure; OpenRouter hosts the router and bills prepaid credits. Stripe agreed to acquire OpenRouter on August 19, 2026, and neither company had announced the close by October 28, 2026.

What teams report

Failures and incidents 1

  1. FutureSearchOn LiteLLM

    FutureSearch runs routing, fallback, retry and accounting through LiteLLM; a June 4, 2026 upgrade dropped the request tags its billing read, and usage went unbilled for 6.5 days (Jun 10, 2026).

    “A routine LiteLLM version bump turned off our usage billing for six and a half days. We had many alerts for runaway spend, but not for spend dropping to zero.”
    Jack Wildman, Senior Software Engineer, FutureSearchFutureSearch blog, , write-up

Left or turned down 1

  1. SRVpressOn OpenRouter

    The SRVpress developer stopped using OpenRouter over slowness and errors (X, Oct 25, 2026).

    “Stopped using OpenRouter for same reason, slowness & errors.”
    Jay Brunet, System Admin and Developer, SRVpressX, , post

Switched 2

  1. Hacker News user (organization not stated)

    The developer moved from LiteLLM to OpenRouter about a year before March 2026 because LiteLLM kept causing outages, and called the move lucky on the day of the PyPI compromise (Hacker News, Mar 24, 2026).

    “Now I feel lucky that I switched to just using OpenRouter a year ago because LiteLLM was incredible flaky and kept causing outages.”
    chillfox, Developer, Hacker News user (organization not stated)Hacker News, , post
  2. kisamoto, DeveloperOn OpenRouter

    The author split a US$100 monthly Claude subscription budget into a US$10 Zed plan, a kept US$20 Cursor plan and US$70 a month of OpenRouter credits on ZDR-only endpoints, then edited the post to note OpenRouter's 5.5% fee (Apr 6, 2026).

    “OpenRouter does charge a 5.5% fee.”
    kisamoto, Developer, braw.dev (personal blog)braw.dev, , write-up

Adopted 1

  1. ZalandoOn LiteLLM

    Zalando's ML platform team has run a LiteLLM proxy since January 2024 as the company gateway to OpenAI, AWS Bedrock and Google Vertex models (Aug 14, 2026).

    “…our ML platform team deployed in January 2024 a LiteLLM based API proxy with access to models from different providers (now: OpenAI, AWS Bedrock, and Google Vertex).”
    Bartosz Ocytko, Executive Principal Engineer, ZalandoZalando Engineering Blog, , write-up

Choosing between LiteLLM and OpenRouter

Choose LiteLLM if

  • Prompts and provider keys must stay in your own network, or your contracts require calling providers directly.
  • You want budgets and rate limits per person, team, and app without paying a fee on model spend.
  • You run self-hosted models, such as vLLM or Ollama, beside hosted providers behind the same endpoint.
  • Your services already call one gateway and you want hosted providers added behind it with fallbacks set centrally, as an RTFM engineer did with OpenRouter in July 2026.

Choose OpenRouter if

  • Nobody on the team should operate, upgrade, or patch a gateway; a developer who moved from LiteLLM to OpenRouter in 2025 did so over outages.
  • You want 500+ models from 80+ providers without setting up an account with each provider.
  • You want fallback across providers where failed attempts are not billed, and EU or US in-region routing on the Business plan.

Side by side

DimensionLiteLLMOpenRouter
What you payList prices in US dollars. LiteLLM adds your own infrastructure cost; OpenRouter does not mark up tokens.Open source US$0 to self-host, with no per-token fee; Enterprise is an annual license quoted by gateway request capacity, deployment architecture, and support needs, never per tokenProvider list price for tokens, plus a fee on credit purchases: 5.5% on Standard, 8% on Business (a tier added in September 2026), discounted on Enterprise contracts
Monthly bill at one workloadGILD's calculation from published rates, fetched Oct 28, 2026: 1 million requests a month, each with 1,000 input and 200 output tokens on Claude Sonnet 5.5 at US$2 and US$10 per million tokens, no caching. The LiteLLM line has no high availability, Enterprise license, support or engineer time; the OpenRouter line assumes its Sonnet route lists Anthropic's rate. Taxes are excluded.US$4,024 a month: US$4,000 of Claude Sonnet 5.5 tokens at Anthropic's list price plus US$24 for one 2-vCPU, 4-GiB VM running the gateway, Postgres and Redis11828US$4,220 a month on Standard credits: the same US$4,000 of tokens plus the 5.5% fee on the credit purchase; US$4,000 with your own provider keys, inside the US$25,000 a month of BYOK spend that carries no fee81328
Reliability teams reportA developer left after repeated outages (Mar 2026); a June 2026 upgrade stopped FutureSearch's usage billing for 6.5 days without an error; Zalando restarts its proxy every 20,000 requests over memory leaks (Aug 2026)202122An RTFM engineer hit 429 errors through OpenRouter in test production and added direct OpenAI fallbacks in LiteLLM (Jul 2026); an SRVpress developer stopped using OpenRouter over slowness and errors (Oct 25, 2026)2425
Who runs itSelf-hosted only in your cloud or data center, from Docker images, a Helm chart, or Terraform modules; air-gapped deployments on EnterpriseHosted by OpenRouter; no self-hosted option
Your own provider keysRequired: you bring your own keys, and LiteLLM calls each provider with your keys and contracts19Optional BYOK: US$25,000 of list-price inference a month with no fee on Standard and Business, then a 5% fee13
Models140+ providers and 1,892 models listed on BerriAI's site, called with your own provider keys and contracts500+ models from 80+ providers on paid plans; 25+ free models with 50 requests a day on the free plan
Spend controlsBudgets and RPM and TPM limits per key, user, team, and organization in open source, enforced against a Postgres database; tag budgets, soft budget alerts, and temporary increases need EnterprisePer-key credit limits with daily, weekly, or monthly resets and workspace budget alerts, from the Standard plan
Prompt dataStays in your infrastructure; self-hosted LiteLLM keeps prompts and telemetry away from BerriAINot stored unless you opt in to logging or to OpenRouter's use of your data, or content is flagged as potential CSAM; request metadata is stored; ZDR-only routing from the Standard plan, since the pricing table lists data-policy routing as unavailable on Free; on October 27, 2026 OpenRouter announced it will screen all traffic, ZDR included, for CSAM; EU and US in-region routing on Business and Enterprise
Single sign-onSSO free for up to 5 users from v1.76.0; beyond that, and SCIM, audit logs, and secret managers, an Enterprise licenseSSO (SAML) and SCIM on Enterprise; Workload Identity Federation on Business and Enterprise
FailoverLoad balancing, retries, fallbacks, and cooldowns across deployments you configureRouting and fallback across providers; attempts that error are not charged for model tokens
Security record44 reviewed GitHub advisories for the package as of October 28, 2026. Two PyPI releases (1.82.7 and 1.82.8) carried credential-stealing malware on March 24, 2026, and 1.107.0 on PyPI and four official Docker tags carried it on October 21, 2026. SOC 2 Type II auditedA hosted service; its Enterprise page states SOC 2 compliance and GDPR compatibility
OwnershipBerriAI, a Y Combinator W23 company17OpenRouter; Stripe agreed to acquire it on August 19, 2026, terms undisclosed, and neither company had announced the close as of October 28, 202616

What practitioners report, side by side

Each product's figures come from its own practitioners, for the group you pick.

Whose sources to count
Compare LiteLLM with
  • OpenRouter

Overall signal

LiteLLM reads +10 and OpenRouter +10, each from its own practitioners. LiteLLM: 38 positive, 28 negative of 108. OpenRouter: 41 positive, 30 negative of 101.

The score counts the authors from all practitioners that take a side, one vote each with their latest view, and is how far positive votes lead negative ones, per 100 votes, so LiteLLM's +10 rests on votes split 35 positive, 42 mixed and 25 negative and OpenRouter's +10 on 40, 30 and 30.

A lead of a fifth of the votes reads positive and a lead of half strong positive, with the same lines below zero. The dots show each source, positive, mixed, negative. Run a pilot on one service's model traffic to measure added latency, failed fallbacks and how closely its spend records match each provider's bill.

Footprint on the AI Application Platform stack

They differ on two of 9 layers. On Model APIs, LiteLLM touches it and OpenRouter supports it. On Tool use, LiteLLM supports it and OpenRouter touches it. Coverage is each product's placement on this stack, as its product page shows it. Core is a job the product owns; Supports and Touches are jobs it helps with. Coverage says nothing about how well a product does them.

Layers where LiteLLM and OpenRouter differ
LayerLiteLLMOpenRouter
Model
Model APIsTouchesSupports
Build
Tool useSupportsTouches
The 7 layers where they match
Layers where LiteLLM and OpenRouter match
LayerLiteLLMOpenRouter
Model
Model gatewayCoreCore
Build
OrchestrationTouchesTouches
Data
RetrievalTouchesTouches
Evaluate
EvaluationTouchesTouches
Operate
ObservabilitySupportsSupports
Cloud deploymentTouchesTouches
GuardrailsSupportsSupports

What practitioners praise

Among all practitioners, LiteLLM alone has five praise themes that reach 5 sources from 3 authors. Virtual Keys, Budgets & Spend Tracking and Self-Hosted Control lead, at 19 of 24 and 12 of 12. OpenRouter alone has three praise themes that reach 5 sources from 3 authors. One API and One Balance and Fast Access to New and Open Models lead, at 25 of 25 each.

What practitioners praise, All practitioners
Praised forLiteLLMOpenRouter
Virtual Keys, Budgets & Spend Tracking19 of 24Not a theme in its sources
Self-Hosted Control12 of 12Not a theme in its sources
One API Across Providers12 of 24Not a theme in its sources
Routing, Fallbacks & Load Balancing8 of 10Not a theme in its sources
Provider & Model Coverage2 of 7Not a theme in its sources
One API and One BalanceNot a theme in its sources25 of 25
Fast Access to New and Open ModelsNot a theme in its sources25 of 25
Spend Limits & Cost DataNot a theme in its sources13 of 16

Each count is the sources that praise a theme, or raise it as a concern, out of those that discuss it. A row pairs the two products when both carry a theme under the same or an equivalent name.

A count ending in "so far" has under 5 sources from 3 authors among all practitioners. "Not a theme in its sources" means GILD found no theme of that name in that product's sources.

What practitioners raise as concerns

Among all practitioners, LiteLLM alone has five concern themes that reach 5 sources from 3 authors. Stability & Code Quality and Performance at Scale lead, at 29 of 29 and 14 of 16. OpenRouter alone has four concern themes that reach 5 sources from 3 authors. Fees & Billing Surprises and Provider Quality Variance lead, at 20 of 25 and 16 of 18.

What practitioners raise as concerns, All practitioners
Raised as a concernLiteLLMOpenRouter
Stability & Code Quality29 of 29Not a theme in its sources
Performance at Scale14 of 16Not a theme in its sources
Security & Supply Chain10 of 14Not a theme in its sources
Operational Burden9 of 10Not a theme in its sources
Enterprise-Gated Features6 of 6Not a theme in its sources
Fees & Billing SurprisesNot a theme in its sources20 of 25
Provider Quality VarianceNot a theme in its sources16 of 18
Latency, Errors & Rate LimitsNot a theme in its sources14 of 16
Free-Model LimitsNot a theme in its sources3 of 5

28 sources

  1. LiteLLM pricingOfficial documentationlitellm.ai
  2. LiteLLM docs: EnterpriseOfficial documentationdocs.litellm.ai
  3. LiteLLM docs: Budgets and rate limitsOfficial documentationdocs.litellm.ai
  4. LiteLLM docs: Data privacy and securityOfficial documentationdocs.litellm.ai
  5. LiteLLM docs: SSO for the Admin UIOfficial documentationdocs.litellm.ai
  6. LiteLLM docs: Load balancingOfficial documentationdocs.litellm.ai
  7. LiteLLM AI Gateway home page (providers, models, adoption figures)Official documentationlitellm.ai
  8. OpenRouter pricing and plan comparisonOfficial documentationopenrouter.ai
  9. OpenRouter EnterpriseOfficial documentationopenrouter.ai
  10. OpenRouter docs: Data collectionOfficial documentationopenrouter.ai
  11. OpenRouter docs: Provider logging and in-region routingOfficial documentationopenrouter.ai
  12. OpenRouter docs: Zero Data RetentionOfficial documentationopenrouter.ai
  13. OpenRouter docs: Bring your own keysOfficial documentationopenrouter.ai
  14. OpenRouter blog: CSAM Screening Across OpenRouter (Oct 27, 2026)Official documentationopenrouter.ai
  15. OpenRouter blog: OpenRouter is Joining Stripe (Aug 19, 2026)Official documentationopenrouter.ai
  16. Stripe newsroom: Stripe agrees to acquire OpenRouter (Aug 19, 2026)Public sourcestripe.com
  17. BerriAI/litellm on GitHub (stars, forks, releases)Official documentationgithub.com
  18. LiteLLM docs: Production best practicesOfficial documentationdocs.litellm.ai
  19. LiteLLM docs: ProvidersOfficial documentationdocs.litellm.ai
  20. Hacker News comment on switching from LiteLLM to OpenRouter (Mar 24, 2026)Public sourcenews.ycombinator.com
  21. Jack Wildman, FutureSearch blog: LiteLLM made us accidentally make our product free for a week (Jun 10, 2026)Public sourcefuturesearch.ai
  22. Bartosz Ocytko, Zalando Engineering Blog: Agentic engineering at Zalando, a snapshot (Aug 14, 2026)Public sourceengineering.zalando.com
  23. Dennis Henry, Okta blog: How Okta deploys and secures AI for its employees (Feb 26, 2026)Public sourceokta.com
  24. Arseny Zinchenko, RTFM: LiteLLM, OpenRouter integration and fallbacks configuration (Jul 31, 2026)Public sourcertfm.co.ua
  25. X post by SRVpress on leaving OpenRouter over slowness and errors (Oct 25, 2026)Public sourcex.com
  26. braw.dev: Reallocating US$100 a month of Claude Code spend to Zed and OpenRouter (Apr 6, 2026)Public sourcebraw.dev
  27. FutureSearch: company page listing Jack Wildman as Senior Software Engineer and Callum McMahon as Research Scientist (Oct 30, 2026)Public sourcefuturesearch.ai
  28. Anthropic: Claude API pricing, Claude Sonnet 5.5 at US$2 and US$10 per million tokens (Oct 28, 2026)Public sourceplatform.claude.com