Palo Alto NetworksAI Gateway
Portkey
Portkey's gateway puts one OpenAI-compatible API, fallbacks, load balancing, request logs, and guardrails in front of a team's own model API keys, as a hosted service, a hybrid data plane in your VPC, or an MIT-licensed open-source gateway. Palo Alto Networks completed its purchase on May 29, 2026 and sells it as Prisma AIRS AI Gateway.
The 30-Second Take
Pick Portkey if security wants every model call logged, filtered and audited without running a logging stack.
It puts one API, fallbacks, request logs and guardrails in front of your own model keys. Palo Alto Networks bought it in May 2026 and sells it as Prisma AIRS AI Gateway, while the portkey.ai plans stay on sale.
- Best fit
- Platform teams that call model makers on their own keys and want hosted request logs, guardrails, and audit logs.
- Main constraint
- Budgets, SSO, and audit logs need Enterprise, and the open-source gateway has shipped no release since January 12, 2026.
- First move
- Run a Production workspace on Portkey cloud against the routes you use, and ask Palo Alto Networks for Enterprise terms in writing.
Why
Watch the gaps: budgets, SSO and audit logs need Enterprise, and a cache change on Portkey's cloud took a production platform down in 2025. Avoid self-hosting the open-source gateway while a July 2026 SSRF bypass stays open.
47 practitioners, 62 sources reviewed, Updated Oct 30, 2026How this is measured
- Operating stack
- AI Application Platform
Comparisons
How does Portkey compare with the alternatives?
Portkey vs OpenRouter
- AI Gateways
Pick Portkey for recorded request logs, audit logs, and a data plane in your VPC on your own model keys, and canary its cache changes: one took a production platform down in 2025. Pick OpenRouter to buy 500+ models through one balance with a fee on credit purchases.
Portkey vs LiteLLM
- AI Gateways
Pick Portkey, now Palo Alto Networks' Prisma AIRS AI Gateway, for hosted observability priced by recorded logs. Pick LiteLLM for free key budgets in a gateway you run yourself.
Operator Insights
What are teams learning from building on Portkey and running it in production?
Leonardo MarcianoCTO, as his GitHub profile describes himselfToolzz
A platform running its model traffic through Portkey's hosted cloud with simple caching configured.
GitHub (Portkey-AI/gateway), published Read the issue (opens GitHub (Portkey-AI/gateway) in a new tab)
Observation
A caching change on Portkey cloud turned one platform's simple cache into a semantic one and took its whole platform down until Portkey reverted it.
- Takeaway
- A hosted gateway's change reaches every app behind it at once, so cache settings need a canary check and alerts on hit rate and errors.
- What happened
- On July 23, 2025 a change Portkey made while fixing caching issues made one platform's simple cache behave as a semantic cache, so similar requests matched each other and the cache hit rate approached 100%. Its CTO reported a platform-wide outage affecting all its customers while they were using the system. Portkey's team replied that it had introduced a bug that caused cache collisions and had fully reverted it by 03:23 UTC that day.
“This caused a complete platform failure while all customers were actively using the system.”
Leonardo Marciano - Public engineering write-up (the CTO's GitHub issue)
- Vendor reply in the same issue
Deployment details
A platform running its model traffic through Portkey's hosted cloud with simple caching configured.
- Public engineering write-up (the CTO's GitHub issue)
- Vendor reply in the same issue
- Team
- A platform on Portkey cloud, reported by its self-described CTO
- Duration
- Until Portkey's revert at 03:23 UTC on July 23, 2025
- Workload
- A production platform on Portkey cloud
- Product version
- Portkey cloud as of July 23, 2025
- Measurement
- Cache hit rate near 100%; outage across all customers
Rajkumar (rajkumargaramie)Author of the migration pull request (GitHub profile names Medical Informatics Engineering)Medical Informatics Engineering
The reference server behind Medical Informatics Engineering's Ozwell API, which used Portkey to route requests to OpenAI, Anthropic and self-hosted Ollama and to normalize provider request and response formats.
GitHub (mieweb/ozwellai-api), published Read the issue (opens GitHub (mieweb/ozwellai-api) in a new tab)
Observation
Medical Informatics Engineering moved off the Portkey gateway for chat in its Ozwell API, calling OpenAI, Anthropic and Ollama directly, while embeddings and audio still used the gateway when that change merged.
- Takeaway
- A gateway used mainly for routing and format translation can be replaced one traffic type at a time. Keep a setting that sends traffic back through the gateway until each type passes its tests.
- What happened
- An issue opened on August 10, 2026 set the goal of replacing the Portkey gateway dependency and connecting providers directly. The first slice, merged into the dev branch on October 6, 2026, sends chat straight to OpenAI, Anthropic and Ollama through the team's internal harness-core library and keeps a setting to roll back to the gateway. Embeddings and audio still used the gateway at merge, with Portkey's config and docs to be removed once they move. The issue and pull request give no reason for leaving.
- Public engineering write-up (the team's GitHub issue and merged pull request)
- No reason for leaving stated
- No metrics reported
Deployment details
The reference server behind Medical Informatics Engineering's Ozwell API, which used Portkey to route requests to OpenAI, Anthropic and self-hosted Ollama and to normalize provider request and response formats.
- Public engineering write-up (the team's GitHub issue and merged pull request)
- No reason for leaving stated
- No metrics reported
- Team
- Medical Informatics Engineering, Ozwell API
- Duration
- Issue opened Aug 10, 2026, chat change merged Oct 6, 2026
- Workload
- Chat, embeddings and audio transcription in the Ozwell reference server
Buying and deployment
What a team building on it should verify before production traffic grows.
Sourced from Portkey documentation
Signals
What is the current evidence saying about Portkey?
A current read of what teams and individual developers report publicly about running model traffic through Portkey, hosted or self-hosted, with each finding linked to its sources.
Practitioner sentiment, all practitioners
0 Mixed net
of 50 sources that take a side, each author counted once.
How this figure is madeTeams and leaders have 18 accounts; GILD prints their sentiment from 20.
Current sentiment
Positive, mixed and negative sources
The score counts them as 18 positive, 11 mixed and 18 negative votes, one per author.
Across 50 counted sources the read is mixed: 20 positive, 11 mixed, and 19 negative. One API with fallbacks draws praise in 16 sources, while provider translation problems are raised in 14, reliability bugs in 8, and doubts about the open-source gateway's maintenance in 5.
Run a pilot on one service's model traffic to measure added latency, failed fallbacks and how closely its spend records match each provider's bill.
Evidence field. All 62 sources, one mark each.
Arrange by
Each mark is one source: positive, mixed, negative, no opinion stated, or documentation (not counted).
| Group | Sources | Positive | Mixed | Negative | No opinion stated and not counted in the score | Documentation, checked and not counted |
|---|---|---|---|---|---|---|
| Positive | 20 | 20 | 0 | 0 | 0 | 0 |
| Mixed | 11 | 0 | 11 | 0 | 0 | 0 |
| Negative | 19 | 0 | 0 | 19 | 0 | 0 |
| Not counted | 6 | 0 | 0 | 0 | 6 | 0 |
| Documentation | 6 | 0 | 0 | 0 | 0 | 6 |
| Quarter | Sources |
|---|---|
| Q3 2025 | 6 |
| Q4 2025 | 1 |
| Q1 2026 | 2 |
| Q2 2026 | 15 |
| Q3 2026 | 18 |
| Q4 2026 | 14 |
| Documentation, checked | 6 |
By sentiment
6 documentation pages check facts and are not counted.
Hover a mark for a quick look, click it or press Enter to open its source.Tap a mark to open its source, then step to its neighbors with Previous and Next.
What practitioners praise
Top praise of 2. Each mark is a source on it; filled marks praise it.
Most common concerns
Top concern of 3. Each mark is a source on it; filled marks raise it.
All 62 sources behind these findings
- PricingPortkey (Official), Product documentation, checked Oct 28, 2026
- Enterprise offeringPortkey (Official), Product documentation, checked Oct 28, 2026
- Audit logsPortkey (Official), Product documentation, checked Oct 28, 2026
- Model CatalogPortkey (Official), Product documentation, checked Oct 28, 2026
- Enforce budget and rate limitsPortkey (Official), Product documentation, checked Oct 28, 2026
- Hybrid deployment architecturePortkey (Official), Product documentation, checked Oct 28, 2026
- Live logs middleware hardcodes the port and shows an undefined endpointshafiktanbir, GitHub user (self-described: Self-hosted gateway on a custom port), GitHub issue, published Oct 26, 2026
- Google / Vertex AI streaming drops functionCall after thought or text partdr-goo, GitHub user (self-described: Streaming tool calls on Gemini and Vertex AI), GitHub issue, published Oct 26, 2026
- fix(k8s): the portkey gateway reads its routing config in the documented way, or the unused config goesdan-petty, owner of the devops-cli repository (self-described: devops-cli, which runs the Portkey gateway in its own Kubernetes cluster), GitHub issue, published Oct 24, 2026
- feat(video): Portkey gateway video generation (omni-flash + Veo 3.1)Jaraxxxx, owner of an OpenMontage fork (self-described: OpenMontage video generation through one Portkey API key), GitHub pull request, published Oct 24, 2026
- [BUG] embed(array) returns one vector for many texts with Bedrock Titan behind an OpenAI-compatible gatewaysheredega303, GitHub user calling Amazon Titan embeddings through Portkey (self-described: RubyLLM embeddings on Amazon Titan through Portkey), GitHub issue, published Oct 22, 2026
- fix: move myceli.ai services onto pollinations.aivoodoohop, Pollinations team member (self-described: Pollinations, whose generation service calls its own Portkey deployment), GitHub pull request, published Oct 16, 2026
- POST /v1/messages with x-portkey-provider: openai or google returns HTTP 500xinliu0727-sudo, GitHub user (self-described: Anthropic-format requests to OpenAI and Google models), GitHub issue, published Oct 15, 2026
- One door or forty doors.Yves Mulkers, publisher of the ins7ghts.com AI and data newsletter (self-described: Commentary on the acquisition), X post, published Oct 12, 2026
- Did anyone running an agent shop actually save money after moving off Portkey?Eastern-Novel-7884, Reddit (r/AI_Agents) (self-described: A three-person team building intake and scheduling tools for clinics and law offices, with clients running intake around the clock), Reddit post, r/AI_Agents, published Oct 9, 2026
- Google provider: system messages that are not the first message are dropped from contentsxinliu0727-sudo, GitHub user (self-described: OpenAI-format requests routed to Gemini), GitHub issue, published Oct 7, 2026
- feat: add an OpenAI-compatible provider for any gateway or serverDEENUU1, vstorm-co team member (self-described: vstorm's full-stack AI agent template), GitHub pull request, published Oct 6, 2026
- OpenAI-format usage for Anthropic cache reads: cached_tokens exceeds prompt_tokenskwisatzh, GitHub user comparing four gateways (self-described: Usage accounting across four open-source gateways), GitHub issue, published Oct 5, 2026
- Bedrock /v1/messages streaming drops exception eventschrikrah, GitHub user (self-described: Bedrock models on the Messages route), GitHub issue, published Oct 3, 2026
- Replace Portkey gateway with harness-core and handle providers directly in ozwellai-apiRajkumar (rajkumargaramie), Medical Informatics Engineering (GitHub profile) (self-described: Medical Informatics Engineering's Ozwell API reference server, which used Portkey for routing to OpenAI, Anthropic and self-hosted Ollama and for normalizing provider formats), GitHub issue comment, published Oct 2, 2026
- Adopt a mature LLM gateway (LiteLLM) for optional model-access enforcement (AI Gateway #2274)Brad-Edwards, owner of the bigrae repository (self-described: bigrae, choosing a gateway for optional model-access enforcement), GitHub issue, published Sep 30, 2026
- Optional lifecycle field on src/data/models.json: 95 listed models are already retired at their providerjoelp22-maker, maintainer of a model retirement dataset (self-described: The gateway's bundled model catalog), GitHub issue, published Sep 20, 2026
- Email address mentioned under contact us not workingmrSingh007, GitHub user (self-described: Seeking support for the self-hosted gateway), GitHub issue, published Sep 15, 2026
- Every "AI SDR" on the market is a wrapper around the same 60 tools.Tim, founder building RevenueFlow (self-described: RevenueFlow's production stack), X post, published Sep 11, 2026
- Streaming: when the upstream closes the stream mid-answer, the gateway ends its own response cleanlysakshamyadav090, GitHub user (self-described: Streaming with a configured fallback), GitHub issue, published Sep 9, 2026
- fix(providers): align Portkey credentials with request routingmldangelo, Promptfoo team member (self-described: Promptfoo's Portkey provider), GitHub pull request, published Sep 9, 2026
- Reply on LiteLLM alternatives for per-team limits, r/mlopsCorrect_Scratch8942, Reddit (r/mlops) (self-described: Portkey in front of several teams' model traffic), Reddit comment, r/mlops, published Sep 9, 2026
- You can't fix what you can't see.Ezekiel Oluyale, AI/ML engineer (self-described: Personal LLM app monitoring), X post, published Sep 7, 2026
- ci: inject the model-gateway host into agent-phase allowlistsAllenGrahamHart, collaborator on terminal-bench-science (self-described: terminal-bench-science CI, which can run agents through Portkey among four model gateways), GitHub pull request, published Aug 22, 2026
- Per-request Gateway API keys: survey, Temporal design, and pipelex-server handoff (docs only)lchoquel, Pipelex team member (self-described: Pipelex, which routes hosted runs through a Portkey gateway), GitHub pull request, published Aug 18, 2026
- Assistant: Portkey gateway provider auth supportsharon-wang, Posit Positron team member (self-described: Positron Assistant's experimental Portkey gateway provider), GitHub issue, published Aug 12, 2026
- Bedrock: tool-result cachePoint nested where the AWS schema forbids itarohou, GitHub user (self-described: Prompt caching on Bedrock through the gateway), GitHub issue, published Aug 11, 2026
- Gemini function calling: role function not transformed to role MODELTCK0423, GitHub user (self-described: Hermes Agent with Google Gemini through Portkey's hosted API), GitHub issue, published Aug 9, 2026
- is this going to be maintained?pritamsoni-hsr, GitHub user (self-described: A self-hosted gateway user after the acquisition), GitHub issue, published Aug 5, 2026
- Custom provider: support Anthropic Messages API for Claude modelssharon-wang, Posit ai-lib team member (self-described: Posit's ai-lib provider bridge), GitHub issue, published Jul 30, 2026
- moonshot provider model list is four generations stalesophiaashi, GitHub user (self-described: The gateway's bundled model catalog), GitHub issue, published Jul 28, 2026
- Actively maintained fork of Portkeypunkpeye, founder of Glama and maintainer of the Lightport fork (self-described: Glama, whose AI gateway runs on Lightport, a fork of Portkey's gateway), GitHub issue, published Jul 18, 2026
- SSRF allowlist bypass and credential theft via /v1/proxy/* route, @portkey-ai/gateway 1.15.2 and earliergeo-chen, security researcher (self-described: Security review of the open-source gateway), GitHub issue, published Jul 3, 2026
- Centralized AI gateway has streamlined model routing, costs tracking, and data protectionAkashkhurana Hirana, Senior Software Engineer 2 at Porch (self-described: Porch, which calls Gemini, OpenAI, Claude and fine-tuned models through Portkey), Review, PeerSpot, published Jun 27, 2026
- Centralized AI control has standardized our workflows and delivers faster, more reliable featuresShravan Revanna, Software Engineer at Clydo (klydo.in) (self-described: Clydo, which routes internal copilots, catalog intelligence and support assistants through Portkey), Review, PeerSpot, published Jun 26, 2026
- [Enhancement]: custom endpoint implementation with openai responses api not compatible with anthropic native web searchxinguaws, GitHub user running a LibreChat deployment (self-described: A LibreChat deployment at ai.drwcloud.com calling Claude on Vertex AI through Portkey), GitHub issue, published Jun 23, 2026
- feat: Portkey gateway integration for enterprise routingsseshachala, owner of the ConductAI repository (self-described: ConductAI, asked by an enterprise prospect to route through its existing Portkey setup), GitHub issue, published Jun 9, 2026
- docs(sales): Portkey onboarding friction notes for demosseshachala, owner of the ConductAI repository (self-described: Notes from a sales follow-up on the Portkey integration), GitHub issue, published Jun 9, 2026
- Unified ai gateway has standardized observability and routing for multiple llm applicationsSinghAman, Generative AI Engineer at an outsourcing company with 10, 001+ employees (self-described: Two years of Portkey as the gateway and observability layer for LLM applications with US and EU endpoints), Review, PeerSpot, published Jun 5, 2026
- Prompt testing has become structured and flexible but trial access still needs improvementSupport Pan, project manager and delivery owner (self-described: A team trying Portkey as a LiteLLM alternative for prompt template testing), Review, PeerSpot, published May 31, 2026
- azure-ai-inference: no Responses API support, requests silently fall back to chatComplete with data lossdavidwhite-spec, GitHub user (self-described: Responses API calls to an Azure AI Inference key), GitHub issue, published May 30, 2026
- Build fails on 2.0.0: akto plugin committed to plugins/akto/ instead of src/plugins/akto/damray, GitHub user (self-described: Building the gateway's 2.0.0 branch), GitHub issue, published May 30, 2026
- Fix chat_portkey() error when PORTKEY_VIRTUAL_KEY is not setthisisnic, ellmer collaborator (self-described: ellmer's chat_portkey() provider for R), GitHub pull request, published May 26, 2026
- Streamed responses fail under concurrent load with "Response object has been garbage collected"meitalbensinai, GitHub user (self-described: Self-hosted gateway under concurrent streaming load), GitHub issue, published May 19, 2026
- feat(portkey): add intel modulejychp, Cartography collaborator (self-described: Cartography's security inventory of Portkey organizations), GitHub pull request, published May 6, 2026
- Show HN: Lightport, open-source AI gatewaystatements, founder of Glama (self-described: Glama, whose AI gateway Lightport began as a fork of Portkey), Hacker News post, published Apr 28, 2026
- Claude Opus 4.7 fails on Bedrock via custom provider with reasoning enabled (wrong thinking format)harsh-m-patil, Pi user (self-described: Pi coding agent calling Claude on Bedrock through Portkey), GitHub issue, published Apr 17, 2026
- Intermittent auth failures with Claude Code OAuth passthrough (mid-session)Yupei Chen, Wise Rock (GitHub profile) (self-described: Claude Code signed in through Anthropic OAuth on a Team plan, pointed at Portkey's hosted API as Portkey's OAuth docs describe), GitHub issue, published Apr 10, 2026
- Tool calls and file inputs fail with Responses API via Portkey for OpenAI, Azure OpenAI, and BedrockNilesh Darji, Founding Engineer at Heizen (his own site) (self-described: LangChain's ChatOpenAI on the Responses API, through Portkey's hosted API to Azure OpenAI and Bedrock), GitHub issue, published Mar 28, 2026
- Comment on: Tell HN: Litellm 1.82.7 and 1.82.8 on PyPI are compromisedtreefarmer, Hacker News commenter (self-described: Personal and side-project model access on Portkey's free plan), Hacker News comment, published Mar 24, 2026
- OpenAI Providers custom HTTP Headersevalstate, owner of the fast-agent repository (self-described: fast-agent's OpenAI-compatible providers), GitHub pull request, published Dec 6, 2025
- Connection errors in productionianbbqzy, GitHub user running the gateway in production (self-described: Production traffic through the gateway, with errors seen on OpenAI, Anthropic, and Mistral), GitHub issue, published Sep 24, 2025
- Removing 11,005 Lines: Why We Replaced Our Custom LLM Manager with Portkeyclayroach, developer of an open-source observability platform (self-described: An observability platform that replaced its own LLM manager with Portkey's gateway), Engineering blog post, DEV Community, published Sep 16, 2025
- Bug Report: Simple Cache Incorrectly Converted to Semantic Cache Causing Platform OutageLeonardo Marciano, CTO by his own GitHub profile (self-described: A platform on Portkey's hosted cloud), GitHub issue, published Jul 23, 2025
- Comment on: Show HN: Any-LLM, Lightweight router to access any LLM Providerswyx, Hacker News commenter (self-described: Comparing model routers), Hacker News comment, published Jul 22, 2025
- Show HN: Aqueduct AI Gateway, A Self-Hostable AI Gateway Without the Taxesmeffmadd, member of a small team at TU Vienna and author of Aqueduct (self-described: TU Vienna, which built its own gateway after evaluating LiteLLM, Portkey, and Kong), Hacker News post, published Jul 1, 2025
- Comment on: HN Slop: AI startup ideas generated from Hacker Newschandureddyvari, Hacker News commenter (self-described: An app hitting provider rate limits), Hacker News comment, published Jul 1, 2025
Jul 2025 to Oct 2026.
56 sources from practitioners, by month and sentiment.
Where It Fits
Where does Portkey belong in the stack?
Portkey is Core across Model, supports Operate, and touches Build, Data, and Evaluate.
- Business area
- Product & Engineering
- Function
- Software Development
- Operating stack
- AI Application Platform
- Primary role
- Governed AI Gateway & Request Logs
Model
Model APIs: Touches
Model APIs, touches. Portkey sells no model access: admins add their own provider keys to the Model Catalog, and each model maker bills its tokens.
Model gateway: Core
Model gateway, core. This is Portkey's primary role: one universal API with fallbacks, load balancing, retries, and caching on every plan, with budgets and rate limits on API keys on Enterprise and for select Pro customers.
Build
Orchestration: Touches
Orchestration, touches. Integration guides cover LangChain agents and coding tools such as Claude Code through the gateway. A framework such as LangGraph controls the agent's steps.
Tool use: Touches
Tool use, touches. Portkey documents integrations for agent libraries and coding tools that call models through it. The tools an agent calls run elsewhere.
Data
Retrieval: Touches
Retrieval, touches. Portkey routes embedding calls to the model makers on your keys and stores no search index; retrieval stays with a vector database or search product.
Evaluate
Evaluation: Touches
Evaluation, touches. Feedback on logged requests is on every plan and advanced evaluation templates are on Enterprise, while datasets and scoring at scale stay with an evaluation tool.
Operate
Observability: Supports
Observability, supports. Logs, traces, feedback, metadata, and filters on every plan, with alerts from Production, keep 3 days of logs on Developer and 30 on Production. Agent-step evaluation and long-term analysis stay with an observability tool.
Cloud deployment: Touches
Cloud deployment, touches. A hybrid Enterprise setup runs the data plane in your VPC with Portkey's control plane, and the open-source gateway runs on your servers; model capacity and quotas come from each model maker.
Guardrails: Supports
Guardrails, supports. Portkey Guardrails run deterministic and LLM based checks on requests and responses, including prompt injection scanning and moderation. Guardrail actions block or route failed calls.
Market mapThe layers Portkey covers, and who else owns each one.
Model gateways & routing
- LiteLLM
- OpenRouter
- Vercel AI Gateway
Observability & tracing
Guardrails & AI security
- Prisma AIRS
- NeMo Guardrails
Model APIs
Orchestration & agent frameworks
4 more layers on the full map. Core, Supports and Touches describe coverage. They say nothing about quality.
Models
Which models run in Portkey?
The current releases GILD tracks that public sources record running in Portkey. Each model's page charts its public benchmark scores.

