ModelRefs / PortKey — AI Glossary
PortKey — AI Glossary
An AI gateway and observability platform providing unified API access, semantic caching, fallback routing, and LLM tracing. Also called Portkey AI.
Overview
PortKey unifies 200+ LLM providers under one API with automatic fallback (switch to backup provider on failure), semantic caching (cache similar requests by embedding similarity), load balancing across providers, and detailed observability traces. Targets production-grade multi-provider architectures.
Reference details
| Topic | infrastructure |
|---|---|
| Also known as | Portkey AI |
| Last reviewed | 2026-06-24 |
Related terms
Commonly confused with
An AI gateway with observability attached, which puts it in two categories at once — compare it with LiteLLM on the gateway axis and with Langfuse or Helicone on the observability axis. The gateway function is the load-bearing one: unified access, fallback routing and caching are things a request path does, whereas observability is something that watches it.
Continue your research
Use these connected ModelRefs sections to compare alternatives, inspect implementation paths, and review the evidence and governance boundaries relevant to PortKey — AI Glossary.
Frequently asked questions
What is PortKey?
An AI gateway and observability platform providing unified API access, semantic caching, fallback routing, and LLM tracing.
Is PortKey the same as Portkey AI?
Yes — Portkey AI are common aliases for PortKey.
What concepts are related to PortKey?
Closely related concepts include litellm, gateway, model routing.