LiteLLM
Inference Aggregators, Gateways & Routers
Last updated · Compiled from public sources with automated enrichment
Loading the map…
Open-source library providing a unified API across LLM providers.
Visit websiteDetails
- Category
- Inference Aggregators, Gateways & Routers
- Founded
- —
- Status
- Active
- Open source
- Yes
- Pricing
- Free
- Funding stage
- Bootstrapped
- Total raised
- —
- Popularity
- Trending
- Modality
- Infrastructure
- GitHub stars
- —
Relationships
12 of 12 confirmed by two independent sources · 12 backed by a published source.
- LangDBLangDB competes with LiteLLM in unified LLM gateway infrastructure.
- MartianMartian competes with LiteLLM in unified LLM routing infrastructure.
- OpenRouterBoth provide unified APIs for routing requests across LLM providers.
- PortkeyBoth offer LLM gateways with provider routing and observability.
- Vercel AI GatewayCompetes with LiteLLM's unified API and model gateway capabilities.
- AnthropicLiteLLM supports routing requests to Anthropic Claude models.
- DeepInfraDeepInfra is supported as a provider through LiteLLM.
- Nebius AI StudioLiteLLM integrates with Nebius AI Studio's OpenAI-compatible API.
- Novita AILiteLLM supports Novita AI as a configured model provider.
- SambaNova CloudLiteLLM supports SambaNova Cloud through its unified provider API.
- Together AILiteLLM includes Together AI as a supported inference provider.
References
Published sources supporting the relationships above.
- LangDB vs. LiteLLM Comparison
unknown publisher · supports LangDB competes with LiteLLM
- Together AI | liteLLM
unknown publisher · supports LiteLLM integrates with Together AI
- Providers | liteLLM
unknown publisher · supports LiteLLM integrates with Together AI
- Anthropic | liteLLM
unknown publisher · supports LiteLLM integrates with Anthropic
- Anthropic (Claude) | juspay/litellm | DeepWiki
unknown publisher · supports LiteLLM integrates with Anthropic
- /v1/messages | liteLLM
unknown publisher · supports LiteLLM integrates with Anthropic
- Providers | liteLLM
unknown publisher · supports LiteLLM integrates with Anthropic
- Using Anthropic File API with LiteLLM Proxy | liteLLM
unknown publisher · supports LiteLLM integrates with Anthropic
- OpenRouter vs LiteLLM vs Bifrost: AI Gateway Comparison
unknown publisher · supports LiteLLM competes with OpenRouter
- LiteLLM vs OpenRouter: I Used Both. Here's Where Each One Actually Broke. - DEV Community
unknown publisher · supports LiteLLM competes with OpenRouter
- Portkey AI v/s LiteLLM
unknown publisher · supports LiteLLM competes with Portkey
- LiteLLM vs Portkey, Kong, Cloudflare
unknown publisher · supports LiteLLM competes with Portkey
- Top 5 LiteLLM Alternatives in 2026
unknown publisher · supports LiteLLM competes with Portkey
- LiteLLM vs Portkey: when to use one over the other
unknown publisher · supports LiteLLM competes with Portkey
- DeepInfra | liteLLM
unknown publisher · supports DeepInfra integrates with LiteLLM
- Providers | liteLLM
unknown publisher · supports DeepInfra integrates with LiteLLM
- https://raw.githubusercontent.com/BerriAI/litellm/main/README.md
unknown publisher · supports DeepInfra integrates with LiteLLM
- [Feature]: Support DeepInfra embeddings with parameters · Issue #12110 · BerriAI/litellm · GitHub
unknown publisher · supports DeepInfra integrates with LiteLLM
- LiteLLM vs Martian (2026) | Respan
unknown publisher · supports Martian competes with LiteLLM
- The LLM Gateway Market in 2026: LiteLLM, Portkey, and Martian's Battle for Enterprise AI Routing | AgentMarketCap
unknown publisher · supports Martian competes with LiteLLM
- LiteLLM vs Portkey vs Martian: LLM Gateway Compared
unknown publisher · supports Martian competes with LiteLLM
- Best Open-Source LLM Router 2026: LiteLLM vs RouteLLM vs Martian
unknown publisher · supports Martian competes with LiteLLM
- The LLM Gateway & Router Index (2026) · OpenRouter, LiteLLM, Portkey & more · Aiprosol
unknown publisher · supports Martian competes with LiteLLM
- Nebius AI Studio | liteLLM
unknown publisher · supports LiteLLM integrates with Nebius AI Studio
- Agent 101: Launching production-grade agents at scale
unknown publisher · supports LiteLLM integrates with Nebius AI Studio
- Using Nebius AI Models with LangChain/Langgraph via LiteLLM - DEV Community
unknown publisher · supports LiteLLM integrates with Nebius AI Studio
- Providers | liteLLM
unknown publisher · supports LiteLLM integrates with Nebius AI Studio
- LiteLLM - Documentation
unknown publisher · supports LiteLLM integrates with Novita AI
- Novita AI | liteLLM
unknown publisher · supports LiteLLM integrates with Novita AI
- LiteLLM - Getting Started | liteLLM
unknown publisher · supports LiteLLM integrates with Novita AI
- LLM Integrations - Semantica
unknown publisher · supports LiteLLM integrates with Novita AI
- Portkey vs LiteLLM (2026): AI Gateways Compared | Kosmoy
unknown publisher · supports Portkey competes with LiteLLM
- Portkey AI v/s LiteLLM
unknown publisher · supports Portkey competes with LiteLLM
- Portkey vs LiteLLM vs OpenRouter: LLM Gateway 2026 — PkgPulse Guides
unknown publisher · supports Portkey competes with LiteLLM
- LiteLLM vs Portkey, Kong, Cloudflare
unknown publisher · supports Portkey competes with LiteLLM
- Portkey vs LiteLLM: Which is Best?
unknown publisher · supports Portkey competes with LiteLLM
- SambaNova Cloud — LLM Infrastructure AI Tool | AIchitect
unknown publisher · supports LiteLLM integrates with SambaNova Cloud
- Top LiteLLM Alternatives in 2026: Compared by Cost, Performance & Features
unknown publisher · supports Vercel AI Gateway competes with LiteLLM
- LiteLLM vs Vercel AI Gateway (2026): Self-Hosted vs Managed - API7.ai
unknown publisher · supports Vercel AI Gateway competes with LiteLLM
- Best 5 Vercel AI Gateway Alternatives 2026: For Scaling
unknown publisher · supports Vercel AI Gateway competes with LiteLLM
- LiteLLM vs Vercel AI Gateway (2026) | Respan
unknown publisher · supports Vercel AI Gateway competes with LiteLLM
- 10 Best LLM Gateways in 2026 (Compared & Ranked) | Respan
unknown publisher · supports Vercel AI Gateway competes with LiteLLM
News
- Copilot, LiteLLM and the AI trust boundary gap - VentureBeatVentureBeat · 6/18/2026
- Mercor says it was hit by cyberattack tied to compromise of open source LiteLLM project - TechCrunchTechCrunch · 3/31/2026
- Popular AI gateway startup LiteLLM ditches controversial startup Delve - TechCrunchTechCrunch · 3/30/2026
- Silicon Valley’s two biggest dramas have intersected: LiteLLM and Delve - TechCrunchTechCrunch · 3/26/2026
More in Inference Aggregators, Gateways & Routers
- AI/ML APIAggregated API access to hundreds of AI models under one key.
- AnyscaleManaged Ray platform for scaling AI and Python workloads, including LLM serving.
- BasetenPlatform for deploying and serving custom ML models in production.
- CentMLInference optimization platform for reducing LLM serving costs.
- Cloudflare Workers AIServerless inference running on Cloudflare's global edge network.
- DeepInfraLow-cost hosted inference for open-source models.
- Featherless AISubscription API giving unlimited access to a large catalog of open models.
- Fireworks AIFast, low-cost inference platform for open and custom models.
- GMI CloudGPU cloud provider focused on AI training and inference workloads.
- GroqCustom LPU chip maker offering extremely low-latency LLM inference.
- HeliconeOpen-source LLM observability platform that also proxies requests.
- HyperbolicDecentralized GPU cloud and inference marketplace.