12 alternatives to Groq in Inference Aggregators, Gateways & Routers. 5 of them are tracked direct competitors.
| Company | Pricing | Open source | Funding |
|---|---|---|---|
| Groqthis pageCustom LPU chip maker offering extremely low-latency LLM inference. | Enterprise | No | Series D+ |
| AWS (Trainium/Inferentia)direct competitorAmazon's custom silicon for AI training and inference. | Paid | No | Public |
| Graphcoredirect competitorBritish AI chipmaker building IPU accelerators for training and inference. | Paid | No | Series D+ |
| Intel (Gaudi)direct competitorIntel's Gaudi AI accelerator chip line. | Paid | No | Public |
| NVIDIAdirect competitorDominant maker of GPUs powering most AI training and inference. | Enterprise | No | Public |
| OpenAIdirect competitorCreator of GPT and ChatGPT, one of the leading frontier AI labs. | Freemium | No | Series D+ |
| AI/ML APIAggregated API access to hundreds of AI models under one key. | Paid | No | Unknown |
| AnyscaleManaged Ray platform for scaling AI and Python workloads, including LLM serving. | Enterprise | Yes | Series C |
| BasetenPlatform for deploying and serving custom ML models in production. | Paid | No | Series A |
| CentMLInference optimization platform for reducing LLM serving costs. | Paid | — | Seed |
| Cloudflare Workers AIServerless inference running on Cloudflare's global edge network. | Paid | No | Public |
| DeepInfraLow-cost hosted inference for open-source models. | Freemium | No | Unknown |
| Featherless AISubscription API giving unlimited access to a large catalog of open models. | Paid | — | Unknown |
Direct competitors are curated relationships in the index. The remaining entries share the Inference Aggregators, Gateways & Routers category.