CentML

Details

Category

Inference Aggregators, Gateways & Routers

Founded

—

Status

Active

Open source

—

Pricing

Paid

Funding stage

Seed

Total raised

—

Popularity

Rising

Modality

Infrastructure

GitHub stars

—

Relationships

0 of 1 re-checked and confirmed, 1 under review · none yet backed by a published source.

News

• CentML lands $27M from Nvidia, others to make AI models run more efficiently - TechCrunch
  TechCrunch · 10/25/2023

More in Inference Aggregators, Gateways & Routers

• AI/ML APIAggregated API access to hundreds of AI models under one key.
• AnyscaleManaged Ray platform for scaling AI and Python workloads, including LLM serving.
• BasetenPlatform for deploying and serving custom ML models in production.
• Cloudflare Workers AIServerless inference running on Cloudflare's global edge network.
• DeepInfraLow-cost hosted inference for open-source models.
• Featherless AISubscription API giving unlimited access to a large catalog of open models.
• Fireworks AIFast, low-cost inference platform for open and custom models.
• GMI CloudGPU cloud provider focused on AI training and inference workloads.
• GroqCustom LPU chip maker offering extremely low-latency LLM inference.
• HeliconeOpen-source LLM observability platform that also proxies requests.
• HyperbolicDecentralized GPU cloud and inference marketplace.
• LangDBAI gateway with governance, routing, and observability for LLM traffic.