LLM providers, compared
These are the commercial model APIs most AI systems start with. The choice usually turns on fit more than on a benchmark: the cloud you already use, where your data may go, and what the work leans on. Whichever you pick, a gateway keeps switching cheap.
Learn the idea Which AI model is best? GPT, Claude, Gemini and the rest on Horizon
Open this layer in the explorerAt a glance
Every tool in this layer, with where it fits and the facts that usually decide it.
| Tool | Where it fits | Licence | Self-hostable | Hosted API | Maturity |
|---|---|---|---|---|---|
| OpenAI Frontier model API | A safe default to start with when you want capable models, mature APIs, and the deepest pool of examples and support. | Proprietary | No | Yes | Mature |
| Amazon Bedrock Managed model platform | The natural choice for AWS-committed organisations that want model access inside their existing account and governance. | Proprietary | No | Yes | Established |
| Anthropic Frontier model API | A strong default when reasoning quality, long-context handling, or tool-use reliability are central to the work. | Proprietary | No | Yes | Established |
| Azure AI Foundry Managed model platform | The default for Azure-committed enterprises wanting OpenAI and other models inside Azure governance and compliance. | Proprietary | No | Yes | Established |
| Cohere Enterprise model API | A fit when retrieval and ranking quality matter, or when an enterprise wants private deployment and strong data-control terms. | Proprietary | No | Yes | Established |
| Google Gemini Frontier model API | A natural fit for very long-context or multimodal work, and for teams already standardised on Google Cloud. | Proprietary | No | Yes | Established |
| Mistral AI Frontier model API | A strong fit when European data residency or a non-US model vendor is a requirement, and for efficient, cost-aware models. | Proprietary | No | Yes | Established |
| xAI Grok Frontier model API | A fit when you want another frontier-tier provider in the mix, particularly where access to real-time social data is useful. | Proprietary | No | Yes | Growing |
How to choose
Start from your situation. Where a line says “our”, it comes from Comet Lab’s own builds.
-
Starting a new build
A safe default: capable models, mature APIs and the deepest pool of examples.
-
Reasoning and tool use carry the work
Claude is our frequent pick where reasoning, long context and tool-use reliability are central.
-
Very long context, multimodal input, or a client on Google Cloud
Some of the longest context windows on the market, and Vertex AI keeps it inside Google Cloud governance.
-
Models must stay inside your cloud account
Bedrock for AWS, Azure AI Foundry for Azure: model access inside the governance you already have.
-
A European provider
Our usual answer for EU data residency. It also publishes open weights, which makes a later move to self-hosting easier.
-
Retrieval and ranking quality
Models built for retrieval and ranking, with private deployment for enterprises.