litellm
VerifiedThe fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropi
What is litellm?
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
litellm is a open-source ai api tool. It runs on web and offers features like . The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropi.
If you are comparing options, popular alternatives to litellm include ChatGPT, Claude, Google Gemini. Each has different strengths depending on your budget and workflow.
litellm interface preview
Who is using litellm?
Quick verdict
open-source
ChatGPT — Conversational AI by OpenAI
Scorecard
Platforms
web
Categories
GitHub
★ 56,216
Added
2026-08-13
Getting started with litellm
- 1Visit the official website at github.com
- 2Clone or fork the repository on GitHub to self-host
- 3Integrate it into your workflow — use it on web
Pricing
litellm FAQ
Is litellm free to use?
litellm is open source, so you can use and self-host it for free.
What platforms does litellm support?
litellm is available on web. Check the official website for the most up-to-date platform availability.
What are some litellm alternatives?
Popular alternatives include ChatGPT, Claude, Google Gemini. See the full comparison →
User reviews
Alternatives to litellm
Similar tools in the same categories
| Tool | Pricing | Rating | Highlights |
|---|---|---|---|
| litellm | open-source | — | The fastest, litest AI Gateway. Rust core with Pyt |
| ChatGPT | freemium $20 | 4.7 | Conversational AI by OpenAI |
| Claude | freemium $20 | 4.8 | AI assistant by Anthropic |
| Google Gemini | freemium $20 | 4.3 | Multimodal AI by Google |
| OpenAI API | paid | 4.6 | GPT models via API |
| Anthropic API | paid | 4.7 | Claude models via API |
Get the next tool stack in your inbox
Weekly email for indie developers: new AI tools, curated stacks, and growth tips. No spam.
Free. Unsubscribe anytime.