One interface for 100+ LLMs, in OpenAI format

githubprojects@opensourceprojects.dev (githubprojects) · Sep 15, 2026 · via Open Source Projects · 1 min read

Open original ↗

berriai/litellm

★ 58.8K⑂ 11.5K

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

Python#ai-gateway#anthropic#azure-openai#bedrock#gateway#langchain
View on GitHub ↗Homepage ↗
You've probably got a folder somewhere with API keys for OpenAI, Anthropic, Gemini, and maybe Bedrock, each with its own client library, its own auth pattern, and its own idea of what a "message" looks like. Every time you want to try a new model, you're back in the docs learning another SDK. LiteLL... GitHub Repository: https://github.com/berriai/litellm

Rendered from the publisher's own feed content.

Comments

Sign in to join the discussion.