opensourcestartups

// AI & ML

LiteLLM

LiteLLM

Call every LLM API like it's OpenAI [100+ LLMs]

LiteLLM is an open source ai & ml project written in Python, with 46,158 stars and 7,856 forks on GitHub. It is licensed under NOASSERTION and falls in the AI & ML category. Key topics: ai-gateway, anthropic, azure-openai, bedrock, gateway.

// FACTS

Stars
46.2k
Forks
7.9k
Open issues
2.9k
Language
Python
License
NOASSERTION
Category
AI & ML
Added
10d ago
Updated
9d ago

// ABOUT

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

// TOPICS

AI-GATEWAYANTHROPICAZURE-OPENAIBEDROCKGATEWAYLANGCHAINLITELLMLLMLLM-GATEWAYLLMOPSMCP-GATEWAYOPENAIOPENAI-PROXYVERTEX-AI

// REVIEWS [000]

No reviews yet — be the first.

$ WRITE A REVIEW

RATING

// COMMENTS [000]

No comments yet.

$ ADD A COMMENT