LiteLLM
API Tool
Free
Unified OpenAI-shaped API over 100+ LLM providers. SDK or proxy mode, with cost tracking, fallback, and virtual keys.
Key features
- 100+ providers
- OpenAI-compatible
- Cost + spend tracking
- Proxy with virtual keys
Pros
- Swap providers without code changes
- Production-ready proxy
- MCP + A2A support
Cons
- Another layer to operate
- Proxy adds latency for low-scale use
llm-gatewayproxyroutingobservability
Try LiteLLM on AIniverse
Read full reviews, see what other builders think, save to your stack.
Open in App · Visit siteMore API Tool tools
Vercel AI SDK
Free
The Vercel AI SDK is a free open-source library that provides the tools needed to build AI-powered products. It offer...
Groq
Freemium
Groq delivers fast, low-cost inference that doesn’t flake when things get real, and is used by over 3 million develop...
RAGFlow
Free
Enterprise-grade RAG engine with deep document understanding. Handles messy PDFs, tables, and scans better than most ...