LiteLLM
API Tool
Free
Unified OpenAI-shaped API over 100+ LLM providers. SDK or proxy mode, with cost tracking, fallback, and virtual keys.
Key features
- 100+ providers
- OpenAI-compatible
- Cost + spend tracking
- Proxy with virtual keys
Pros
- Swap providers without code changes
- Production-ready proxy
- MCP + A2A support
Cons
- Another layer to operate
- Proxy adds latency for low-scale use
llm-gatewayproxyroutingobservability
Try LiteLLM on AIniverse
Read full reviews, see what other builders think, save to your stack.
Open in App · Visit siteMore API Tool tools
Vercel AI SDK
Free
The Vercel AI SDK is a free open-source library that provides the tools needed to build AI-powered products. It offer...
Groq
Freemium
Groq delivers fast, low-cost inference that doesn’t flake when things get real, and is used by over 3 million develop...
LiteRT
Free
LiteRT (formerly TensorFlow Lite) is Google's AI Edge runtime for running models on-device across Android, iOS, and e...
TurboVec
Free
TurboVec is a Rust vector index with Python bindings that compresses embedding vectors with Google Research's TurboQu...