LiteLLM

LiteLLM serves as a robust gateway for developers to access over 100 large language models (LLMs) while maintaining complete control over model usage and logging. With support for the OpenAI format, this tool allows for seamless integration and management of various LLMs such as Azure, Gemini, Bedrock, and OpenAI itself. One of the standout features includes comprehensive logging and usage tracking, which can be directed to platforms like S3, Datadog, and OTEL, ensuring that developers can monitor their API interactions effectively.

In addition to logging, LiteLLM provides advanced control over model access through virtual keys, enabling teams to manage permissions easily. Users can set budgets and rate limits on a per-model basis, facilitating cost management within projects. The platform's self-serve portal empowers teams to manage their own keys and access configurations, promoting efficiency and flexibility in development workflows. Use cases for LiteLLM include rapid project migrations via pass-through endpoints and developing applications that require diverse language model interactions without compromising on control or oversight.

Open Source:
- Self-hosted access
- 100+ LLM provider integrations
- Virtual keys, budgets, and teams management
- $0/month

Enterprise Basic:
- Cloud or self-hosted
- Everything in Open Source
- Enhanced support options
- Custom pricing

Enterprise Premium:
- Cloud or self-hosted
- Everything in Enterprise Basic
- Enterprise support with custom SLAs
- JWT authentication, SSO, and audit logs
- Custom pricing