- Getting Started | liteLLM
LiteLLM is an open-source library that gives you a single, unified interface to call 100+ LLMs — OpenAI, Anthropic, Vertex AI, Bedrock, and more — using the OpenAI format
- GitHub - BerriAI litellm: Python SDK, Proxy Server (AI Gateway) to call . . .
You can use LiteLLM through either the Proxy Server or Python SDK Both gives you a unified interface to access multiple LLMs (100+ LLMs) Choose the option that best fits your needs: Who Uses It? LiteLLM Performance: 8ms P95 latency at 1k RPS (See benchmarks here) Stable Release: Use docker images with the -stable tag
- LiteLLM Supply Chain Attack: What Happened, Whos Affected, and What . . .
LiteLLM — 95 million downloads per month, a dependency of CrewAI, DSPy, Browser-Use, Opik, and nearly every major AI agent framework — was hit by a supply chain attack Here is what happened, how we responded, and what you should do right now
- litellm · PyPI
LiteLLM follows the Google Python Style Guide Our automated checks include: All these checks must pass before your PR can be merged Need for simplicity: Our code started to get extremely complicated managing translating calls between Azure, OpenAI and Cohere
- A gentle introduction to LiteLLM - Medium
Born out of the illustrious Y Combinator program, LiteLLM is a lightweight, powerful abstraction layer that unifies LLM API calls across providers — whether you’re calling OpenAI, Anthropic,
- Popular LiteLLM PyPI package backdoored to steal . . . - BleepingComputer
The TeamPCP hacking group continues its supply-chain rampage, now compromising the massively popular "LiteLLM" Python package on PyPI and claiming to have stolen data from hundreds of thousands of
- LiteLLM
LiteLLM streamlines the complexities of managing multiple LLM models Why Enterprise? LLM Gateway (OpenAI Proxy) to manage authentication, loadbalancing, and spend tracking across 100+ LLMs All in the OpenAI format
- TeamPCP Backdoors LiteLLM Versions 1. 82. 7–1. 82. 8 via Trivy CI CD Compromise
TeamPCP, the threat actor behind the recent compromises of Trivy and KICS, has now compromised a popular Python package named litellm, pushing two malicious versions containing a credential harvester, a Kubernetes lateral movement toolkit, and a persistent backdoor Multiple security vendors, including Endor Labs and JFrog, revealed that litellm versions 1 82 7 and 1 82 8 were published on
|