https://github.com/BerriAI/litellm
ai-gateway anthropic azure-openai bedrock gateway langchain litellm llm llm-gateway llmops mcp-gateway openai openai-proxy rust rust-ai vertex-ai
Score: 36.844753955863894
Last synced: about 7 hours ago
JSON representation
Repository metadata:
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
- Host: GitHub
- URL: https://github.com/BerriAI/litellm
- Owner: BerriAI
- License: other
- Created: 2023-07-27T00:09:52.000Z (about 3 years ago)
- Default Branch: main
- Last Pushed: 2026-10-12T10:31:03.000Z (about 23 hours ago)
- Last Synced: 2026-10-12T10:34:07.768Z (about 23 hours ago)
- Topics: ai-gateway, anthropic, azure-openai, bedrock, gateway, langchain, litellm, llm, llm-gateway, llmops, mcp-gateway, openai, openai-proxy, rust, rust-ai, vertex-ai
- Language: Python
- Homepage: https://docs.litellm.ai/docs/
- Size: 2.04 GB
- Stars: 61,039
- Watchers: 238
- Forks: 12,244
- Open Issues: 5,465
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- Funding: .github/FUNDING.yml
- License: LICENSE
- Codeowners: .github/CODEOWNERS
- Security: security.md
- Agents: AGENTS.md
- Gemini: GEMINI.md
-
Funding:
- Custom: https://buy.stripe.com/9AQ03Kd3P91o0Q8bIS
Owner metadata:
- Name: Berri AI
- Login: BerriAI
- Email: founders@berri.ai
- Kind: organization
- Description: The fastest way to take your LLM app to production
- Website: https://docs.litellm.ai/docs/
- Location:
- Twitter:
- Company:
- Icon url: https://avatars.githubusercontent.com/u/121462774?v=4
- Repositories: 1
- Last Synced at: 2026-10-12T12:45:30.112Z
- Profile URL: https://github.com/BerriAI
Committers metadata
Last synced: 1 day ago
Total Commits: 36,680
Total Committers: 1,484
Avg Commits per committer: 24.717
Development Distribution Score (DDS): 0.623
Commits in past year: 15,076
Committers in past year: 809
Avg Commits per committer in past year: 18.635
Development Distribution Score (DDS) in past year: 0.861
| Name | Commits | |
|---|---|---|
| Ishaan Jaff | i****4@g****m | 13841 |
| Krrish Dholakia | k****a@g****m | 8083 |
| Sameer Kankute | s****r@b****i | 1665 |
| yuneng-jiang | y****g@g****m | 1453 |
| Yuneng Jiang | y****g@b****i | 1067 |
| mateo-berri | 2****i | 930 |
| Chesars | c****4@g****m | 518 |
| ryan-crabbe-berri | r****n@b****i | 488 |
| Tin Chi Lo | t****n@b****i | 421 |
| user | 7****f | 341 |
| Yassin Kortam | y****n@b****i | 304 |
| Alexsander Hamir | a****a@g****m | 283 |
| Yuta Saito | u****c@b****p | 263 |
| Harshit Jain | 4****j | 253 |
| Julio Quinteros Pro | j****r@g****m | 251 |
| Ishaan Jaffer | i****n@b****i | 219 |
| mubashir1osmani | m****7@g****m | 194 |
| Ryan Crabbe | r****e@b****u | 184 |
| devin-ai-integration[bot] | 1****] | 180 |
| shivam | s****m@b****i | 168 |
| Jugal D. Bhatt | 5****b | 153 |
| Krrish Dholakia | k****b@b****i | 150 |
| yucheng-berri | y****g@b****i | 147 |
| Cole McIntosh | 8****h | 137 |
| David Manouchehri | d****i@a****a | 121 |
| Cursor Agent | c****t@c****m | 114 |
| milan-berri | m****n@b****i | 101 |
| michelligabriele | g****i@i****m | 97 |
| tanjiro | 5****r | 95 |
| Achintya Rajan | a****3@g****m | 92 |
| and 1454 more... | ||
Issue and Pull Request metadata
Last synced: about 8 hours ago
Total issues: 5,812
Total pull requests: 9,992
Average time to close issues: about 1 month
Average time to close pull requests: 8 days
Total issue authors: 2,910
Total pull request authors: 1,779
Average comments per issue: 1.91
Average comments per pull request: 2.17
Merged pull request: 5,742
Bot issues: 4
Bot pull requests: 321
Past year issues: 413
Past year pull requests: 1,363
Past year average time to close issues: 3 months
Past year average time to close pull requests: about 1 month
Past year issue authors: 331
Past year pull request authors: 528
Past year average comments per issue: 2.06
Past year average comments per pull request: 6.47
Past year merged pull request: 235
Past year bot issues: 2
Past year bot pull requests: 179
Top Issue Authors
- krrishdholakia (510)
- ishaan-jaff (424)
- Manouchehri (132)
- superpoussin22 (62)
- jamesbraza (48)
- emerzon (47)
- mubashir1osmani (30)
- paul-gauthier (28)
- berri-teddy (25)
- jeromeroussin (24)
- taralika (24)
- Clad3815 (22)
- TeddyAmkie (22)
- mirodrr2 (21)
- mvrodrig (20)
Top Pull Request Authors
- ishaan-jaff (2,850)
- krrishdholakia (1,923)
- colesmcintosh (173)
- devin-ai-integration[bot] (162)
- jugaldb (144)
- dependabot[bot] (143)
- NANDINI-star (134)
- yuneng-berri (129)
- mateo-berri (99)
- msabramo (94)
- Manouchehri (71)
- tin-berri (47)
- mubashir1osmani (47)
- Sameerlite (39)
- emerzon (38)
Top Issue Labels
- bug (3,227)
- enhancement (1,519)
- stale (684)
- mlops user request (317)
- llm translation (306)
- proxy (185)
- awaiting: user response (71)
- enterprise (64)
- feb 2025 (41)
- help wanted (39)
- SDK (31)
- claude code (29)
- ui (27)
- high priority (24)
- unable to repro (22)
- april 2025 (20)
- good first issue (20)
- march 2025 (19)
- P0 (17)
- ui-dashboard (15)
- august 2025 (11)
- bedrock (11)
- urgent (9)
- under review (9)
- P1 (9)
- langfuse (8)
- spend tracking (7)
- security (7)
- new model (7)
- docs (7)
Top Pull Request Labels
- stale (298)
- dependencies (145)
- javascript (78)
- bug (46)
- korbit-code-analysis (42)
- python (37)
- enhancement (28)
- github_actions (25)
- run-ci (23)
- changes requested (19)
- awaiting: user response (19)
- new model (5)
- high priority (4)
- codex (4)
- missing testing (2)
- under review (2)
- internal (1)
- area/build (1)
- A-devp2p (1)
- run ci (1)
- C-enhancement (1)
- unable to repro (1)
- ⚡️ codeflash (1)
- pending updates (1)
- outdated (1)
- blocked (1)
- bump-cask-pr (1)
- documentation (1)
- duplicate (1)
- rust (1)
Package metadata
- Total packages: 23
-
Total downloads:
- pypi: 101,636,652 last-month
- conda: 827 total
- cargo: 17 total
- Total docker downloads: 32,103
- Total dependent packages: 116 (may contain duplicates)
- Total dependent repositories: 1 (may contain duplicates)
- Total versions: 5,200
- Total maintainers: 7
- Total advisories: 42
proxy.golang.org: github.com/BerriAi/litellm
- Homepage:
- Documentation: https://pkg.go.dev/github.com/BerriAi/litellm#section-documentation
- Licenses: other
- Latest release: v1.105.0 (published 2 days ago)
- Last Synced: 2026-10-11T23:38:09.749Z (1 day ago)
- Versions: 1,117
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent packages count: 4.432%
- Average: 4.581%
- Dependent repos count: 4.73%
proxy.golang.org: github.com/berriai/litellm
- Homepage:
- Documentation: https://pkg.go.dev/github.com/berriai/litellm#section-documentation
- Licenses: other
- Latest release: v1.105.0 (published 2 days ago)
- Last Synced: 2026-10-11T23:37:59.213Z (1 day ago)
- Versions: 1,117
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Stargazers count: 0.767%
- Forks count: 1.042%
- Average: 4.969%
- Dependent packages count: 8.491%
- Dependent repos count: 9.576%
proxy.golang.org: github.com/BerriAI/litellm/cookbook/gollem_go_agent_framework
- Homepage: https://github.com/BerriAI/litellm
- Documentation: https://pkg.go.dev/github.com/BerriAI/litellm/cookbook/gollem_go_agent_framework#section-documentation
- Licenses: MIT
- Latest release: v0.0.0-20260611001636-496f5b98598e (published 4 months ago)
- Last Synced: 2026-10-11T23:37:37.064Z (1 day ago)
- Versions: 49
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent packages count: 4.815%
- Average: 4.977%
- Dependent repos count: 5.139%
pypi.org: litellm
Library to easily interface with LLM API providers
- Homepage: https://litellm.ai
- Documentation: https://docs.litellm.ai
- Licenses: MIT
- Latest release: 1.105.0 (published 2 days ago)
- Last Synced: 2026-10-12T09:31:50.864Z (1 day ago)
- Versions: 1,493
- Dependent Packages: 116
- Dependent Repositories: 1
- Downloads: 92,239,101 Last month
- Docker Downloads: 32,103
-
Rankings:
- Dependent packages count: 0.32%
- Downloads: 0.719%
- Docker downloads count: 3.809%
- Average: 6.596%
- Dependent repos count: 21.535%
- Maintainers (1)
-
Advisories:
- LiteLLM: Authenticated SSRF and provider-credential exfiltration via unvalidated request-body routing parameters
- LiteLLM Proxy has server-side request forgery via the `user_config` request parameter
- LiteLLM vulnerable to server-side template injection in the /prompts/test endpoint
- LiteLLM: Custom Code Guardrails production endpoints bypass code safety checks
- LiteLLM: MCP Authentication Bypass via OAuth2 Passthrough Fallback
- LiteLLM: Local file read via request-supplied OIDC file references
- LiteLLM: Arbitrary file write via path traversal in Skills archive extraction
- BerriAI litellm has Security Feature Bypass in BannedKeywords and AzureContentSafety Guardrails via call_type Mismatch on Async Endpoints
- BerriAI litellm: SSO Login Does Not Invalidate Previous UI Session Tokens
- BerriAI litellm has SSRF via Unvalidated spec_path URL in MCP OpenAPI Spec Loader
- BerriAI litellm: UI User Enumeration leads to System-Wide Information Disclosure
- LiteLLM: SSO Debug Flow Has Improper Authentication
- LiteLLM: MCP Proxy Has Improper Authentication
- LiteLLM: Admin Key Handler Has Improper Authorization
- LiteLLM: PROXY_ADMIN database API Key Generator Has Insufficient Session Expiration
- LiteLLM: M2M JWT Handler Has Improper Authorization
- LiteLLM: Authentication Bypass via Host Header Injection
- LiteLLM allows a user to modify their own user_role via the /user/update endpoint
- LiteLLM allows an authenticated internal_user to create API keys with access to routes that their role does not permit
- LiteLLM has a sandbox escape in custom-code guardrail
- LiteLLM: Authenticated command execution via MCP stdio test endpoints
- LiteLLM has SQL Injection in Proxy API key verification
- LiteLLM: Server-Side Template Injection in /prompts/test endpoint
- Duplicate Advisory: LiteLLM has a sandbox escape in custom-code guardrail
- LiteLLM: Password hash exposure and pass-the-hash authentication bypass
- LiteLLM: Authentication bypass via OIDC userinfo cache key collision
- LiteLLM: Privilege escalation via unrestricted proxy configuration endpoint
- Two LiteLLM versions published containing credential harvesting malware
- LiteLLM Has a Leakage of Langfuse API Keys
- LiteLLM Has an Improper Authorization Vulnerability
- LiteLLM Reveals Portion of API Key via a Logging File
- LiteLLM Vulnerable to Denial of Service (DoS) via Crafted HTTP Request
- LiteLLM Vulnerable to Remote Code Execution (RCE)
- LiteLLM Vulnerable to Denial of Service (DoS)
- LiteLLM Server-Side Request Forgery (SSRF) vulnerability
- litellm vulnerable to improper access control in team management
- litellm vulnerable to remote code execution based on using eval unsafely
- SQL injection in litellm
- Arbitrary file deletion in litellm
- SQL injection in litellm
- litellm passes untrusted data to `eval` function without sanitization
- LiteLLM has Server-Side Template Injection vulnerability in /completions endpoint
proxy.golang.org: github.com/BerriAI/litellm
- Homepage:
- Documentation: https://pkg.go.dev/github.com/BerriAI/litellm#section-documentation
- Licenses: other
- Latest release: v1.105.0 (published 2 days ago)
- Last Synced: 2026-10-11T23:37:57.521Z (1 day ago)
- Versions: 1,117
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent packages count: 8.491%
- Average: 9.034%
- Dependent repos count: 9.576%
pypi.org: litellm_ad
Library to easily interface with LLM API providers
- Homepage: https://litellm.ai
- Documentation: https://docs.litellm.ai
- Licenses: MIT
- Latest release: 1.76.1 (published about 1 year ago)
- Last Synced: 2026-10-11T23:37:43.635Z (1 day ago)
- Versions: 2
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 30 Last month
-
Rankings:
- Stargazers count: 0.326%
- Forks count: 0.342%
- Dependent packages count: 8.64%
- Average: 14.498%
- Dependent repos count: 48.686%
- Maintainers (1)
pypi.org: litellm-slipstream-fork
Library to easily interface with LLM API providers
- Homepage: https://litellm.ai
- Documentation: https://docs.litellm.ai
- Licenses: MIT
- Latest release: 1.74.7 (published about 1 year ago)
- Last Synced: 2026-10-11T23:37:47.675Z (1 day ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 25 Last month
-
Rankings:
- Stargazers count: 0.343%
- Forks count: 0.4%
- Dependent packages count: 8.803%
- Average: 14.786%
- Dependent repos count: 49.6%
- Maintainers (1)
pypi.org: litellm-dev
Library to easily interface with LLM API providers
- Homepage: https://litellm.ai
- Documentation: https://docs.litellm.ai
- Licenses: MIT
- Latest release: 1.100.0.dev1 (published about 1 month ago)
- Last Synced: 2026-10-11T23:37:36.110Z (1 day ago)
- Versions: 32
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 1,295 Last month
-
Rankings:
- Dependent packages count: 7.321%
- Average: 26.858%
- Downloads: 31.841%
- Dependent repos count: 41.411%
pypi.org: litellm-enterprise
Package for LiteLLM Enterprise features
- Homepage: https://litellm.ai
- Documentation: https://docs.litellm.ai
- Licenses: LicenseRef-Proprietary
- Latest release: 0.1.76 (published 4 days ago)
- Last Synced: 2026-10-11T23:37:50.812Z (1 day ago)
- Versions: 86
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 4,670,402 Last month
-
Rankings:
- Dependent packages count: 9.17%
- Average: 30.413%
- Dependent repos count: 51.657%
- Maintainers (1)
pypi.org: litellm-plus
Library to easily interface with LLM API providers
- Homepage: https://litellm.ai
- Documentation: https://docs.litellm.ai
- Licenses: MIT
- Latest release: 1.65.1b1 (published over 1 year ago)
- Last Synced: 2026-10-11T23:37:38.753Z (1 day ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 14 Last month
-
Rankings:
- Dependent packages count: 9.384%
- Average: 31.119%
- Dependent repos count: 52.855%
- Maintainers (1)
pypi.org: litellm-proxy-extras
Additional files for the LiteLLM Proxy. Reduces the size of the main litellm package.
- Homepage: https://litellm.ai
- Documentation: https://docs.litellm.ai
- Licenses: MIT
- Latest release: 0.4.108 (published 4 days ago)
- Last Synced: 2026-10-11T23:37:38.974Z (1 day ago)
- Versions: 169
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 4,725,767 Last month
-
Rankings:
- Dependent packages count: 9.388%
- Average: 31.133%
- Dependent repos count: 52.878%
- Maintainers (1)
pypi.org: gspringer-litellm
Library to easily interface with LLM API providers
- Homepage:
- Documentation: https://gspringer-litellm.readthedocs.io/
- Licenses: MIT
- Latest release: 0.0.1 (published about 2 years ago)
- Last Synced: 2026-10-11T23:37:33.468Z (1 day ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 18 Last month
-
Rankings:
- Dependent packages count: 10.219%
- Average: 33.866%
- Dependent repos count: 57.513%
- Maintainers (1)
crates.io: litellm
Placeholder for the LiteLLM Rust SDK, currently under development
- Homepage: https://litellm.ai
- Documentation: https://docs.rs/litellm/
- Licenses: MIT
- Latest release: 0.0.1 (published about 1 month ago)
- Last Synced: 2026-10-11T23:37:39.010Z (1 day ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 17 Total
-
Rankings:
- Dependent repos count: 12.264%
- Dependent packages count: 16.198%
- Average: 39.302%
- Downloads: 89.443%
- Maintainers (1)
anaconda.org: litellm
Translate inputs to provider's completion, embedding, and image_generation endpoints Consistent output, text responses will always be available at ['choices'][0] Retry/fallback logic across multiple deployments (e.g. Azure/OpenAI) - Router Track spend & set budgets per project LiteLLM Proxy Server
- Homepage: https://github.com/BerriAI/litellm
- Licenses: MIT
- Latest release: 1.89.3 (published 4 months ago)
- Last Synced: 2026-06-26T09:04:06.810Z (4 months ago)
- Versions: 5
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 827 Total
-
Rankings:
- Dependent packages count: 40.988%
- Average: 42.84%
- Dependent repos count: 44.691%
nixpkgs-unstable: litellm
Use any LLM as a drop in replacement for gpt-3.5-turbo. Use Azure, OpenAI, Cohere, Anthropic, Ollama, VLLM, Sagemaker, HuggingFace, Replicate (100+ LLMs)
- Homepage: https://github.com/BerriAI/litellm
- Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-unstable/pkgs/development/python-modules/litellm/default.nix#L149
- Licenses: MIT
- Latest release: 1.80.0 (published 9 months ago)
- Last Synced: 2026-04-09T13:02:06.461Z (6 months ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%
- Maintainers (1)
nixpkgs-24.11: python311Packages.litellm
Use any LLM as a drop in replacement for gpt-3.5-turbo. Use Azure, OpenAI, Cohere, Anthropic, Ollama, VLLM, Sagemaker, HuggingFace, Replicate (100+ LLMs)
- Homepage: https://github.com/BerriAI/litellm
- Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-24.11/pkgs/development/python-modules/litellm/default.nix#L99
- Licenses: MIT
- Latest release: 1.51.2 (published 8 months ago)
- Last Synced: 2026-03-08T04:29:39.861Z (7 months ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%
- Maintainers (1)
nixpkgs-24.11: python312Packages.litellm
Use any LLM as a drop in replacement for gpt-3.5-turbo. Use Azure, OpenAI, Cohere, Anthropic, Ollama, VLLM, Sagemaker, HuggingFace, Replicate (100+ LLMs)
- Homepage: https://github.com/BerriAI/litellm
- Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-24.11/pkgs/development/python-modules/litellm/default.nix#L99
- Licenses: MIT
- Latest release: 1.51.2 (published 8 months ago)
- Last Synced: 2026-03-07T16:09:27.005Z (7 months ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%
- Maintainers (1)
nixpkgs-24.05: python311Packages.litellm
Use any LLM as a drop in replacement for gpt-3.5-turbo. Use Azure, OpenAI, Cohere, Anthropic, Ollama, VLLM, Sagemaker, HuggingFace, Replicate (100+ LLMs)
- Homepage: https://github.com/BerriAI/litellm
- Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-24.05/pkgs/development/python-modules/litellm/default.nix#L98
- Licenses: MIT
- Latest release: 1.37.16 (published 8 months ago)
- Last Synced: 2026-07-24T21:16:58.588Z (3 months ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%
- Maintainers (1)
nixpkgs-23.11: python311Packages.litellm
Use any LLM as a drop in replacement for gpt-3.5-turbo. Use Azure, OpenAI, Cohere, Anthropic, Ollama, VLLM, Sagemaker, HuggingFace, Replicate (100+ LLMs)
- Homepage: https://github.com/BerriAI/litellm
- Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-23.11/pkgs/development/python-modules/litellm/default.nix#L47
- Licenses: MIT
- Latest release: 0.11.1 (published 8 months ago)
- Last Synced: 2026-03-08T10:35:29.923Z (7 months ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%
- Maintainers (1)
nixpkgs-23.11: python310Packages.litellm
Use any LLM as a drop in replacement for gpt-3.5-turbo. Use Azure, OpenAI, Cohere, Anthropic, Ollama, VLLM, Sagemaker, HuggingFace, Replicate (100+ LLMs)
- Homepage: https://github.com/BerriAI/litellm
- Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-23.11/pkgs/development/python-modules/litellm/default.nix#L47
- Licenses: MIT
- Latest release: 0.11.1 (published 8 months ago)
- Last Synced: 2026-04-10T22:02:46.615Z (6 months ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%
- Maintainers (1)
nixpkgs-unstable: python313Packages.litellm
Use any LLM as a drop in replacement for gpt-3.5-turbo. Use Azure, OpenAI, Cohere, Anthropic, Ollama, VLLM, Sagemaker, HuggingFace, Replicate (100+ LLMs)
- Homepage: https://github.com/BerriAI/litellm
- Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-unstable/pkgs/development/python-modules/litellm/default.nix#L149
- Licenses: MIT
- Latest release: 1.80.0 (published 9 months ago)
- Last Synced: 2026-05-14T01:00:19.162Z (5 months ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%
- Maintainers (1)
nixpkgs-24.05: python312Packages.litellm
Use any LLM as a drop in replacement for gpt-3.5-turbo. Use Azure, OpenAI, Cohere, Anthropic, Ollama, VLLM, Sagemaker, HuggingFace, Replicate (100+ LLMs)
- Homepage: https://github.com/BerriAI/litellm
- Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-24.05/pkgs/development/python-modules/litellm/default.nix#L98
- Licenses: MIT
- Latest release: 1.37.16 (published 8 months ago)
- Last Synced: 2026-03-07T12:04:13.939Z (7 months ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%
- Maintainers (1)
nixpkgs-unstable: python314Packages.litellm
Use any LLM as a drop in replacement for gpt-3.5-turbo. Use Azure, OpenAI, Cohere, Anthropic, Ollama, VLLM, Sagemaker, HuggingFace, Replicate (100+ LLMs)
- Homepage: https://github.com/BerriAI/litellm
- Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-unstable/pkgs/development/python-modules/litellm/default.nix#L149
- Licenses: MIT
- Latest release: 1.80.0 (published 9 months ago)
- Last Synced: 2026-09-24T19:26:45.578Z (19 days ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%
- Maintainers (1)
Dependencies
.github/workflows/codspeed.yml
actions
- ./.github/actions/setup-uv-with-retries * composite
- CodSpeedHQ/action 1c8ae4843586d3ba879736b7f6b7b0c990757fab composite
- actions/checkout 08eba0b27e820071cde6df949e0beb9ba4906955 composite
- actions/setup-python a26af69be951a213d495a4c3e4e4022e16d87065 composite
.github/workflows/conventional-commits.yml
actions
- amannn/action-semantic-pull-request 48f256284bd46cdaab1048c3721360e808335d50 composite
.github/workflows/test-rust.yml
actions
- actions/cache 0057852bfaa89a56745cba8c7296529d2fc39830 composite
- actions/checkout 08eba0b27e820071cde6df949e0beb9ba4906955 composite
litellm-rust/Cargo.lock
cargo
- 255 dependencies
cookbook/gollem_go_agent_framework/go.sum
go
- github.com/fugue-labs/gollem v0.1.0
.github/actions/setup-uv-with-retries/action.yml
actions
- astral-sh/setup-uv 37802adc94f370d6bfd71619e3f0bf239e1f3b78 composite
.github/workflows/check-schema-sync.yml
actions
- actions/checkout 08eba0b27e820071cde6df949e0beb9ba4906955 composite
.github/workflows/create-release-branch.yml
actions
- actions/github-script 60a0d83039c74a4aee543508d2ffcb1c3799cdea composite
.github/workflows/image-scan.yml
actions
- actions/checkout 08eba0b27e820071cde6df949e0beb9ba4906955 composite
- actions/setup-python a26af69be951a213d495a4c3e4e4022e16d87065 composite
.github/workflows/mutation-test.yml
actions
- ./.github/actions/setup-uv-with-retries * composite
- actions/cache 0057852bfaa89a56745cba8c7296529d2fc39830 composite
- actions/checkout 08eba0b27e820071cde6df949e0beb9ba4906955 composite
- actions/setup-python a26af69be951a213d495a4c3e4e4022e16d87065 composite
- actions/upload-artifact 4cec3d8aa04e39d1a68397de0c4cd6fb9dce8ec1 composite
.github/workflows/osv-scan.yml
actions
- actions/checkout 08eba0b27e820071cde6df949e0beb9ba4906955 composite
.github/workflows/scorecard.yml
actions
- actions/checkout 11bd71901bbe5b1630ceea73d27597364c9af683 composite
- actions/upload-artifact 4cec3d8aa04e39d1a68397de0c4cd6fb9dce8ec1 composite
- github/codeql-action/upload-sarif c10b8064de6f491fea524254123dbe5e09572f13 composite
- ossf/scorecard-action f49aabe0b5af0936a0987cfb85d86b75731b0186 composite
.github/workflows/test-linting.yml
actions
- ./.github/actions/setup-uv-with-retries * composite
- actions/checkout 08eba0b27e820071cde6df949e0beb9ba4906955 composite
- actions/setup-python a26af69be951a213d495a4c3e4e4022e16d87065 composite
.github/workflows/weekly_load_anomaly.yml
actions
- ./.github/actions/setup-uv-with-retries * composite
- actions/checkout 08eba0b27e820071cde6df949e0beb9ba4906955 composite
- actions/setup-python a26af69be951a213d495a4c3e4e4022e16d87065 composite
- postgres 16.6 docker
docker-compose.hardened.yml
docker
- sameersbn/squid 3.5.27-2
cookbook/litellm-ollama-docker-image/requirements.txt
pypi
- litellm ==1.83.14
.github/workflows/auto_update_price_and_context_window.yml
actions
- ./.github/actions/setup-uv-with-retries * composite
- actions/checkout 08eba0b27e820071cde6df949e0beb9ba4906955 composite
.github/workflows/guard-fork-dependencies.yml
actions
- actions/checkout 08eba0b27e820071cde6df949e0beb9ba4906955 composite
.github/workflows/issue-keyword-labeler.yml
actions
- actions/checkout 08eba0b27e820071cde6df949e0beb9ba4906955 composite
- actions/github-script f28e40c7f34bde8b3046d885e986cb6290c5673b composite
docker-compose.yml
docker
- docker.litellm.ai/berriai/litellm main-stable
- postgres 16
- prom/prometheus latest
cookbook/gollem_go_agent_framework/go.mod
go
- github.com/fugue-labs/gollem v0.1.0
litellm-rust/crates/python-bridge/Cargo.toml
cargo
backend/Dockerfile
docker
- $LITELLM_BUILD_IMAGE latest build
- $LITELLM_RUNTIME_IMAGE latest build
- $UV_IMAGE latest build
gateway/Dockerfile
docker
- $LITELLM_BUILD_IMAGE latest build
- $LITELLM_RUNTIME_IMAGE latest build
- $UV_IMAGE latest build
litellm-proxy-extras/pyproject.toml
pypi
.github/workflows/test-terraform-provider.yml
actions
- ./.github/actions/setup-uv-with-retries * composite
- actions/cache 0057852bfaa89a56745cba8c7296529d2fc39830 composite
- actions/checkout 08eba0b27e820071cde6df949e0beb9ba4906955 composite
- actions/setup-go 7a3fe6cf4cb3a834922a1244abfce67bcef6a0c5 composite
- actions/setup-python a26af69be951a213d495a4c3e4e4022e16d87065 composite
litellm-rust/Cargo.toml
cargo
cookbook/anthropic_agent_sdk/requirements.txt
pypi
- claude-agent-sdk *
- httpx >=0.27.0
enterprise/pyproject.toml
pypi
Dockerfile
docker
- $LITELLM_BUILD_IMAGE latest build
- $LITELLM_RUNTIME_IMAGE latest build
- $UI_BUILD_IMAGE latest build
- $UV_IMAGE latest build
cookbook/litellm-ollama-docker-image/Dockerfile
docker
- ollama/ollama latest build
cookbook/livekit_agent_sdk/requirements.txt
pypi
- livekit-agents >=1.3.12
- websockets >=15.0.1
.github/workflows/sync-schema.yml
actions
- actions/checkout 08eba0b27e820071cde6df949e0beb9ba4906955 composite
.github/workflows/zizmor.yml
actions
- actions/checkout 08eba0b27e820071cde6df949e0beb9ba4906955 composite
- zizmorcore/zizmor-action 5f14fd08f7cf1cb1609c1e344975f152c7ee938d composite
.github/workflows/codeql.yml
actions
- actions/checkout 08eba0b27e820071cde6df949e0beb9ba4906955 composite
- advanced-security/filter-sarif 2da736ff05ef065cb2894ac6892e47b5eac2c3c0 composite
- github/codeql-action/analyze ebcb5b36ded6beda4ceefea6a8bc4cc885255bb3 composite
- github/codeql-action/init ebcb5b36ded6beda4ceefea6a8bc4cc885255bb3 composite
- github/codeql-action/upload-sarif ebcb5b36ded6beda4ceefea6a8bc4cc885255bb3 composite
.github/workflows/stale.yml
actions
- actions/stale 1160a2240286f5da8ec72b1c0816ce2481aabf84 composite
.github/actions/cache-cargo-build/action.yml
actions
- actions/cache 0057852bfaa89a56745cba8c7296529d2fc39830 composite
.github/workflows/test-unit.yml
actions
.github/workflows/test-terraform-modules.yml
actions
- actions/checkout 08eba0b27e820071cde6df949e0beb9ba4906955 composite
- hashicorp/setup-terraform b9cd54a3c349d3f38e8881555d616ced269862dd composite
.github/actions/detect-changes/action.yml
actions
.github/actions/cache-prisma-binaries/action.yml
actions
- actions/cache 0057852bfaa89a56745cba8c7296529d2fc39830 composite
.github/workflows/e2e_record_replay.yml
actions
- ./.github/actions/cache-cargo-build * composite
- ./.github/actions/cache-prisma-binaries * composite
- ./.github/actions/setup-uv-with-retries * composite
- actions/checkout 08eba0b27e820071cde6df949e0beb9ba4906955 composite
- actions/setup-python a26af69be951a213d495a4c3e4e4022e16d87065 composite
- actions/upload-artifact 4cec3d8aa04e39d1a68397de0c4cd6fb9dce8ec1 composite
- postgres 16.6 docker
.github/workflows/sync-together-ai-models.yml
actions
- ./.github/actions/setup-uv-with-retries * composite
- actions/checkout 08eba0b27e820071cde6df949e0beb9ba4906955 composite
.github/workflows/auto-close-duplicates.yml
actions
- actions/checkout 08eba0b27e820071cde6df949e0beb9ba4906955 composite
- oven-sh/setup-bun 0c5077e51419868618aeaa5fe8019c62421857d6 composite
.github/workflows/test-mcp-dependency-resolution.yml
actions
- ./.github/actions/cache-cargo-build * composite
- ./.github/actions/detect-changes * composite
- ./.github/actions/setup-uv-with-retries * composite
- actions/checkout 08eba0b27e820071cde6df949e0beb9ba4906955 composite
- actions/setup-python a26af69be951a213d495a4c3e4e4022e16d87065 composite
.github/workflows/test-mcp-oauth-e2e.yml
actions
- ./.github/actions/cache-cargo-build * composite
- ./.github/actions/setup-uv-with-retries * composite
- actions/checkout 08eba0b27e820071cde6df949e0beb9ba4906955 composite
- actions/setup-node 49933ea5288caeca8642d1e84afbd3f7d6820020 composite
- actions/setup-python a26af69be951a213d495a4c3e4e4022e16d87065 composite
- aws-actions/configure-aws-credentials e7f100cf4c008499ea8adda475de1042d6975c7b composite
- postgres 16.6 docker
litellm-rust/crates/cache/Cargo.toml
cargo
litellm-rust/crates/secrets/Cargo.toml
cargo
- aws-sdk-kms 1.120.0 development
- google-cloud-kms-v1 1.14.0 development
- tempfile 3 development
- wiremock 0.6.5 development
litellm-rust/crates/cache-memory/Cargo.toml
cargo
litellm-rust/crates/http/Cargo.toml
cargo
.github/workflows/issue_fixed_comment.yml
actions
- actions/checkout 08eba0b27e820071cde6df949e0beb9ba4906955 composite
- oven-sh/setup-bun 0c5077e51419868618aeaa5fe8019c62421857d6 composite
litellm-rust/crates/auth-azure/Cargo.toml
cargo
- azure_core 1.0.0
- azure_identity 1.0.0
litellm-rust/crates/auth/Cargo.toml
cargo
litellm-rust/crates/core-utils/Cargo.toml
cargo
- serde_path_to_error 0.1
litellm-rust/crates/llms/Cargo.toml
cargo
- aws-smithy-eventstream =0.61.1 development
- aws-smithy-types 1.6.1 development
- data-url 0.3.2
- serde_path_to_error 0.1
litellm-rust/crates/token-counter/Cargo.toml
cargo
- indexmap 2.14.0
- itoa 1.0
.github/workflows/issue_label_sync.yml
actions
- actions/checkout 08eba0b27e820071cde6df949e0beb9ba4906955 composite
- oven-sh/setup-bun 0c5077e51419868618aeaa5fe8019c62421857d6 composite
litellm-rust/crates/host/Cargo.toml
cargo
litellm-rust/crates/secrets-google/Cargo.toml
cargo
- wiremock 0.6.5 development
- google-cloud-gax 1.14.0
- google-cloud-kms-v1 1.14.0
- percent-encoding 2.3
.github/workflows/issue_classifier.yml
actions
- actions/checkout 08eba0b27e820071cde6df949e0beb9ba4906955 composite
- actions/upload-artifact 4cec3d8aa04e39d1a68397de0c4cd6fb9dce8ec1 composite
- oven-sh/setup-bun 0c5077e51419868618aeaa5fe8019c62421857d6 composite
litellm-rust/crates/auth-aws/Cargo.toml
cargo
- aws-config 1.9.0
- aws-credential-types 1.3.0
- aws-sdk-sts 1.108.0
- aws-sigv4 1.5.1
- aws-smithy-runtime-api 1.13.0
- aws-types 1.4.0
litellm-rust/crates/secrets-aws/Cargo.toml
cargo
- wiremock 0.6.5 development
- aws-credential-types 1.3.0
- aws-sdk-kms 1.120.0
- aws-sdk-secretsmanager 1.117.0
- tracing 0.1
litellm-rust/crates/token-counter-tiktoken/Cargo.toml
cargo
.github/workflows/test-vscode-extension.yml
actions
- actions/checkout 08eba0b27e820071cde6df949e0beb9ba4906955 composite
- actions/setup-node a0853c24544627f65ddf259abe73b1d18a591444 composite
- actions/upload-artifact 4cec3d8aa04e39d1a68397de0c4cd6fb9dce8ec1 composite
litellm-rust/crates/auth-types/Cargo.toml
cargo
litellm-rust/crates/cache-redis/Cargo.toml
cargo
- redis-test 1.0.4 development
- redis 1.7.0
.github/workflows/cost-map-guard.yml
actions
- ./.github/actions/setup-uv-with-retries * composite
- actions/checkout 08eba0b27e820071cde6df949e0beb9ba4906955 composite
.github/workflows/duplicate_issue_check.yml
actions
- actions/checkout 08eba0b27e820071cde6df949e0beb9ba4906955 composite
- openai/codex-action 10cb888d2ed3b99867f7e7ccff174a861a75aeb6 composite
- oven-sh/setup-bun 0c5077e51419868618aeaa5fe8019c62421857d6 composite
litellm-rust/crates/auth-gcp/Cargo.toml
cargo
litellm-rust/crates/token-counter-huggingface/Cargo.toml
cargo
.github/workflows/issue_label_claude_code.yml
actions
.github/workflows/test-e2e-redis-chaos.yml
actions
- ./.github/actions/cache-cargo-build * composite
- ./.github/actions/cache-prisma-binaries * composite
- ./.github/actions/setup-uv-with-retries * composite
- actions/checkout 08eba0b27e820071cde6df949e0beb9ba4906955 composite
- actions/setup-python a26af69be951a213d495a4c3e4e4022e16d87065 composite
- postgres 16.6@sha256 docker
- valkey/valkey 8.1.4@sha256 docker
litellm-rust/crates/secrets-types/Cargo.toml
cargo
litellm-rust/crates/callbacks-legacy-python/Cargo.toml
cargo
litellm-rust/crates/framer/Cargo.toml
cargo
- aws-smithy-eventstream =0.61.1
- aws-smithy-types 1.6.1
- bytes 1
- sse-stream =0.2.6
litellm-rust/crates/host-python/Cargo.toml
cargo
litellm-rust/crates/token-counter-fast/Cargo.toml
cargo
- rustc-hash 2.1.3
- unicode-normalization-alignments 0.1.12
.github/actions/rust-bridge/action.yml
actions
- ./.github/actions/cache-cargo-build * composite
- actions/download-artifact 95815c38cf2ff2164869cbab79da8d1f422bc89e composite
litellm-rust/crates/cache-redis-semantic/Cargo.toml
cargo
- redis-test 1.0.4 development
- redis 1.7.0
litellm-rust/crates/config/Cargo.toml
cargo
- serde_yaml_ng 0.10.0
litellm-rust/crates/gateway-ui/Cargo.toml
cargo
- tower 0.5 development
- governor 0.10.4
- tower 0.5
- tower-cookies 0.11.0
- tower-http 0.6.11
litellm-rust/crates/host-http/Cargo.toml
cargo
.github/workflows/test-merge-smoke.yml
actions
- ./.github/actions/setup-uv-with-retries * composite
- actions/checkout 08eba0b27e820071cde6df949e0beb9ba4906955 composite
- actions/setup-python a26af69be951a213d495a4c3e4e4022e16d87065 composite
- actions/upload-artifact 4cec3d8aa04e39d1a68397de0c4cd6fb9dce8ec1 composite
- postgres 14@sha256 docker
litellm-rust/crates/cache-azure-blob/Cargo.toml
cargo
- async-trait 0.1
- azure_core 1.1.0
- azure_storage_blob 1.1.0
litellm-rust/crates/router/Cargo.toml
cargo
docker/docker-compose.tracing.yml
docker
- postgres 16
terraform/provider/go.mod
go
- github.com/ProtonMail/go-crypto v1.3.0
- github.com/agext/levenshtein v1.2.2
- github.com/apparentlymart/go-textseg/v15 v15.0.0
- github.com/cloudflare/circl v1.6.1
- github.com/fatih/color v1.16.0
- github.com/golang/protobuf v1.5.4
- github.com/google/go-cmp v0.7.0
- github.com/google/uuid v1.6.0
- github.com/hashicorp/errwrap v1.0.0
- github.com/hashicorp/go-checkpoint v0.5.0
- github.com/hashicorp/go-cleanhttp v0.5.2
- github.com/hashicorp/go-cty v1.5.0
- github.com/hashicorp/go-hclog v1.6.3
- github.com/hashicorp/go-multierror v1.1.1
- github.com/hashicorp/go-plugin v1.7.0
- github.com/hashicorp/go-retryablehttp v0.7.8
- github.com/hashicorp/go-uuid v1.0.3
- github.com/hashicorp/go-version v1.8.0
- github.com/hashicorp/hc-install v0.9.3
- github.com/hashicorp/hcl/v2 v2.24.0
- github.com/hashicorp/logutils v1.0.0
- github.com/hashicorp/terraform-exec v0.25.0
- github.com/hashicorp/terraform-json v0.27.2
- github.com/hashicorp/terraform-plugin-go v0.31.0
- github.com/hashicorp/terraform-plugin-log v0.10.0
- github.com/hashicorp/terraform-plugin-sdk/v2 v2.40.0
- github.com/hashicorp/terraform-registry-address v0.4.0
- github.com/hashicorp/terraform-svchost v0.1.1
- github.com/hashicorp/yamux v0.1.2
- github.com/mattn/go-colorable v0.1.13
- github.com/mattn/go-isatty v0.0.20
- github.com/mitchellh/copystructure v1.2.0
- github.com/mitchellh/go-testing-interface v1.14.1
- github.com/mitchellh/go-wordwrap v1.0.1
- github.com/mitchellh/mapstructure v1.5.0
- github.com/mitchellh/reflectwalk v1.0.2
- github.com/oklog/run v1.1.0
- github.com/vmihailenco/msgpack v4.0.4+incompatible
- github.com/vmihailenco/msgpack/v5 v5.4.1
- github.com/vmihailenco/tagparser/v2 v2.0.0
- github.com/zclconf/go-cty v1.17.0
- golang.org/x/crypto v0.53.0
- golang.org/x/mod v0.37.0
- golang.org/x/net v0.56.0
- golang.org/x/sync v0.21.0
- golang.org/x/sys v0.46.0
- golang.org/x/text v0.39.0
- golang.org/x/tools v0.47.0
- google.golang.org/appengine v1.6.8
- google.golang.org/genproto/googleapis/rpc v0.0.0-20260414002931-afd174a4e478
- google.golang.org/grpc v1.82.1
- google.golang.org/protobuf v1.36.11
litellm-rust/crates/cache-qdrant-semantic/Cargo.toml
cargo
- futures-executor 0.3 development
- tokio-stream 0.1 development
- tonic 0.14 development
- tonic-prost 0.14 development
litellm-rust/crates/tracing/Cargo.toml
cargo
- tracing-subscriber 0.3
scripts/health_check/health_check_requirements.txt
pypi
- httpx ==0.28.1
- pyyaml ==6.0.2
.github/workflows/compat-matrix-image.yml
actions
- actions/checkout 08eba0b27e820071cde6df949e0beb9ba4906955 composite
litellm-rust/crates/cache-response/Cargo.toml
cargo
- redis 1.7.0 development
- redis-test 1.0.4 development
- py_literal 0.4.0
litellm-rust/crates/inference-testing/Cargo.toml
cargo
litellm-rust/crates/secrets-hashicorp/Cargo.toml
cargo
- tempfile 3 development
.github/workflows/create-rc-branch.yml
actions
- actions/checkout 08eba0b27e820071cde6df949e0beb9ba4906955 composite
- actions/github-script 60a0d83039c74a4aee543508d2ffcb1c3799cdea composite
litellm-rust/crates/cost/Cargo.toml
cargo
litellm-rust/crates/gateway-inference/Cargo.toml
cargo
- tower 0.5.3 development
litellm-rust/crates/gateway-management/Cargo.toml
cargo
litellm-rust/crates/gateway-mcp/Cargo.toml
cargo
- rmcp =3.4.1 development
- sse-stream 0.2.6 development
- rmcp =3.4.1
- tokio-util 0.7
- tower 0.5
litellm-rust/crates/inference/Cargo.toml
cargo
- tokio-util 0.7