https://github.com/intentee/paddler
ai llamacpp llm llmops load-balancer
Score: 17.537415129797832
Last synced: about 4 hours ago
JSON representation
Repository metadata:
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
- Host: GitHub
- URL: https://github.com/intentee/paddler
- Owner: intentee
- License: apache-2.0
- Created: 2024-04-27T18:07:47.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2026-07-19T19:36:21.000Z (about 1 month ago)
- Last Synced: 2026-08-26T14:36:20.110Z (2 days ago)
- Topics: ai, llamacpp, llm, llmops, load-balancer
- Language: Rust
- Homepage: https://paddler.intentee.com
- Size: 9.25 MB
- Stars: 1,664
- Watchers: 13
- Forks: 97
- Open Issues: 29
-
Metadata Files:
- Readme: README.md
- License: LICENSE
- Codeowners: CODEOWNERS
- Security: SECURITY.md
- Claude: CLAUDE.md
Owner metadata:
- Name: intentee
- Login: intentee
- Email:
- Kind: organization
- Description:
- Website:
- Location:
- Twitter:
- Company:
- Icon url: https://avatars.githubusercontent.com/u/215040511?v=4
- Repositories: 1
- Last Synced at: 2025-06-19T18:04:09.819Z
- Profile URL: https://github.com/intentee
GitHub Events
Total
- Create event: 50
- Delete event: 35
- Fork event: 12
- Issue comment event: 20
- Issues event: 17
- Pull request event: 38
- Pull request review comment event: 63
- Pull request review event: 56
- Push event: 251
- Release event: 6
- Watch event: 387
- Total: 935
Last Year
- Create event: 37
- Delete event: 23
- Fork event: 6
- Issue comment event: 14
- Issues event: 9
- Pull request event: 16
- Pull request review comment event: 40
- Pull request review event: 25
- Push event: 181
- Release event: 5
- Watch event: 107
- Total: 463
Committers metadata
Last synced: 2 days ago
Total Commits: 1,070
Total Committers: 12
Avg Commits per committer: 89.167
Development Distribution Score (DDS): 0.243
Commits in past year: 488
Committers in past year: 6
Avg Commits per committer in past year: 81.333
Development Distribution Score (DDS) in past year: 0.289
| Name | Commits | |
|---|---|---|
| Mateusz Charytoniuk | m****k@p****m | 810 |
| Propfend | m****0@g****m | 141 |
| Małgorzata Zagajewska | m****a@g****m | 105 |
| dependabot[bot] | 4****] | 5 |
| dgbrnd | m****2@d****m | 2 |
| Ramsyana | k****k@r****m | 1 |
| Phate | p****4@g****m | 1 |
| Luke Belbina | k****a@g****m | 1 |
| Jason Ni | j****y@g****m | 1 |
| Hadi Cherkaoui | g****b@h****h | 1 |
| Fluid | f****s@p****e | 1 |
| Andrew DalPino | a****o | 1 |
Issue and Pull Request metadata
Last synced: 1 day ago
Total issues: 23
Total pull requests: 99
Average time to close issues: 3 months
Average time to close pull requests: about 17 hours
Total issue authors: 8
Total pull request authors: 5
Average comments per issue: 2.43
Average comments per pull request: 0.14
Merged pull request: 80
Bot issues: 0
Bot pull requests: 0
Past year issues: 13
Past year pull requests: 50
Past year average time to close issues: 3 months
Past year average time to close pull requests: about 21 hours
Past year issue authors: 7
Past year pull request authors: 5
Past year average comments per issue: 3.92
Past year average comments per pull request: 0.22
Past year merged pull request: 39
Past year bot issues: 0
Past year bot pull requests: 0
Top Issue Authors
- Propfend (8)
- malzag (5)
- mcharytoniuk (3)
- marcjwojtowicz (3)
- LeXaMeN (1)
- rzerres (1)
- matteogrechi (1)
- chrislawso (1)
Top Pull Request Authors
- mcharytoniuk (58)
- malzag (24)
- Propfend (13)
- ndragon798 (3)
- matteogrechi (1)
Top Issue Labels
- help wanted (2)
- good first issue (2)
- compatibility (2)
- openai (2)
- idea (2)
- question (1)
Top Pull Request Labels
Package metadata
- Total packages: 8
-
Total downloads:
- pypi: 23 last-month
- cargo: 2,010 total
- Total dependent packages: 0 (may contain duplicates)
- Total dependent repositories: 0 (may contain duplicates)
- Total versions: 18
- Total maintainers: 2
pypi.org: paddler-client
Python client for Paddler LLM load balancer
- Homepage: https://github.com/intentee/paddler
- Documentation: https://paddler-client.readthedocs.io/
- Licenses: Apache-2.0
- Latest release: 4.0.0 (published 3 months ago)
- Last Synced: 2026-08-27T18:07:24.470Z (1 day ago)
- Versions: 6
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 23 Last month
-
Rankings:
- Dependent packages count: 7.609%
- Average: 26.396%
- Downloads: 28.553%
- Dependent repos count: 43.027%
- Maintainers (1)
crates.io: paddler_download_manager
Open-source LLMOps platform for hosting and scaling AI in your own infrastructure
- Homepage: https://paddler.intentee.com/
- Documentation: https://docs.rs/paddler_download_manager/
- Licenses: Apache-2.0
- Latest release: 4.0.0 (published 3 months ago)
- Last Synced: 2026-08-27T18:08:31.991Z (1 day ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 52 Total
-
Rankings:
- Dependent repos count: 14.115%
- Dependent packages count: 18.644%
- Average: 40.676%
- Downloads: 89.27%
- Maintainers (1)
crates.io: paddler_state_conversion
Open-source LLMOps platform for hosting and scaling AI in your own infrastructure
- Homepage: https://paddler.intentee.com/
- Documentation: https://docs.rs/paddler_state_conversion/
- Licenses: Apache-2.0
- Latest release: 4.0.0 (published 3 months ago)
- Last Synced: 2026-08-27T18:09:38.053Z (1 day ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 80 Total
-
Rankings:
- Dependent repos count: 14.115%
- Dependent packages count: 18.644%
- Average: 40.676%
- Downloads: 89.27%
- Maintainers (1)
crates.io: paddler_messaging
Open-source LLMOps platform for hosting and scaling AI in your own infrastructure
- Homepage: https://paddler.intentee.com/
- Documentation: https://docs.rs/paddler_messaging/
- Licenses: Apache-2.0
- Latest release: 4.1.0 (published about 1 month ago)
- Last Synced: 2026-08-27T18:07:22.205Z (1 day ago)
- Versions: 2
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 131 Total
-
Rankings:
- Dependent repos count: 14.115%
- Dependent packages count: 18.644%
- Average: 40.676%
- Downloads: 89.27%
- Maintainers (1)
crates.io: paddler_cache_dir
Open-source LLMOps platform for hosting and scaling AI in your own infrastructure
- Homepage: https://paddler.intentee.com/
- Documentation: https://docs.rs/paddler_cache_dir/
- Licenses: Apache-2.0
- Latest release: 4.0.0 (published 3 months ago)
- Last Synced: 2026-08-27T18:08:32.247Z (1 day ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 51 Total
-
Rankings:
- Dependent repos count: 14.115%
- Dependent packages count: 18.644%
- Average: 40.676%
- Downloads: 89.27%
- Maintainers (1)
crates.io: paddler_agent
Open-source LLMOps platform for hosting and scaling AI in your own infrastructure
- Homepage: https://paddler.intentee.com/
- Documentation: https://docs.rs/paddler_agent/
- Licenses: Apache-2.0
- Latest release: 4.0.0 (published 3 months ago)
- Last Synced: 2026-08-27T18:07:24.442Z (1 day ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 20 Total
-
Rankings:
- Dependent repos count: 14.115%
- Dependent packages count: 18.644%
- Average: 40.676%
- Downloads: 89.27%
- Maintainers (1)
crates.io: paddler_balancer
Open-source LLMOps platform for hosting and scaling AI in your own infrastructure
- Homepage: https://paddler.intentee.com/
- Documentation: https://docs.rs/paddler_balancer/
- Licenses: Apache-2.0
- Latest release: 4.0.0 (published 3 months ago)
- Last Synced: 2026-08-27T18:09:37.996Z (1 day ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 20 Total
-
Rankings:
- Dependent repos count: 14.115%
- Dependent packages count: 18.644%
- Average: 40.676%
- Downloads: 89.27%
- Maintainers (1)
crates.io: paddler
Open-source LLMOps platform for hosting and scaling AI in your own infrastructure
- Homepage: https://paddler.intentee.com/
- Documentation: https://docs.rs/paddler/
- Licenses: Apache-2.0
- Latest release: 3.1.2 (published 4 months ago)
- Last Synced: 2026-08-27T18:07:24.262Z (1 day ago)
- Versions: 5
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 1,656 Total
-
Rankings:
- Dependent repos count: 24.425%
- Dependent packages count: 32.396%
- Average: 50.861%
- Downloads: 95.762%
- Maintainers (1)
Dependencies
- ubuntu 24.04 build
- actions/checkout v4 composite
- actions/setup-go v5 composite
- softprops/action-gh-release v2 composite
- Swatinem/rust-cache v2 composite
- actions/checkout v4 composite
- colorama 0.4.6 develop
- coverage 7.13.5 develop
- iniconfig 2.3.0 develop
- librt 0.8.1 develop
- mypy 1.19.1 develop
- mypy-extensions 1.1.0 develop
- nodeenv 1.10.0 develop
- packaging 26.0 develop
- pathspec 1.0.4 develop
- pluggy 1.6.0 develop
- pygments 2.20.0 develop
- pyright 1.1.408 develop
- pytest 9.0.3 develop
- pytest-asyncio 1.3.0 develop
- pytest-cov 7.1.0 develop
- ruff 0.15.12 develop
- typing-extensions 4.15.0 develop
- annotated-types 0.7.0
- anyio 4.12.1
- certifi 2026.2.25
- h11 0.16.0
- httpcore 1.0.9
- httpx 0.28.1
- idna 3.11
- pydantic 2.12.5
- pydantic-core 2.41.5
- typing-extensions 4.15.0
- typing-inspection 0.4.2
- websockets 15.0.1
- mypy ^1 develop
- pygments ^2.20 develop
- pyright ^1 develop
- pytest ^9 develop
- pytest-asyncio ^1.3 develop
- pytest-cov ^7 develop
- ruff 0.15.12 develop
- httpx ^0.28
- pydantic ^2
- python ^3.11
- websockets ^15
- crane 1316b7d
- flake-parts 17c9d6c
- nixpkgs 61b7c44
- rust-overlay afacd68
- crane *
- flake-parts *
- nixpkgs nixos-unstable
- rust-overlay *
- @types/node ^22 development
- tsx ^4.21.0 development
- typescript ^5.9.2 development
- nanoid ^5.1.11
- colorama 0.4.6 develop
- iniconfig 2.3.0 develop
- librt 0.11.0 develop
- mypy 1.20.2 develop
- mypy-extensions 1.1.0 develop
- nodeenv 1.10.0 develop
- packaging 26.2 develop
- pathspec 1.1.1 develop
- pluggy 1.6.0 develop
- pygments 2.20.0 develop
- pyright 1.1.410 develop
- pytest 9.0.3 develop
- ruff 0.15.12 develop
- typing-extensions 4.15.0 develop
- annotated-types 0.7.0
- anyio 4.13.0
- certifi 2026.5.20
- colorama 0.4.6
- distro 1.9.0
- h11 0.16.0
- httpcore 1.0.9
- httpx 0.28.1
- idna 3.18
- jiter 0.15.0
- openai 2.41.0
- pydantic 2.13.4
- pydantic-core 2.46.4
- sniffio 1.3.1
- tqdm 4.67.3
- typing-extensions 4.15.0
- typing-inspection 0.4.2
- mypy ^1 develop
- pyright ^1 develop
- pytest ^9 develop
- ruff 0.15.12 develop
- openai ==2.41.0
- python ^3.11
- actions/checkout v4 composite
- 400 dependencies
- 520 dependencies
- @types/hotwired__turbo ^8 development
- @types/react ^19.1.10 development
- @types/react-dom ^19.1.7 development
- ava ^6.4.1 development
- esbuild ^0.25.8 development
- eslint ^9.33.0 development
- eslint-plugin-react-hooks ^5.2.0 development
- fs-extra ^11.3.1 development
- glob ^11.1.0 development
- jarmuz ^0.4.0 development
- lodash ^4.17.21 development
- node-notifier ^10.0.1 development
- prettier ^3.6.2 development
- prettier-plugin-organize-imports ^4.2.0 development
- stylelint ^16.23.1 development
- stylelint-config-recommended ^17.0.0 development
- tempy ^3.1.0 development
- tsimp ^2.0.12 development
- tslib ^2.8.1 development
- typed-css-modules ^0.9.1 development
- typescript ^5.9.2 development
- typescript-eslint ^8.39.1 development
- @codemirror/lang-jinja ^6.0.0
- @uiw/react-codemirror ^4.24.2
- clsx ^2.1.1
- nanoid ^5.1.5
- path-to-regexp ^8.2.0
- react ^19.1.1
- react-dom ^19.1.1
- react-markdown ^10.1.0
- rxjs ^7.8.2
- wouter ^3.7.1
- zod ^4.0.17
- tempfile 3.20.0 development
- actix 0.13
- actix-cors 0.7
- actix-rt 2.11
- actix-web 4
- actix-web-lab 0.24
- actix-ws 0.3
- anyhow 1
- askama 0.14
- async-stream 0.3
- async-trait 0.1
- bytes 1.11
- cadence 1.6
- clap 4.5
- dashmap 6.1
- encoding_rs 0.8
- env_logger 0.11
- esbuild-metafile 0.5.2
- futures 0.3
- futures-util 0.3
- hf-hub 0.4
- indoc 2
- jsonschema 0.37
- llama-cpp-2 0.1.126
- log 0.4
- mime_guess 2
- minijinja 2.12
- minijinja-contrib 2.12
- nanoid 0.4
- nix 0.30
- rand 0.9
- reqwest 0.12
- rust-embed 8.9
- serde 1
- serde_json 1
- shellexpand 3
- tokio 1.48
- tokio-stream 0.1.17
- tokio-tungstenite 0.28
- url 2.5
- actions/checkout v4 composite
- docker/setup-buildx-action v3 composite