awesome-llama: https://github.com/xorbitsai/inference
artificial-intelligence chatglm deployment flan-t5 gemma ggml glm4 inference llama llama3 llamacpp llm machine-learning mistral openai-api pytorch qwen vllm whisper wizardlm
Score: 23.836729538469577
Last synced: about 10 hours ago
JSON representation
Repository metadata:
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
- Host: GitHub
- URL: https://github.com/xorbitsai/inference
- Owner: xorbitsai
- License: apache-2.0
- Created: 2023-06-14T07:05:04.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2026-01-26T09:39:00.000Z (9 days ago)
- Last Synced: 2026-01-26T12:43:46.137Z (9 days ago)
- Topics: artificial-intelligence, chatglm, deployment, flan-t5, gemma, ggml, glm4, inference, llama, llama3, llamacpp, llm, machine-learning, mistral, openai-api, pytorch, qwen, vllm, whisper, wizardlm
- Language: Python
- Homepage: https://inference.readthedocs.io
- Size: 68.6 MB
- Stars: 8,990
- Watchers: 59
- Forks: 789
- Open Issues: 171
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Owner metadata:
- Name: Xorbits
- Login: xorbitsai
- Email:
- Kind: organization
- Description: Xorbits makes it easy to scale ML and DS workloads, from data loading to preprocessing, tuning, training, and model serving.
- Website: xorbits.io
- Location:
- Twitter: Xorbitsio
- Company:
- Icon url: https://avatars.githubusercontent.com/u/109655068?v=4
- Repositories: 1
- Last Synced at: 2023-07-04T09:02:42.715Z
- Profile URL: https://github.com/xorbitsai
GitHub Events
Total
- Create event: 38
- Delete event: 12
- Fork event: 314
- Issue comment event: 4978
- Issues event: 1879
- Member event: 4
- Pull request event: 712
- Pull request review comment event: 178
- Pull request review event: 473
- Push event: 349
- Release event: 32
- Watch event: 3064
- Total: 12033
Last Year
- Create event: 38
- Delete event: 12
- Fork event: 314
- Issue comment event: 4978
- Issues event: 1879
- Member event: 4
- Pull request event: 712
- Pull request review comment event: 178
- Pull request review event: 473
- Push event: 349
- Release event: 32
- Watch event: 3064
- Total: 12033
Committers metadata
Last synced: 3 months ago
Total Commits: 1,473
Total Committers: 121
Avg Commits per committer: 12.174
Development Distribution Score (DDS): 0.835
Commits in past year: 500
Committers in past year: 60
Avg Commits per committer in past year: 8.333
Development Distribution Score (DDS) in past year: 0.732
| Name | Commits | |
|---|---|---|
| Xuye Qin | q****e@g****m | 243 |
| codingl2k1 | 1****1 | 169 |
| Chengjie Li | 1****8 | 167 |
| Uranus | 1****n | 136 |
| aresnow1 | 1****1 | 96 |
| amumu96 | 1****6 | 81 |
| xiaolei | 1****s | 74 |
| Jun-Howie | 6****e | 51 |
| Minamiyama | m****a@q****m | 51 |
| pangyoki | p****i@1****m | 29 |
| Bojun-Feng | 1****g | 29 |
| Dreamsome | o****k@g****m | 28 |
| jiayini1119 | 1****9 | 21 |
| Adam Ning | f****t@g****m | 20 |
| hainaweiben | 1****n | 19 |
| OliverBryant | 5****t | 18 |
| Rui Ji | r****i@u****u | 17 |
| zwt-1234 | 1****4 | 11 |
| 呆萌闷油瓶 | 2****2@q****m | 11 |
| llyycchhee | m****9@1****m | 10 |
| Mike Shi | s****i@h****m | 9 |
| XprobeBot | 1****t | 8 |
| bash000000 | m****3@o****m | 8 |
| wxiwnd | 4****d | 8 |
| Wang Xuejin | 9****7 | 6 |
| mujin2 | 1****2 | 6 |
| Gmgge | 4****e | 5 |
| aniya105 | 1****5 | 5 |
| zhuhao | 3****o | 5 |
| Hexiao Zhang | 7****2@q****m | 4 |
| and 91 more... | ||
Issue and Pull Request metadata
Last synced: 3 months ago
Total issues: 2,195
Total pull requests: 1,605
Average time to close issues: about 1 month
Average time to close pull requests: 6 days
Total issue authors: 1,128
Total pull request authors: 135
Average comments per issue: 3.14
Average comments per pull request: 0.54
Merged pull request: 1,253
Bot issues: 0
Bot pull requests: 0
Past year issues: 1,074
Past year pull requests: 794
Past year average time to close issues: 14 days
Past year average time to close pull requests: 3 days
Past year issue authors: 635
Past year pull request authors: 65
Past year average comments per issue: 3.51
Past year average comments per pull request: 0.55
Past year merged pull request: 609
Past year bot issues: 0
Past year bot pull requests: 0
Top Issue Authors
- UranusSeven (52)
- Minamiyama (28)
- qinxuye (23)
- leslie2046 (20)
- Songjiadong (19)
- lordk911 (18)
- aresnow1 (18)
- moshilangzi (16)
- xs818818 (14)
- yidasanqian (13)
- wangyongpenga (12)
- kelliaao (12)
- rexjm (12)
- frankSARU (11)
- ChengjieLi28 (11)
Top Pull Request Authors
- qinxuye (335)
- codingl2k1 (173)
- ChengjieLi28 (144)
- amumu96 (137)
- yiboyasss (114)
- Minamiyama (96)
- Jun-Howie (84)
- aresnow1 (40)
- frostyplanet (32)
- UranusSeven (28)
- hainaweiben (24)
- Bojun-Feng (17)
- llyycchhee (17)
- leslie2046 (16)
- OliverBryant (15)
Top Issue Labels
- stale (950)
- gpu (717)
- feature (323)
- question (173)
- bug (76)
- enhancement (34)
- good first issue (20)
- help wanted (17)
- new model (15)
- pr welcome (12)
- documentation (6)
- build (2)
- duplicate (2)
- testing (1)
- high priority (1)
Top Pull Request Labels
- feature (463)
- bug (330)
- enhancement (258)
- documentation (130)
- build (59)
- gpu (54)
- refactor (47)
- testing (13)
- new model (6)
- question (3)
- stale (2)
Package metadata
- Total packages: 2
-
Total downloads:
- pypi: 19,532 last-month
- Total docker downloads: 750
- Total dependent packages: 3 (may contain duplicates)
- Total dependent repositories: 9 (may contain duplicates)
- Total versions: 242
- Total maintainers: 1
pypi.org: xinference
Model Serving Made Easy
- Homepage: https://github.com/xorbitsai/inference
- Documentation: https://xinference.readthedocs.io/
- Licenses: Apache License 2.0
- Latest release: 1.17.1 (published 22 days ago)
- Last Synced: 2026-01-20T19:52:43.006Z (15 days ago)
- Versions: 132
- Dependent Packages: 3
- Dependent Repositories: 9
- Downloads: 19,532 Last month
- Docker Downloads: 750
-
Rankings:
- Stargazers count: 2.027%
- Downloads: 3.469%
- Average: 4.666%
- Dependent repos count: 4.955%
- Forks count: 5.508%
- Dependent packages count: 7.373%
- Maintainers (1)
proxy.golang.org: github.com/xorbitsai/inference
- Homepage:
- Documentation: https://pkg.go.dev/github.com/xorbitsai/inference#section-documentation
- Licenses: apache-2.0
- Latest release: v1.17.1 (published 22 days ago)
- Last Synced: 2026-01-20T19:53:09.571Z (15 days ago)
- Versions: 110
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent packages count: 6.528%
- Average: 6.747%
- Dependent repos count: 6.966%
Dependencies
- actions/checkout v3 composite
- actions/setup-python v4 composite
- codecov/codecov-action v3 composite
- conda-incubator/setup-miniconda v2 composite
- isort/isort-action master composite
- psf/black stable composite
- py-actions/flake8 v2 composite
- actions/checkout v3 composite
- actions/setup-python v4 composite
- pypa/gh-action-pypi-publish v1.5.0 composite
- 1324 dependencies
- @babel/plugin-proposal-private-property-in-object ^7.21.11 development
- @emotion/react ^11.11.1
- @emotion/styled ^11.11.0
- @fullcalendar/core ^6.1.8
- @fullcalendar/daygrid ^6.1.8
- @fullcalendar/list ^6.1.8
- @fullcalendar/timegrid ^6.1.8
- @mui/icons-material ^5.14.0
- @mui/material ^5.14.0
- @mui/x-data-grid ^6.10.0
- @nivo/bar ^0.83.0
- @nivo/core ^0.83.0
- @nivo/geo ^0.83.0
- @nivo/line ^0.83.0
- @nivo/pie ^0.83.0
- @testing-library/jest-dom ^5.16.5
- @testing-library/react ^13.4.0
- @testing-library/user-event ^13.5.0
- formik ^2.4.2
- react ^18.2.0
- react-dom ^18.2.0
- react-pro-sidebar ^1.1.0-alpha.1
- react-router-dom ^6.14.1
- react-scripts 5.0.1
- uuid ^9.0.0
- web-vitals ^2.1.4
- yup ^1.2.0