inference

artificial-intelligence chatglm deployment flan-t5 gemma ggml glm4 inference llama llama3 llamacpp llm machine-learning mistral openai-api pytorch qwen vllm whisper wizardlm

Score: 24.33444509813883

Last synced: about 23 hours ago
JSON representation

Repository metadata:

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

Host: GitHub
URL: https://github.com/xorbitsai/inference
Owner: xorbitsai
License: apache-2.0
Created: 2023-06-14T07:05:04.000Z (almost 3 years ago)
Default Branch: main
Last Pushed: 2026-05-21T12:26:30.000Z (12 days ago)
Last Synced: 2026-05-21T15:19:49.410Z (12 days ago)
Topics: artificial-intelligence, chatglm, deployment, flan-t5, gemma, ggml, glm4, inference, llama, llama3, llamacpp, llm, machine-learning, mistral, openai-api, pytorch, qwen, vllm, whisper, wizardlm
Language: Python
Homepage: https://inference.readthedocs.io
Size: 70.3 MB
Stars: 9,312
Watchers: 60
Forks: 826
Open Issues: 50
Metadata Files:
- Readme: README.md
- License: LICENSE

Owner metadata:

Name: Xorbits
Login: xorbitsai
Email:
Kind: organization
Description: Xorbits makes it easy to scale ML and DS workloads, from data loading to preprocessing, tuning, training, and model serving.
Website: xorbits.io
Location:
Twitter: Xorbitsio
Company:
Icon url: https://avatars.githubusercontent.com/u/109655068?v=4
Repositories: 1
Last Synced at: 2023-07-04T09:02:42.715Z
Profile URL: https://github.com/xorbitsai

GitHub Events

Total

Create event: 38
Delete event: 12
Fork event: 314
Issue comment event: 4978
Issues event: 1879
Member event: 4
Pull request event: 712
Pull request review comment event: 178
Pull request review event: 473
Push event: 349
Release event: 32
Watch event: 3064
Total: 12033

Last Year

Create event: 38
Delete event: 12
Fork event: 314
Issue comment event: 4978
Issues event: 1879
Member event: 4
Pull request event: 712
Pull request review comment event: 178
Pull request review event: 473
Push event: 349
Release event: 32
Watch event: 3064
Total: 12033

Committers metadata

Last synced: 6 days ago

Total Commits: 1,850
Total Committers: 140
Avg Commits per committer: 13.214
Development Distribution Score (DDS): 0.846

Commits in past year: 607
Committers in past year: 51
Avg Commits per committer in past year: 11.902
Development Distribution Score (DDS) in past year: 0.827

Name	Email	Commits
Xuye Qin	q**e@g**m	285
codingl2k1	1****1	170
Chengjie Li	1****8	167
Uranus	1****n	136
OliverBryant	5****t	105
amumu96	1****6	101
aresnow1	1****1	96
xiaolei	1****s	90
Jun-Howie	6****e	61
llyycchhee	m**9@1**m	58
Minamiyama	m**a@q**m	51
XprobeBot	1****t	43
呆萌闷油瓶	2**2@q**m	36
zwt-1234	1****4	31
pangyoki	p**i@1**m	29
Bojun-Feng	1****g	29
Dreamsome	o**k@g**m	28
m199369309	z**i@c**m	27
jiayini1119	1****9	21
Adam Ning	f**t@g**m	20
hainaweiben	1****n	19
Rui Ji	r**i@u**u	17
ZhikaiGuo960110	t**o@v**m	11
Mike Shi	s**i@h**m	9
wxiwnd	4****d	8
bash000000	m**3@o**m	8
Gmgge	4****e	6
Wang Xuejin	9****7	6
mujin2	1****2	6
aniya105	1****5	5
and 110 more...

Issue and Pull Request metadata

Last synced: 10 days ago

Total issues: 2,198
Total pull requests: 1,607
Average time to close issues: about 1 month
Average time to close pull requests: 6 days
Total issue authors: 1,129
Total pull request authors: 137
Average comments per issue: 3.14
Average comments per pull request: 0.54
Merged pull request: 1,252
Bot issues: 1
Bot pull requests: 1

Past year issues: 364
Past year pull requests: 251
Past year average time to close issues: 15 days
Past year average time to close pull requests: 2 days
Past year issue authors: 228
Past year pull request authors: 31
Past year average comments per issue: 3.91
Past year average comments per pull request: 0.38
Past year merged pull request: 178
Past year bot issues: 0
Past year bot pull requests: 0

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/xorbitsai/inference

Top Issue Authors

UranusSeven (52)
Minamiyama (28)
qinxuye (23)
leslie2046 (21)
Songjiadong (19)
lordk911 (18)
aresnow1 (18)
moshilangzi (16)
xs818818 (14)
yidasanqian (13)
wangyongpenga (12)
kelliaao (12)
rexjm (12)
YSblack (11)
frankSARU (11)

Top Pull Request Authors

qinxuye (334)
codingl2k1 (173)
ChengjieLi28 (144)
amumu96 (137)
yiboyasss (114)
Minamiyama (96)
Jun-Howie (84)
aresnow1 (40)
frostyplanet (32)
UranusSeven (28)
hainaweiben (24)
Bojun-Feng (17)
llyycchhee (17)
leslie2046 (16)
OliverBryant (16)

Top Issue Labels

stale (951)
gpu (718)
feature (322)
question (173)
bug (76)
enhancement (34)
good first issue (20)
help wanted (17)
new model (15)
pr welcome (12)
documentation (6)
duplicate (2)
build (2)
high priority (1)
Mend: dependency security vulnerability (1)
testing (1)

Top Pull Request Labels

feature (463)
bug (330)
enhancement (259)
documentation (130)
build (59)
gpu (54)
refactor (47)
testing (13)
new model (6)
question (3)
stale (2)
dependencies (1)

Package metadata

Total packages: 2
Total downloads:
- pypi: 27,472 last-month
Total docker downloads: 750
Total dependent packages: 3 (may contain duplicates)
Total dependent repositories: 9 (may contain duplicates)
Total versions: 266
Total maintainers: 1

pypi.org: xinference

Model Serving Made Easy

Homepage: https://github.com/xorbitsai/inference
Documentation: https://xinference.readthedocs.io/
Licenses: Apache License 2.0
Latest release: 2.9.0 (published 10 days ago)
Last Synced: 2026-05-27T09:04:46.628Z (6 days ago)
Versions: 144
Dependent Packages: 3
Dependent Repositories: 9
Downloads: 27,472 Last month
Docker Downloads: 750
Rankings:
- Stargazers count: 2.027%
- Downloads: 3.469%
- Average: 4.666%
- Dependent repos count: 4.955%
- Forks count: 5.508%
- Dependent packages count: 7.373%
Maintainers (1)
- xprobe

proxy.golang.org: github.com/xorbitsai/inference

Homepage:
Documentation: https://pkg.go.dev/github.com/xorbitsai/inference#section-documentation
Licenses: apache-2.0
Latest release: v2.9.0+incompatible (published 10 days ago)
Last Synced: 2026-05-27T09:04:50.529Z (6 days ago)
Versions: 122
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent packages count: 6.528%
- Average: 6.747%
- Dependent repos count: 6.966%

Dependencies

.github/workflows/python.yaml actions

actions/checkout v3 composite
actions/setup-python v4 composite
codecov/codecov-action v3 composite
conda-incubator/setup-miniconda v2 composite
isort/isort-action master composite
psf/black stable composite
py-actions/flake8 v2 composite

.github/workflows/release.yaml actions

actions/checkout v3 composite
actions/setup-python v4 composite
pypa/gh-action-pypi-publish v1.5.0 composite

xinference/web/ui/package-lock.json npm

1324 dependencies

xinference/web/ui/package.json npm

@babel/plugin-proposal-private-property-in-object ^7.21.11 development
@emotion/react ^11.11.1
@emotion/styled ^11.11.0
@fullcalendar/core ^6.1.8
@fullcalendar/daygrid ^6.1.8
@fullcalendar/list ^6.1.8
@fullcalendar/timegrid ^6.1.8
@mui/icons-material ^5.14.0
@mui/material ^5.14.0
@mui/x-data-grid ^6.10.0
@nivo/bar ^0.83.0
@nivo/core ^0.83.0
@nivo/geo ^0.83.0
@nivo/line ^0.83.0
@nivo/pie ^0.83.0
@testing-library/jest-dom ^5.16.5
@testing-library/react ^13.4.0
@testing-library/user-event ^13.5.0
formik ^2.4.2
react ^18.2.0
react-dom ^18.2.0
react-pro-sidebar ^1.1.0-alpha.1
react-router-dom ^6.14.1
react-scripts 5.0.1
uuid ^9.0.0
web-vitals ^2.1.4
yup ^1.2.0

pyproject.toml pypi

setup.py pypi

ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Summary