lmdeploy

codellama cuda-kernels deepspeed fastertransformer internlm llama llama2 llama3 llm llm-inference turbomind

Score: 26.040857043154144

Last synced: about 8 hours ago
JSON representation

Repository metadata:

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Host: GitHub
URL: https://github.com/InternLM/lmdeploy
Owner: InternLM
License: apache-2.0
Created: 2023-06-15T12:38:06.000Z (almost 3 years ago)
Default Branch: main
Last Pushed: 2026-05-29T07:55:56.000Z (4 days ago)
Last Synced: 2026-05-29T08:30:45.331Z (4 days ago)
Topics: codellama, cuda-kernels, deepspeed, fastertransformer, internlm, llama, llama2, llama3, llm, llm-inference, turbomind
Language: Python
Homepage: https://lmdeploy.readthedocs.io/en/latest
Size: 12.4 MB
Stars: 7,876
Watchers: 55
Forks: 699
Open Issues: 603
Metadata Files:
- Readme: README.md
- Contributing: .github/CONTRIBUTING.md
- License: LICENSE

Owner metadata:

Name: InternLM
Login: InternLM
Email: internlm@pjlab.org.cn
Kind: organization
Description:
Website: https://internlm.intern-ai.org.cn/
Location: China
Twitter: intern_lm
Company:
Icon url: https://avatars.githubusercontent.com/u/135356492?v=4
Repositories: 16
Last Synced at: 2024-05-06T00:03:26.107Z
Profile URL: https://github.com/InternLM

GitHub Events

Total

Commit comment event: 1
Create event: 28
Delete event: 17
Fork event: 207
Issue comment event: 2502
Issues event: 891
Member event: 1
Pull request event: 1116
Pull request review comment event: 950
Pull request review event: 1698
Push event: 605
Release event: 15
Watch event: 2269
Total: 10300

Last Year

Commit comment event: 1
Create event: 28
Delete event: 17
Fork event: 207
Issue comment event: 2502
Issues event: 891
Member event: 1
Pull request event: 1116
Pull request review comment event: 950
Pull request review event: 1698
Push event: 605
Release event: 15
Watch event: 2269
Total: 10300

Committers metadata

Last synced: 7 days ago

Total Commits: 1,879
Total Committers: 139
Avg Commits per committer: 13.518
Development Distribution Score (DDS): 0.806

Commits in past year: 578
Committers in past year: 50
Avg Commits per committer in past year: 11.56
Development Distribution Score (DDS) in past year: 0.785

Name	Email	Commits
Lyu Han	l**8@1**m	364
q yao	s**o@l**m	317
AllentDan	4****n	190
Chen Xin	i**c@g**m	164
RunningLeon	m**g@y**t	140
Li Zhang	l**9@g**m	103
zxy	4****y	79
zhulinJulia24	1****4	69
zhyncs	m**e@z**m	40
windreamer	w**r@g**m	34
yaofengchen	6****n	28
tpoisonooo	k**n@a**m	23
jinminxi104	j**4@h**m	22
CyCle1024	c**u@p**n	20
pppppM	6****M	16
tangzhiyi11	t****1	13
zhaochaoxing	1****g	12
Ke Bao	I**e@1**m	11
littlegy	7**6@q**m	10
zhoushenglong	8****u	10
WRH	1****i	10
Wei Tao	1**1@q**m	10
qinkun	8****6	9
JimyMa	3****a	8
Tsundoku958	w**u@g**m	7
q.yao	y**n@s**m	6
vansin	m**e@1**m	5
del-zhenwu	d**u@g**m	4
lapy	l****y	4
liukuikun	2****k	4
and 109 more...

Issue and Pull Request metadata

Last synced: 10 days ago

Total issues: 1,575
Total pull requests: 2,195
Average time to close issues: 18 days
Average time to close pull requests: 9 days
Total issue authors: 847
Total pull request authors: 166
Average comments per issue: 2.72
Average comments per pull request: 1.06
Merged pull request: 1,609
Bot issues: 0
Bot pull requests: 0

Past year issues: 164
Past year pull requests: 383
Past year average time to close issues: 20 days
Past year average time to close pull requests: 5 days
Past year issue authors: 119
Past year pull request authors: 44
Past year average comments per issue: 2.32
Past year average comments per pull request: 0.42
Past year merged pull request: 222
Past year bot issues: 0
Past year bot pull requests: 0

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/InternLM/lmdeploy

Top Issue Authors

zhulinJulia24 (62)
zhyncs (30)
josephrocca (19)
maxin9966 (17)
lmingze (13)
sleepwalker2017 (13)
Gierry (12)
bltcn (11)
pseudotensor (10)
Vincent131499 (9)
AllentDan (9)
shell-nlp (9)
hitzhu (9)
Skyseaee (8)
WCwalker (8)

Top Pull Request Authors

lvhan028 (379)
grimoire (365)
AllentDan (222)
irexyc (192)
RunningLeon (143)
zhulinJulia24 (106)
lzhangzz (95)
CUHKSZzxy (69)
zhyncs (58)
yao-fengchen (43)
jinminxi104 (37)
windreamer (35)
JackWeiw (35)
CyCle1024 (32)
Reinerzhou (29)

Top Issue Labels

awaiting response (258)
Stale (174)
backlog (15)
improvement (9)
Bug:P1 (6)
mllm (5)
v100 (5)
wontfix (4)
enhancement (4)
planned feature (3)
benchmark (2)
Bug:P2 (2)
duplicate (1)
RFC (1)
documentation (1)
good first issue (1)
BC-breaking (1)

Top Pull Request Labels

improvement (503)
Bug:P1 (387)
enhancement (262)
documentation (84)
Bug:P2 (56)
Bug:P0 (22)
WIP (15)
planned feature (9)
BC-breaking (7)
turbomind (6)
Bug:P3 (5)
bug (5)
awaiting response (3)
Stale (2)

Package metadata

Total packages: 3
Total downloads:
- pypi: 169,963 last-month
Total docker downloads: 3,030
Total dependent packages: 1 (may contain duplicates)
Total dependent repositories: 2 (may contain duplicates)
Total versions: 167
Total maintainers: 1
Total advisories: 6

pypi.org: lmdeploy

A toolset for compressing, deploying and serving LLM

Homepage:
Documentation: https://lmdeploy.readthedocs.io/
Licenses: apache-2.0
Latest release: 0.13.0 (published 22 days ago)
Last Synced: 2026-05-31T13:43:36.536Z (2 days ago)
Versions: 65
Dependent Packages: 1
Dependent Repositories: 2
Downloads: 169,963 Last month
Docker Downloads: 3,030
Rankings:
- Docker downloads count: 2.036%
- Dependent packages count: 4.778%
- Downloads: 5.516%
- Average: 5.969%
- Dependent repos count: 11.544%
Maintainers (1)
- openmmlab
Advisories:

proxy.golang.org: github.com/InternLM/lmdeploy

Homepage:
Documentation: https://pkg.go.dev/github.com/InternLM/lmdeploy#section-documentation
Licenses: apache-2.0
Latest release: v0.13.0 (published 22 days ago)
Last Synced: 2026-05-24T07:05:42.767Z (10 days ago)
Versions: 52
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent packages count: 6.528%
- Average: 6.747%
- Dependent repos count: 6.966%

proxy.golang.org: github.com/internlm/lmdeploy

Homepage:
Documentation: https://pkg.go.dev/github.com/internlm/lmdeploy#section-documentation
Licenses: apache-2.0
Latest release: v0.12.2 (published 3 months ago)
Last Synced: 2026-05-10T07:07:30.325Z (24 days ago)
Versions: 50
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent packages count: 6.528%
- Average: 6.747%
- Dependent repos count: 6.966%

Dependencies

.github/workflows/docker.yml actions

actions/checkout v3 composite

.github/workflows/lint.yml actions

DoozyX/clang-format-lint-action v0.13 composite
actions/checkout v2 composite
actions/setup-python v2 composite
gaurav-nelson/github-action-markdown-link-check v1 composite

.github/workflows/linux-x64-gpu.yml actions

actions/checkout v3 composite

.github/workflows/pypi.yml actions

Jimver/cuda-toolkit v0.2.11 composite
actions/checkout v3 composite
actions/download-artifact v3 composite
actions/setup-python v4 composite
actions/upload-artifact v3 composite

.github/workflows/stale.yml actions

actions/stale v7 composite

.github/workflows/windows-x64-gpu.yml actions

Jimver/cuda-toolkit v0.2.11 composite
actions/checkout v3 composite
actions/setup-python v4 composite

docker/Dockerfile docker

nvcr.io/nvidia/tritonserver 22.12-py3 build

setup.py pypi

requirements/docs.txt pypi

docutils ==0.16.0
m2r ==0.2.1
markdown >=3.4.0
mistune ==0.8.4
myst-parser *
recommonmark *
sphinx ==4.0.2
sphinx-copybutton *
sphinx_markdown_tables >=0.0.16
sphinxcontrib-mermaid *

requirements/test.txt pypi

allure-pytest * test
coverage * test
pynvml * test
pytest * test
pyyaml * test

.github/workflows/cuda12.8-whl-release.yml actions

actions/checkout v3 composite
actions/download-artifact v4 composite
actions/setup-python v4 composite
actions/upload-artifact v4 composite
jlumbroso/free-disk-space main composite
softprops/action-gh-release v1 composite

.github/workflows/test_docker.yml actions

MaxymVlasov/dive-action v1.5.0 composite
actions/checkout v3 composite
docker/setup-buildx-action v3 composite
jlumbroso/free-disk-space main composite

.github/workflows/api_eval.yml actions

actions/checkout v2 composite
actions/checkout v3 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite
jlumbroso/free-disk-space main composite

.github/workflows/daily_ete_test_3090.yml actions

actions/checkout v2 composite
actions/checkout v3 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite
jlumbroso/free-disk-space main composite

.github/workflows/daily_ete_test_h800.yml actions

actions/checkout v2 composite
actions/checkout v3 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite
jlumbroso/free-disk-space main composite

.github/workflows/evaluate_h800.yml actions

actions/checkout v3 composite
actions/checkout v2 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite

requirements_ascend.txt pypi

.github/workflows/stable.yml actions

actions/checkout v3 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite

requirements_maca.txt pypi

requirements_rocm.txt pypi

.github/workflows/api_eval_h800.yml actions

actions/checkout v3 composite
actions/checkout v2 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite

.github/workflows/daily_ete_test_5080.yml actions

actions/checkout v2 composite
actions/checkout v3 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite
jlumbroso/free-disk-space main composite

.github/workflows/evaluate.yml actions

actions/checkout v2 composite
actions/checkout v3 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite
jlumbroso/free-disk-space main composite

.github/workflows/evaluate_remote.yml actions

actions/checkout v2 composite
actions/checkout v3 composite
actions/download-artifact v4 composite
actions/setup-python v4 composite
actions/upload-artifact v4 composite
nick-fields/retry v3 composite

requirements_camb.txt pypi

requirements_cuda.txt pypi

.github/workflows/benchmark.yml actions

actions/checkout v2 composite
actions/checkout v3 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite
jlumbroso/free-disk-space main composite

.github/workflows/daily_ete_test.yml actions

actions/checkout v2 composite
actions/checkout v3 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite
jlumbroso/free-disk-space main composite

.github/workflows/pr_ete_test.yml actions

actions/checkout v2 composite

.github/workflows/unit-test.yml actions

actions/checkout v5 composite

pyproject.toml pypi

ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Summary