lmdeploy

codellama cuda-kernels deepspeed fastertransformer internlm llama llama2 llama3 llm llm-inference turbomind

Score: 24.943509109761592

Last synced: about 8 hours ago
JSON representation

Repository metadata:

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Host: GitHub
URL: https://github.com/internlm/lmdeploy
Owner: InternLM
License: apache-2.0
Created: 2023-06-15T12:38:06.000Z (about 3 years ago)
Default Branch: main
Last Pushed: 2026-08-05T16:03:14.000Z (8 days ago)
Last Synced: 2026-08-05T20:57:34.756Z (7 days ago)
Topics: codellama, cuda-kernels, deepspeed, fastertransformer, internlm, llama, llama2, llama3, llm, llm-inference, turbomind
Language: Python
Homepage: https://lmdeploy.readthedocs.io/en/latest
Size: 14.4 MB
Stars: 7,992
Watchers: 56
Forks: 722
Open Issues: 608
Metadata Files:
- Readme: README.md
- Contributing: .github/CONTRIBUTING.md
- License: LICENSE

Owner metadata:

Name: InternLM
Login: InternLM
Email: internlm@pjlab.org.cn
Kind: organization
Description:
Website: https://internlm.intern-ai.org.cn/
Location: China
Twitter: intern_lm
Company:
Icon url: https://avatars.githubusercontent.com/u/135356492?v=4
Repositories: 16
Last Synced at: 2024-05-06T00:03:26.107Z
Profile URL: https://github.com/InternLM

GitHub Events

Total

Commit comment event: 1
Create event: 28
Delete event: 17
Fork event: 207
Issue comment event: 2502
Issues event: 891
Member event: 1
Pull request event: 1116
Pull request review comment event: 950
Pull request review event: 1698
Push event: 605
Release event: 15
Watch event: 2269
Total: 10300

Last Year

Commit comment event: 1
Create event: 28
Delete event: 17
Fork event: 207
Issue comment event: 2502
Issues event: 891
Member event: 1
Pull request event: 1116
Pull request review comment event: 950
Pull request review event: 1698
Push event: 605
Release event: 15
Watch event: 2269
Total: 10300

Committers metadata

Last synced: 3 days ago

Total Commits: 2,020
Total Committers: 145
Avg Commits per committer: 13.931
Development Distribution Score (DDS): 0.807

Commits in past year: 591
Committers in past year: 44
Avg Commits per committer in past year: 13.432
Development Distribution Score (DDS) in past year: 0.785

Name	Email	Commits
Lyu Han	l**8@1**m	390
q yao	s**o@l**m	339
AllentDan	4****n	190
Chen Xin	i**c@g**m	177
RunningLeon	m**g@y**t	160
Li Zhang	l**9@g**m	114
zxy	4****y	96
zhulinJulia24	1****4	71
zhyncs	m**e@z**m	40
windreamer	w**r@g**m	39
yaofengchen	6****n	28
jinminxi104	j**4@h**m	24
tpoisonooo	k**n@a**m	23
CyCle1024	c**u@p**n	20
littlegy	7**6@q**m	19
pppppM	6****M	16
tangzhiyi11	t****1	13
zhaochaoxing	1****g	12
Ke Bao	I**e@1**m	11
qinkun	8****6	10
zhoushenglong	8****u	10
WRH	1****i	10
Wei Tao	1**1@q**m	10
JimyMa	3****a	8
Qing Wang	4****z	7
Tsundoku958	w**u@g**m	7
q.yao	y**n@s**m	6
vansin	m**e@1**m	5
del-zhenwu	d**u@g**m	4
lapy	l****y	4
and 115 more...

Issue and Pull Request metadata

Last synced: 1 day ago

Total issues: 1,596
Total pull requests: 2,379
Average time to close issues: 19 days
Average time to close pull requests: 9 days
Total issue authors: 855
Total pull request authors: 180
Average comments per issue: 2.71
Average comments per pull request: 1.02
Merged pull request: 1,720
Bot issues: 0
Bot pull requests: 0

Past year issues: 107
Past year pull requests: 379
Past year average time to close issues: about 1 month
Past year average time to close pull requests: 9 days
Past year issue authors: 75
Past year pull request authors: 47
Past year average comments per issue: 2.96
Past year average comments per pull request: 0.48
Past year merged pull request: 202
Past year bot issues: 0
Past year bot pull requests: 0

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/internlm/lmdeploy

Top Issue Authors

zhulinJulia24 (62)
zhyncs (30)
josephrocca (19)
maxin9966 (17)
sleepwalker2017 (13)
lmingze (13)
Gierry (12)
bltcn (12)
pseudotensor (10)
hitzhu (9)
shell-nlp (9)
Vincent131499 (9)
AllentDan (9)
zhanghui-china (8)
Kenneth-X (8)

Top Pull Request Authors

lvhan028 (420)
grimoire (386)
AllentDan (222)
irexyc (205)
RunningLeon (162)
zhulinJulia24 (110)
lzhangzz (104)
CUHKSZzxy (91)
zhyncs (58)
yao-fengchen (43)
windreamer (37)
jinminxi104 (37)
JackWeiw (35)
CyCle1024 (32)
Reinerzhou (29)

Top Issue Labels

awaiting response (260)
Stale (176)
backlog (16)
improvement (9)
Bug:P1 (6)
mllm (5)
v100 (5)
wontfix (4)
enhancement (4)
planned feature (3)
benchmark (2)
Bug:P2 (2)
duplicate (1)
RFC (1)
documentation (1)
good first issue (1)
BC-breaking (1)

Top Pull Request Labels

improvement (547)
Bug:P1 (410)
enhancement (277)
documentation (84)
Bug:P2 (59)
Bug:P0 (42)
WIP (15)
planned feature (11)
BC-breaking (8)
turbomind (6)
Bug:P3 (5)
bug (5)
awaiting response (3)
Stale (2)

Package metadata

Total packages: 3
Total downloads:
- pypi: 51,536 last-month
Total docker downloads: 3,030
Total dependent packages: 1 (may contain duplicates)
Total dependent repositories: 2 (may contain duplicates)
Total versions: 175
Total maintainers: 1
Total advisories: 6

pypi.org: lmdeploy

A toolset for compressing, deploying and serving LLM

Homepage:
Documentation: https://lmdeploy.readthedocs.io/
Licenses: apache-2.0
Latest release: 0.15.0 (published 13 days ago)
Last Synced: 2026-08-11T22:06:37.427Z (1 day ago)
Versions: 67
Dependent Packages: 1
Dependent Repositories: 2
Downloads: 51,536 Last month
Docker Downloads: 3,030
Rankings:
- Docker downloads count: 2.036%
- Dependent packages count: 4.778%
- Downloads: 5.516%
- Average: 5.969%
- Dependent repos count: 11.544%
Maintainers (1)
- openmmlab
Advisories:

proxy.golang.org: github.com/InternLM/lmdeploy

Homepage:
Documentation: https://pkg.go.dev/github.com/InternLM/lmdeploy#section-documentation
Licenses: apache-2.0
Latest release: v0.15.0 (published 13 days ago)
Last Synced: 2026-08-11T22:04:31.574Z (1 day ago)
Versions: 54
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent packages count: 6.528%
- Average: 6.747%
- Dependent repos count: 6.966%

proxy.golang.org: github.com/internlm/lmdeploy

Homepage:
Documentation: https://pkg.go.dev/github.com/internlm/lmdeploy#section-documentation
Licenses: apache-2.0
Latest release: v0.15.0 (published 13 days ago)
Last Synced: 2026-08-11T22:06:03.380Z (1 day ago)
Versions: 54
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent packages count: 6.528%
- Average: 6.747%
- Dependent repos count: 6.966%

Dependencies

.github/workflows/docker.yml actions

actions/checkout v3 composite

.github/workflows/lint.yml actions

DoozyX/clang-format-lint-action v0.13 composite
actions/checkout v2 composite
actions/setup-python v2 composite
gaurav-nelson/github-action-markdown-link-check v1 composite

.github/workflows/pypi.yml actions

Jimver/cuda-toolkit v0.2.11 composite
actions/checkout v3 composite
actions/download-artifact v3 composite
actions/setup-python v4 composite
actions/upload-artifact v3 composite

.github/workflows/stale.yml actions

actions/stale v7 composite

docker/Dockerfile docker

nvcr.io/nvidia/tritonserver 22.12-py3 build

setup.py pypi

requirements/docs.txt pypi

docutils ==0.16.0
m2r ==0.2.1
markdown >=3.4.0
mistune ==0.8.4
myst-parser *
recommonmark *
sphinx ==4.0.2
sphinx-copybutton *
sphinx_markdown_tables >=0.0.16
sphinxcontrib-mermaid *

requirements/test.txt pypi

allure-pytest * test
coverage * test
pynvml * test
pytest * test
pyyaml * test

.github/workflows/linux_x64_gpu.yml actions

actions/checkout v3 composite
jlumbroso/free-disk-space 54081f138730dfa15788a46383842cd2f914a1be composite

.github/workflows/docker_nightly.yml actions

actions/checkout v6 composite
docker/login-action v2 composite
jlumbroso/free-disk-space 54081f138730dfa15788a46383842cd2f914a1be composite

.github/workflows/mllm_api_eval.yml actions

actions/checkout v6 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite
jlumbroso/free-disk-space 54081f138730dfa15788a46383842cd2f914a1be composite

.github/workflows/docker_dev.yml actions

actions/checkout v4 composite
docker/login-action v2 composite
jlumbroso/free-disk-space v1.3.1 composite

.github/workflows/unit_test.yml actions

actions/checkout v5 composite

.github/workflows/windows_x64_gpu.yml actions

actions/checkout v3 composite
actions/setup-python v4 composite

.github/workflows/test_docker.yml actions

MaxymVlasov/dive-action v1.5.0 composite
actions/checkout v3 composite
docker/setup-buildx-action v3 composite
jlumbroso/free-disk-space main composite

.github/workflows/api_eval.yml actions

actions/checkout v2 composite
actions/checkout v3 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite
jlumbroso/free-disk-space main composite

.github/workflows/daily_ete_test_3090.yml actions

actions/checkout v2 composite
actions/checkout v3 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite
jlumbroso/free-disk-space main composite

requirements_ascend.txt pypi

requirements_maca.txt pypi

requirements_rocm.txt pypi

.github/workflows/daily_ete_test_5080.yml actions

actions/checkout v2 composite
actions/checkout v3 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite
jlumbroso/free-disk-space main composite

.github/workflows/evaluate.yml actions

actions/checkout v2 composite
actions/checkout v3 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite
jlumbroso/free-disk-space main composite

requirements_camb.txt pypi

requirements_cuda.txt pypi

.github/workflows/benchmark.yml actions

actions/checkout v2 composite
actions/checkout v3 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite
jlumbroso/free-disk-space main composite

.github/workflows/daily_ete_test.yml actions

actions/checkout v2 composite
actions/checkout v3 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite
jlumbroso/free-disk-space main composite

.github/workflows/pr_ete_test.yml actions

actions/checkout v2 composite

pyproject.toml pypi

ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Summary