lmdeploy

codellama cuda-kernels deepspeed fastertransformer internlm llama llama2 llama3 llm llm-inference turbomind

Score: 24.44393457770746

Last synced: about 4 hours ago
JSON representation

Repository metadata:

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Host: GitHub
URL: https://github.com/internlm/lmdeploy
Owner: InternLM
License: apache-2.0
Created: 2023-06-15T12:38:06.000Z (over 3 years ago)
Default Branch: main
Last Pushed: 2026-09-23T07:34:01.000Z (10 days ago)
Last Synced: 2026-09-27T02:42:36.587Z (6 days ago)
Topics: codellama, cuda-kernels, deepspeed, fastertransformer, internlm, llama, llama2, llama3, llm, llm-inference, turbomind
Language: Python
Homepage: https://lmdeploy.readthedocs.io/en/latest
Size: 16.1 MB
Stars: 8,098
Watchers: 57
Forks: 755
Open Issues: 597
Metadata Files:
- Readme: README.md
- Contributing: .github/CONTRIBUTING.md
- License: LICENSE

Owner metadata:

Name: InternLM
Login: InternLM
Email: internlm@pjlab.org.cn
Kind: organization
Description:
Website: https://chat.intern-ai.org.cn/
Location: China
Twitter: intern_lm
Company:
Icon url: https://avatars.githubusercontent.com/u/135356492?v=4
Repositories: 16
Last Synced at: 2026-10-02T02:56:33.292Z
Profile URL: https://github.com/InternLM

GitHub Events

Total

Commit comment event: 1
Create event: 41
Delete event: 38
Discussion event: 1
Fork event: 228
Issue comment event: 2824
Issues event: 1023
Member event: 1
Pull request event: 1333
Pull request review comment event: 1399
Pull request review event: 2097
Push event: 845
Release event: 18
Watch event: 2519
Total: 12368

Last Year

Create event: 13
Delete event: 21
Discussion event: 1
Fork event: 20
Issue comment event: 310
Issues event: 125
Pull request event: 214
Pull request review comment event: 445
Pull request review event: 393
Push event: 239
Release event: 3
Watch event: 234
Total: 2018

Committers metadata

Last synced: 1 day ago

Total Commits: 2,123
Total Committers: 157
Avg Commits per committer: 13.522
Development Distribution Score (DDS): 0.804

Commits in past year: 585
Committers in past year: 48
Avg Commits per committer in past year: 12.188
Development Distribution Score (DDS) in past year: 0.778

Name	Email	Commits
Lyu Han	l**8@1**m	416
q yao	s**o@l**m	351
AllentDan	4****n	190
Chen Xin	i**c@g**m	184
RunningLeon	m**g@y**t	162
Li Zhang	l**9@g**m	120
zxy	4****y	108
zhulinJulia24	1****4	75
windreamer	w**r@g**m	42
zhyncs	m**e@z**m	40
yaofengchen	6****n	28
jinminxi104	j**4@h**m	24
littlegy	7**6@q**m	23
tpoisonooo	k**n@a**m	23
CyCle1024	c**u@p**n	20
pppppM	6****M	16
tangzhiyi11	t****1	13
zhaochaoxing	1****g	12
Ke Bao	I**e@1**m	11
qinkun	8****6	10
zhoushenglong	8****u	10
WRH	1****i	10
Wei Tao	1**1@q**m	10
Qing Wang	4****z	9
JimyMa	3****a	8
Tsundoku958	w**u@g**m	7
q.yao	y**n@s**m	6
Tai An	a**1@o**m	5
caikun-pjlab	1****b	5
vansin	m**e@1**m	5
and 127 more...

Issue and Pull Request metadata

Last synced: 1 day ago

Total issues: 2,230
Total pull requests: 3,783
Average time to close issues: 20 days
Average time to close pull requests: 13 days
Total issue authors: 1,101
Total pull request authors: 222
Average comments per issue: 4.35
Average comments per pull request: 1.12
Merged pull request: 3,035
Bot issues: 1
Bot pull requests: 1

Past year issues: 219
Past year pull requests: 759
Past year average time to close issues: 21 days
Past year average time to close pull requests: 13 days
Past year issue authors: 141
Past year pull request authors: 83
Past year average comments per issue: 3.22
Past year average comments per pull request: 0.59
Past year merged pull request: 580
Past year bot issues: 0
Past year bot pull requests: 0

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/internlm/lmdeploy

Top Issue Authors

zhulinJulia24 (76)
frankxyy (43)
zhyncs (33)
sleepwalker2017 (27)
maxin9966 (21)
josephrocca (20)
simonjhy (19)
Vincent131499 (17)
lmingze (16)
bltcn (14)
Gierry (12)
del-zhenwu (11)
pseudotensor (10)
shell-nlp (10)
hitzhu (9)

Top Pull Request Authors

lvhan028 (688)
grimoire (607)
AllentDan (356)
irexyc (328)
RunningLeon (263)
lzhangzz (170)
CUHKSZzxy (158)
zhulinJulia24 (149)
zhyncs (101)
windreamer (68)
yao-fengchen (59)
jinminxi104 (46)
CyCle1024 (40)
JackWeiw (35)
tangzhiyi11 (30)

Top Issue Labels

awaiting response (431)
Stale (266)
backlog (39)
Bug:P1 (11)
wontfix (11)
planned feature (10)
improvement (8)
mllm (8)
v100 (7)
enhancement (5)
Bug:P2 (2)
good first issue (2)
benchmark (2)
documentation (2)
duplicate (2)
bug (1)
usage (1)
Installation (1)
RFC (1)
BC-breaking (1)

Top Pull Request Labels

improvement (929)
Bug:P1 (683)
enhancement (432)
documentation (170)
Bug:P0 (132)
Bug:P2 (97)
planned feature (32)
WIP (17)
BC-breaking (12)
turbomind (11)
Bug:P3 (10)
bug (5)
javascript (1)
awaiting response (1)
dependencies (1)
Stale (1)

Package metadata

Total packages: 4
Total downloads:
- pypi: 27,213 last-month
Total docker downloads: 3,030
Total dependent packages: 1 (may contain duplicates)
Total dependent repositories: 2 (may contain duplicates)
Total versions: 241
Total maintainers: 1
Total advisories: 10

proxy.golang.org: github.com/InternLM/LMDeploy

Homepage:
Documentation: https://pkg.go.dev/github.com/InternLM/LMDeploy#section-documentation
Licenses: apache-2.0
Latest release: v0.18.0 (published 5 days ago)
Last Synced: 2026-10-01T18:03:37.319Z (1 day ago)
Versions: 57
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Stargazers count: 1.003%
- Forks count: 1.362%
- Average: 2.678%
- Dependent packages count: 4.034%
- Dependent repos count: 4.315%

pypi.org: lmdeploy

A toolset for compressing, deploying and serving LLM

Homepage:
Documentation: https://lmdeploy.readthedocs.io/
Licenses: apache-2.0
Latest release: 0.18.0 (published 4 days ago)
Last Synced: 2026-10-01T18:03:10.356Z (1 day ago)
Versions: 70
Dependent Packages: 1
Dependent Repositories: 2
Downloads: 27,213 Last month
Docker Downloads: 3,030
Rankings:
- Docker downloads count: 2.036%
- Dependent packages count: 4.778%
- Downloads: 5.516%
- Average: 5.969%
- Dependent repos count: 11.544%
Maintainers (1)
- openmmlab
Advisories:

proxy.golang.org: github.com/InternLM/lmdeploy

Homepage:
Documentation: https://pkg.go.dev/github.com/InternLM/lmdeploy#section-documentation
Licenses: apache-2.0
Latest release: v0.18.0 (published 3 days ago)
Last Synced: 2026-10-01T18:03:17.630Z (1 day ago)
Versions: 57
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent packages count: 6.528%
- Average: 6.747%
- Dependent repos count: 6.966%

proxy.golang.org: github.com/internlm/lmdeploy

Homepage:
Documentation: https://pkg.go.dev/github.com/internlm/lmdeploy#section-documentation
Licenses: apache-2.0
Latest release: v0.18.0 (published 5 days ago)
Last Synced: 2026-10-01T18:03:13.974Z (1 day ago)
Versions: 57
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent packages count: 6.528%
- Average: 6.747%
- Dependent repos count: 6.966%

Dependencies

.github/workflows/docker.yml actions

actions/checkout v3 composite

.github/workflows/lint.yml actions

DoozyX/clang-format-lint-action v0.13 composite
actions/checkout v2 composite
actions/setup-python v2 composite
gaurav-nelson/github-action-markdown-link-check v1 composite

.github/workflows/pypi.yml actions

Jimver/cuda-toolkit v0.2.11 composite
actions/checkout v3 composite
actions/download-artifact v3 composite
actions/setup-python v4 composite
actions/upload-artifact v3 composite

.github/workflows/stale.yml actions

actions/stale v7 composite

docker/Dockerfile docker

nvcr.io/nvidia/tritonserver 22.12-py3 build

setup.py pypi

requirements/docs.txt pypi

docutils ==0.16.0
m2r ==0.2.1
markdown >=3.4.0
mistune ==0.8.4
myst-parser *
recommonmark *
sphinx ==4.0.2
sphinx-copybutton *
sphinx_markdown_tables >=0.0.16
sphinxcontrib-mermaid *

requirements/test.txt pypi

allure-pytest * test
coverage * test
pynvml * test
pytest * test
pyyaml * test

.github/workflows/linux_x64_gpu.yml actions

actions/checkout v3 composite
jlumbroso/free-disk-space 54081f138730dfa15788a46383842cd2f914a1be composite

.github/workflows/docker_nightly.yml actions

actions/checkout v6 composite
docker/login-action v2 composite
jlumbroso/free-disk-space 54081f138730dfa15788a46383842cd2f914a1be composite

.github/workflows/mllm_api_eval.yml actions

actions/checkout v6 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite
jlumbroso/free-disk-space 54081f138730dfa15788a46383842cd2f914a1be composite

.github/workflows/docker_dev.yml actions

actions/checkout v4 composite
docker/login-action v2 composite
jlumbroso/free-disk-space v1.3.1 composite

.github/workflows/unit_test.yml actions

actions/checkout v5 composite

.github/workflows/windows_x64_gpu.yml actions

actions/checkout v3 composite
actions/setup-python v4 composite

.github/workflows/test_docker.yml actions

MaxymVlasov/dive-action v1.5.0 composite
actions/checkout v3 composite
docker/setup-buildx-action v3 composite
jlumbroso/free-disk-space main composite

.github/workflows/api_eval.yml actions

actions/checkout v2 composite
actions/checkout v3 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite
jlumbroso/free-disk-space main composite

.github/workflows/daily_ete_test_3090.yml actions

actions/checkout v2 composite
actions/checkout v3 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite
jlumbroso/free-disk-space main composite

requirements_ascend.txt pypi

requirements_maca.txt pypi

requirements_rocm.txt pypi

.github/workflows/daily_ete_test_5080.yml actions

actions/checkout v2 composite
actions/checkout v3 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite
jlumbroso/free-disk-space main composite

requirements_camb.txt pypi

requirements_cuda.txt pypi

.github/workflows/benchmark.yml actions

actions/checkout v2 composite
actions/checkout v3 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite
jlumbroso/free-disk-space main composite

.github/workflows/daily_ete_test.yml actions

actions/checkout v2 composite
actions/checkout v3 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite
jlumbroso/free-disk-space main composite

.github/workflows/pr_ete_test.yml actions

actions/checkout v2 composite

pyproject.toml pypi

ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Summary