lmdeploy

codellama cuda-kernels deepspeed fastertransformer internlm llama llama2 llama3 llm llm-inference turbomind

Score: 25.62422507252923

Last synced: about 3 hours ago
JSON representation

Repository metadata:

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Host: GitHub
URL: https://github.com/internlm/lmdeploy
Owner: InternLM
License: apache-2.0
Created: 2023-06-15T12:38:06.000Z (almost 3 years ago)
Default Branch: main
Last Pushed: 2026-04-29T08:55:09.000Z (about 1 month ago)
Last Synced: 2026-04-29T09:06:55.132Z (about 1 month ago)
Topics: codellama, cuda-kernels, deepspeed, fastertransformer, internlm, llama, llama2, llama3, llm, llm-inference, turbomind
Language: Python
Homepage: https://lmdeploy.readthedocs.io/en/latest
Size: 11.8 MB
Stars: 7,825
Watchers: 54
Forks: 692
Open Issues: 588
Metadata Files:
- Readme: README.md
- Contributing: .github/CONTRIBUTING.md
- License: LICENSE

Owner metadata:

Name: InternLM
Login: InternLM
Email: internlm@pjlab.org.cn
Kind: organization
Description:
Website: https://internlm.intern-ai.org.cn/
Location: China
Twitter: intern_lm
Company:
Icon url: https://avatars.githubusercontent.com/u/135356492?v=4
Repositories: 16
Last Synced at: 2024-05-06T00:03:26.107Z
Profile URL: https://github.com/InternLM

GitHub Events

Total

Commit comment event: 1
Create event: 28
Delete event: 17
Fork event: 207
Issue comment event: 2502
Issues event: 891
Member event: 1
Pull request event: 1116
Pull request review comment event: 950
Pull request review event: 1698
Push event: 605
Release event: 15
Watch event: 2269
Total: 10300

Last Year

Commit comment event: 1
Create event: 28
Delete event: 17
Fork event: 207
Issue comment event: 2502
Issues event: 891
Member event: 1
Pull request event: 1116
Pull request review comment event: 950
Pull request review event: 1698
Push event: 605
Release event: 15
Watch event: 2269
Total: 10300

Committers metadata

Last synced: about 1 month ago

Total Commits: 1,845
Total Committers: 139
Avg Commits per committer: 13.273
Development Distribution Score (DDS): 0.811

Commits in past year: 583
Committers in past year: 54
Avg Commits per committer in past year: 10.796
Development Distribution Score (DDS) in past year: 0.787

Name	Email	Commits
Lyu Han	l**8@1**m	349
q yao	s**o@l**m	315
AllentDan	4****n	190
Chen Xin	i**c@g**m	164
RunningLeon	m**g@y**t	136
Li Zhang	l**9@g**m	101
zxy	4****y	73
zhulinJulia24	1****4	69
zhyncs	m**e@z**m	40
windreamer	w**r@g**m	32
yaofengchen	6****n	28
tpoisonooo	k**n@a**m	23
jinminxi104	j**4@h**m	22
CyCle1024	c**u@p**n	20
pppppM	6****M	16
tangzhiyi11	t****1	13
zhaochaoxing	1****g	12
Ke Bao	I**e@1**m	11
WRH	1****i	10
zhoushenglong	8****u	10
Wei Tao	1**1@q**m	10
littlegy	7**6@q**m	9
JimyMa	3****a	8
Tsundoku958	w**u@g**m	7
qinkun	8****6	7
q.yao	y**n@s**m	6
vansin	m**e@1**m	5
del-zhenwu	d**u@g**m	4
lapy	l****y	4
liukuikun	2****k	4
and 109 more...

Issue and Pull Request metadata

Last synced: about 1 month ago

Total issues: 1,562
Total pull requests: 2,125
Average time to close issues: 18 days
Average time to close pull requests: 9 days
Total issue authors: 837
Total pull request authors: 160
Average comments per issue: 2.71
Average comments per pull request: 1.08
Merged pull request: 1,573
Bot issues: 0
Bot pull requests: 0

Past year issues: 195
Past year pull requests: 404
Past year average time to close issues: 18 days
Past year average time to close pull requests: 5 days
Past year issue authors: 140
Past year pull request authors: 41
Past year average comments per issue: 1.92
Past year average comments per pull request: 0.37
Past year merged pull request: 258
Past year bot issues: 0
Past year bot pull requests: 0

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/internlm/lmdeploy

Top Issue Authors

zhulinJulia24 (62)
zhyncs (30)
josephrocca (19)
maxin9966 (17)
lmingze (13)
sleepwalker2017 (13)
Gierry (12)
bltcn (11)
pseudotensor (10)
Vincent131499 (9)
AllentDan (9)
hitzhu (9)
shell-nlp (9)
zhanghui-china (8)
xiezhipeng-git (8)

Top Pull Request Authors

lvhan028 (365)
grimoire (360)
AllentDan (222)
irexyc (190)
RunningLeon (138)
zhulinJulia24 (105)
lzhangzz (93)
CUHKSZzxy (58)
zhyncs (58)
yao-fengchen (42)
jinminxi104 (37)
JackWeiw (35)
CyCle1024 (32)
Reinerzhou (29)
zhaochaoxing (26)

Top Issue Labels

awaiting response (256)
Stale (172)
backlog (15)
improvement (9)
Bug:P1 (6)
mllm (5)
v100 (5)
wontfix (4)
enhancement (4)
planned feature (3)
benchmark (2)
Bug:P2 (2)
duplicate (1)
RFC (1)
documentation (1)
good first issue (1)
BC-breaking (1)

Top Pull Request Labels

improvement (491)
Bug:P1 (379)
enhancement (253)
documentation (83)
Bug:P2 (54)
Bug:P0 (17)
WIP (14)
planned feature (9)
BC-breaking (7)
turbomind (6)
Bug:P3 (5)
bug (5)
awaiting response (3)
Stale (2)

Package metadata

Total packages: 3
Total downloads:
- pypi: 111,911 last-month
Total docker downloads: 3,030
Total dependent packages: 1 (may contain duplicates)
Total dependent repositories: 2 (may contain duplicates)
Total versions: 165
Total maintainers: 1
Total advisories: 4

pypi.org: lmdeploy

A toolset for compressing, deploying and serving LLM

Homepage:
Documentation: https://lmdeploy.readthedocs.io/
Licenses: apache-2.0
Latest release: 0.12.3 (published about 1 month ago)
Last Synced: 2026-05-03T03:10:15.120Z (about 1 month ago)
Versions: 64
Dependent Packages: 1
Dependent Repositories: 2
Downloads: 111,911 Last month
Docker Downloads: 3,030
Rankings:
- Docker downloads count: 2.036%
- Dependent packages count: 4.778%
- Downloads: 5.516%
- Average: 5.969%
- Dependent repos count: 11.544%
Maintainers (1)
- openmmlab
Advisories:

proxy.golang.org: github.com/InternLM/lmdeploy

Homepage:
Documentation: https://pkg.go.dev/github.com/InternLM/lmdeploy#section-documentation
Licenses: apache-2.0
Latest release: v0.12.3 (published about 2 months ago)
Last Synced: 2026-04-29T19:04:08.803Z (about 1 month ago)
Versions: 51
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent packages count: 6.528%
- Average: 6.747%
- Dependent repos count: 6.966%

proxy.golang.org: github.com/internlm/lmdeploy

Homepage:
Documentation: https://pkg.go.dev/github.com/internlm/lmdeploy#section-documentation
Licenses: apache-2.0
Latest release: v0.12.2 (published 3 months ago)
Last Synced: 2026-03-30T04:02:15.600Z (2 months ago)
Versions: 50
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent packages count: 6.528%
- Average: 6.747%
- Dependent repos count: 6.966%

Dependencies

.github/workflows/docker.yml actions

actions/checkout v3 composite

.github/workflows/lint.yml actions

DoozyX/clang-format-lint-action v0.13 composite
actions/checkout v2 composite
actions/setup-python v2 composite
gaurav-nelson/github-action-markdown-link-check v1 composite

.github/workflows/linux-x64-gpu.yml actions

actions/checkout v3 composite

.github/workflows/pypi.yml actions

Jimver/cuda-toolkit v0.2.11 composite
actions/checkout v3 composite
actions/download-artifact v3 composite
actions/setup-python v4 composite
actions/upload-artifact v3 composite

.github/workflows/stale.yml actions

actions/stale v7 composite

.github/workflows/windows-x64-gpu.yml actions

Jimver/cuda-toolkit v0.2.11 composite
actions/checkout v3 composite
actions/setup-python v4 composite

docker/Dockerfile docker

nvcr.io/nvidia/tritonserver 22.12-py3 build

setup.py pypi

requirements/docs.txt pypi

docutils ==0.16.0
m2r ==0.2.1
markdown >=3.4.0
mistune ==0.8.4
myst-parser *
recommonmark *
sphinx ==4.0.2
sphinx-copybutton *
sphinx_markdown_tables >=0.0.16
sphinxcontrib-mermaid *

requirements/test.txt pypi

allure-pytest * test
coverage * test
pynvml * test
pytest * test
pyyaml * test

.github/workflows/cuda12.8-whl-release.yml actions

actions/checkout v3 composite
actions/download-artifact v4 composite
actions/setup-python v4 composite
actions/upload-artifact v4 composite
jlumbroso/free-disk-space main composite
softprops/action-gh-release v1 composite

.github/workflows/test_docker.yml actions

MaxymVlasov/dive-action v1.5.0 composite
actions/checkout v3 composite
docker/setup-buildx-action v3 composite
jlumbroso/free-disk-space main composite

.github/workflows/api_eval.yml actions

actions/checkout v2 composite
actions/checkout v3 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite
jlumbroso/free-disk-space main composite

.github/workflows/daily_ete_test_3090.yml actions

actions/checkout v2 composite
actions/checkout v3 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite
jlumbroso/free-disk-space main composite

.github/workflows/daily_ete_test_h800.yml actions

actions/checkout v2 composite
actions/checkout v3 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite
jlumbroso/free-disk-space main composite

.github/workflows/evaluate_h800.yml actions

actions/checkout v3 composite
actions/checkout v2 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite

requirements_ascend.txt pypi

.github/workflows/stable.yml actions

actions/checkout v3 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite

requirements_maca.txt pypi

requirements_rocm.txt pypi

.github/workflows/api_eval_h800.yml actions

actions/checkout v3 composite
actions/checkout v2 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite

.github/workflows/daily_ete_test_5080.yml actions

actions/checkout v2 composite
actions/checkout v3 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite
jlumbroso/free-disk-space main composite

.github/workflows/evaluate.yml actions

actions/checkout v2 composite
actions/checkout v3 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite
jlumbroso/free-disk-space main composite

.github/workflows/evaluate_remote.yml actions

actions/checkout v2 composite
actions/checkout v3 composite
actions/download-artifact v4 composite
actions/setup-python v4 composite
actions/upload-artifact v4 composite
nick-fields/retry v3 composite

requirements_camb.txt pypi

requirements_cuda.txt pypi

.github/workflows/benchmark.yml actions

actions/checkout v2 composite
actions/checkout v3 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite
jlumbroso/free-disk-space main composite

.github/workflows/daily_ete_test.yml actions

actions/checkout v2 composite
actions/checkout v3 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite
jlumbroso/free-disk-space main composite

.github/workflows/pr_ete_test.yml actions

actions/checkout v2 composite

.github/workflows/unit-test.yml actions

actions/checkout v5 composite

pyproject.toml pypi

ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Summary