lmdeploy

codellama cuda-kernels deepspeed fastertransformer internlm llama llama2 llama3 llm llm-inference turbomind

Score: 24.70185668080425

Last synced: about 11 hours ago
JSON representation

Repository metadata:

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Host: GitHub
URL: https://github.com/internlm/lmdeploy
Owner: InternLM
License: apache-2.0
Created: 2023-06-15T12:38:06.000Z (over 2 years ago)
Default Branch: main
Last Pushed: 2026-01-05T09:02:54.000Z (about 1 month ago)
Last Synced: 2026-01-06T01:46:49.387Z (29 days ago)
Topics: codellama, cuda-kernels, deepspeed, fastertransformer, internlm, llama, llama2, llama3, llm, llm-inference, turbomind
Language: Python
Homepage: https://lmdeploy.readthedocs.io/en/latest
Size: 10.2 MB
Stars: 7,475
Watchers: 52
Forks: 640
Open Issues: 553
Metadata Files:
- Readme: README.md
- Contributing: .github/CONTRIBUTING.md
- License: LICENSE

Owner metadata:

Name: InternLM
Login: InternLM
Email: internlm@pjlab.org.cn
Kind: organization
Description:
Website: https://internlm.intern-ai.org.cn/
Location: China
Twitter: intern_lm
Company:
Icon url: https://avatars.githubusercontent.com/u/135356492?v=4
Repositories: 16
Last Synced at: 2024-05-06T00:03:26.107Z
Profile URL: https://github.com/InternLM

GitHub Events

Total

Commit comment event: 1
Create event: 28
Delete event: 17
Fork event: 207
Issue comment event: 2502
Issues event: 891
Member event: 1
Pull request event: 1116
Pull request review comment event: 950
Pull request review event: 1698
Push event: 605
Release event: 15
Watch event: 2269
Total: 10300

Last Year

Commit comment event: 1
Create event: 28
Delete event: 17
Fork event: 207
Issue comment event: 2502
Issues event: 891
Member event: 1
Pull request event: 1116
Pull request review comment event: 950
Pull request review event: 1698
Push event: 605
Release event: 15
Watch event: 2269
Total: 10300

Committers metadata

Last synced: about 1 month ago

Total Commits: 1,657
Total Committers: 130
Avg Commits per committer: 12.746
Development Distribution Score (DDS): 0.813

Commits in past year: 599
Committers in past year: 56
Avg Commits per committer in past year: 10.696
Development Distribution Score (DDS) in past year: 0.786

Name	Email	Commits
Lyu Han	l**8@1**m	310
q yao	s**o@l**m	274
AllentDan	4****n	190
Chen Xin	i**c@g**m	162
RunningLeon	m**g@y**t	122
Li Zhang	l**9@g**m	89
zhulinJulia24	1****4	64
zxy	4****y	49
zhyncs	m**e@z**m	40
yaofengchen	6****n	24
tpoisonooo	k**n@a**m	23
jinminxi104	j**4@h**m	20
CyCle1024	c**u@p**n	19
pppppM	6****M	16
windreamer	w**r@g**m	16
zhaochaoxing	1****g	12
Ke Bao	I**e@1**m	11
tangzhiyi11	t****1	11
zhoushenglong	8****u	10
Wei Tao	1**1@q**m	10
WRH	1****i	10
JimyMa	3****a	7
littlegy	7**6@q**m	6
q.yao	y**n@s**m	6
Tsundoku958	w**u@g**m	5
vansin	m**e@1**m	5
del-zhenwu	d**u@g**m	4
liukuikun	2****k	4
whcao	4****h	3
jack	Q****k	3
and 100 more...

Issue and Pull Request metadata

Last synced: about 1 month ago

Total issues: 1,558
Total pull requests: 2,113
Average time to close issues: 18 days
Average time to close pull requests: 9 days
Total issue authors: 834
Total pull request authors: 157
Average comments per issue: 2.71
Average comments per pull request: 1.08
Merged pull request: 1,571
Bot issues: 0
Bot pull requests: 0

Past year issues: 446
Past year pull requests: 835
Past year average time to close issues: 12 days
Past year average time to close pull requests: 6 days
Past year issue authors: 274
Past year pull request authors: 60
Past year average comments per issue: 1.88
Past year average comments per pull request: 0.54
Past year merged pull request: 582
Past year bot issues: 0
Past year bot pull requests: 0

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/internlm/lmdeploy

Top Issue Authors

zhulinJulia24 (62)
zhyncs (30)
josephrocca (19)
maxin9966 (17)
sleepwalker2017 (13)
lmingze (13)
Gierry (12)
pseudotensor (10)
bltcn (10)
Vincent131499 (9)
AllentDan (9)
hitzhu (9)
shell-nlp (9)
WCwalker (8)
zhanghui-china (8)

Top Pull Request Authors

lvhan028 (363)
grimoire (359)
AllentDan (222)
irexyc (190)
RunningLeon (137)
zhulinJulia24 (103)
lzhangzz (93)
CUHKSZzxy (58)
zhyncs (58)
yao-fengchen (42)
jinminxi104 (37)
JackWeiw (35)
CyCle1024 (32)
Reinerzhou (29)
zhaochaoxing (26)

Top Issue Labels

awaiting response (256)
Stale (172)
backlog (15)
improvement (9)
Bug:P1 (6)
mllm (5)
v100 (5)
enhancement (4)
wontfix (4)
planned feature (3)
benchmark (2)
Bug:P2 (2)
documentation (1)
good first issue (1)
RFC (1)
duplicate (1)
BC-breaking (1)

Top Pull Request Labels

improvement (487)
Bug:P1 (379)
enhancement (251)
documentation (83)
Bug:P2 (53)
Bug:P0 (16)
WIP (14)
planned feature (9)
BC-breaking (7)
turbomind (6)
bug (5)
Bug:P3 (5)
awaiting response (3)
Stale (2)

Package metadata

Total packages: 3
Total downloads:
- pypi: 48,172 last-month
Total docker downloads: 3,030
Total dependent packages: 1 (may contain duplicates)
Total dependent repositories: 2 (may contain duplicates)
Total versions: 154
Total maintainers: 1
Total advisories: 3

pypi.org: lmdeploy

A toolset for compressing, deploying and serving LLM

Homepage:
Documentation: https://lmdeploy.readthedocs.io/
Licenses: apache-2.0
Latest release: 0.11.1 (published about 1 month ago)
Last Synced: 2026-01-10T06:01:00.372Z (25 days ago)
Versions: 60
Dependent Packages: 1
Dependent Repositories: 2
Downloads: 48,172 Last month
Docker Downloads: 3,030
Rankings:
- Docker downloads count: 2.036%
- Dependent packages count: 4.778%
- Downloads: 5.516%
- Average: 5.969%
- Dependent repos count: 11.544%
Maintainers (1)
- openmmlab
Advisories:

proxy.golang.org: github.com/InternLM/lmdeploy

Homepage:
Documentation: https://pkg.go.dev/github.com/InternLM/lmdeploy#section-documentation
Licenses: apache-2.0
Latest release: v0.11.1 (published about 1 month ago)
Last Synced: 2026-01-10T06:01:21.820Z (25 days ago)
Versions: 47
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent packages count: 6.528%
- Average: 6.747%
- Dependent repos count: 6.966%

proxy.golang.org: github.com/internlm/lmdeploy

Homepage:
Documentation: https://pkg.go.dev/github.com/internlm/lmdeploy#section-documentation
Licenses: apache-2.0
Latest release: v0.11.1 (published about 1 month ago)
Last Synced: 2026-01-10T06:01:41.775Z (25 days ago)
Versions: 47
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent packages count: 6.528%
- Average: 6.747%
- Dependent repos count: 6.966%

Dependencies

.github/workflows/docker.yml actions

actions/checkout v3 composite

.github/workflows/lint.yml actions

DoozyX/clang-format-lint-action v0.13 composite
actions/checkout v2 composite
actions/setup-python v2 composite
gaurav-nelson/github-action-markdown-link-check v1 composite

.github/workflows/linux-x64-gpu.yml actions

actions/checkout v3 composite

.github/workflows/pypi.yml actions

Jimver/cuda-toolkit v0.2.11 composite
actions/checkout v3 composite
actions/download-artifact v3 composite
actions/setup-python v4 composite
actions/upload-artifact v3 composite

.github/workflows/stale.yml actions

actions/stale v7 composite

.github/workflows/windows-x64-gpu.yml actions

Jimver/cuda-toolkit v0.2.11 composite
actions/checkout v3 composite
actions/setup-python v4 composite

docker/Dockerfile docker

nvcr.io/nvidia/tritonserver 22.12-py3 build

setup.py pypi

requirements/docs.txt pypi

docutils ==0.16.0
m2r ==0.2.1
markdown >=3.4.0
mistune ==0.8.4
myst-parser *
recommonmark *
sphinx ==4.0.2
sphinx-copybutton *
sphinx_markdown_tables >=0.0.16
sphinxcontrib-mermaid *

requirements/test.txt pypi

allure-pytest * test
coverage * test
pynvml * test
pytest * test
pyyaml * test

.github/workflows/cuda12.8-whl-release.yml actions

actions/checkout v3 composite
actions/download-artifact v4 composite
actions/setup-python v4 composite
actions/upload-artifact v4 composite
jlumbroso/free-disk-space main composite
softprops/action-gh-release v1 composite

.github/workflows/test_docker.yml actions

MaxymVlasov/dive-action v1.5.0 composite
actions/checkout v3 composite
docker/setup-buildx-action v3 composite
jlumbroso/free-disk-space main composite

.github/workflows/api_eval.yml actions

actions/checkout v2 composite
actions/checkout v3 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite
jlumbroso/free-disk-space main composite

.github/workflows/daily_ete_test_3090.yml actions

actions/checkout v2 composite
actions/checkout v3 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite
jlumbroso/free-disk-space main composite

.github/workflows/daily_ete_test_h800.yml actions

actions/checkout v2 composite
actions/checkout v3 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite
jlumbroso/free-disk-space main composite

.github/workflows/evaluate_h800.yml actions

actions/checkout v3 composite
actions/checkout v2 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite

requirements_ascend.txt pypi

.github/workflows/stable.yml actions

actions/checkout v3 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite

requirements_maca.txt pypi

requirements_rocm.txt pypi

.github/workflows/api_eval_h800.yml actions

actions/checkout v3 composite
actions/checkout v2 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite

.github/workflows/daily_ete_test_5080.yml actions

actions/checkout v2 composite
actions/checkout v3 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite
jlumbroso/free-disk-space main composite

.github/workflows/evaluate.yml actions

actions/checkout v2 composite
actions/checkout v3 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite
jlumbroso/free-disk-space main composite

.github/workflows/evaluate_remote.yml actions

actions/checkout v2 composite
actions/checkout v3 composite
actions/download-artifact v4 composite
actions/setup-python v4 composite
actions/upload-artifact v4 composite
nick-fields/retry v3 composite

requirements_camb.txt pypi

requirements_cuda.txt pypi

.github/workflows/benchmark.yml actions

actions/checkout v2 composite
actions/checkout v3 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite
jlumbroso/free-disk-space main composite

.github/workflows/daily_ete_test.yml actions

actions/checkout v2 composite
actions/checkout v3 composite
actions/download-artifact v4 composite
actions/upload-artifact v4 composite
jlumbroso/free-disk-space main composite

.github/workflows/pr_ete_test.yml actions

actions/checkout v2 composite

.github/workflows/unit-test.yml actions

actions/checkout v5 composite

pyproject.toml pypi

ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Summary