lightllm

deep-learning gpt llama llm model-serving nlp openai-triton

Score: -Infinity

Last synced: 1 day ago
JSON representation

Repository metadata:

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

Host: GitHub
URL: https://github.com/ModelTC/lightllm
Owner: ModelTC
License: apache-2.0
Created: 2023-07-22T08:11:15.000Z (about 3 years ago)
Default Branch: main
Last Pushed: 2026-10-13T07:08:18.000Z (6 days ago)
Last Synced: 2026-10-13T07:27:29.166Z (6 days ago)
Topics: deep-learning, gpt, llama, llm, model-serving, nlp, openai-triton
Language: Python
Homepage:
Size: 81.1 MB
Stars: 4,319
Watchers: 33
Forks: 371
Open Issues: 172
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE

Owner metadata:

Name: ModelTC
Login: ModelTC
Email:
Kind: organization
Description: https://light-ai.top/
Website:
Location:
Twitter:
Company:
Icon url: https://avatars.githubusercontent.com/u/69665675?v=4
Repositories: 8
Last Synced at: 2026-10-17T11:35:18.837Z
Profile URL: https://github.com/ModelTC

GitHub Events

Total

Create event: 188
Delete event: 134
Fork event: 23
Issue comment event: 81
Issues event: 15
Pull request event: 182
Pull request review comment event: 309
Pull request review event: 131
Push event: 1573
Watch event: 277
Total: 2913

Last Year

Create event: 145
Delete event: 96
Fork event: 16
Issue comment event: 61
Issues event: 11
Pull request event: 103
Pull request review comment event: 211
Pull request review event: 81
Push event: 1208
Watch event: 134
Total: 2066

Committers metadata

Last synced: 2 days ago

Total Commits: 995
Total Committers: 56
Avg Commits per committer: 17.768
Development Distribution Score (DDS): 0.674

Commits in past year: 314
Committers in past year: 26
Avg Commits per committer in past year: 12.077
Development Distribution Score (DDS) in past year: 0.723

Name	Email	Commits
hiworldwzj	3****j	324
shihaobai	4****i	233
sufubao	4****o	88
blueswhen	g**l@1**m	62
sangchengmeng	1****C	55
wanzihao	1**0@q**m	55
FlyingFlame	c**i@s**m	26
XHPlus	x**s@1**m	13
LiangLiu	1**4@q**m	10
llehtahw	q**w@g**m	10
Wu SiYu	w**u@h**m	9
wxd000000	8**6@q**m	8
wangzaijun	w**n@s**m	8
Yang Yong	y**0@1**m	7
fubaosu	4****u	7
Chielo	C**e@Y**m	7
fuheaven	4****n	6
baishihao	b**o@s**m	5
Weichao Luo	l**6@h**m	5
and_gate	3****o	5
Yunqian Fan	p**f@f**m	4
black_eleven	6**7@q**m	3
Xintong Zhao	O**2@g**m	3
Parinay Kapoor	9****R	2
Sarah Salah	1****h	2
Tracin	9**1@q**m	2
andy-yang-1	a**g@s**n	2
R0CKSTAR	x**e@m**m	2
Leoy	l**s@o**m	2
wangzhihong	s**2@1**m	2
and 26 more...

Issue and Pull Request metadata

Last synced: 2 days ago

Total issues: 170
Total pull requests: 1,512
Average time to close issues: 11 days
Average time to close pull requests: 8 days
Total issue authors: 127
Total pull request authors: 74
Average comments per issue: 2.72
Average comments per pull request: 0.14
Merged pull request: 1,048
Bot issues: 0
Bot pull requests: 0

Past year issues: 22
Past year pull requests: 389
Past year average time to close issues: about 2 months
Past year average time to close pull requests: 9 days
Past year issue authors: 14
Past year pull request authors: 42
Past year average comments per issue: 0.59
Past year average comments per pull request: 0.37
Past year merged pull request: 197
Past year bot issues: 0
Past year bot pull requests: 0

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/ModelTC/lightllm

Top Issue Authors

yyymk (6)
harvinyou (5)
leiwen83 (4)
hiworldwzj (3)
302178 (3)
tonylin52 (3)
ChristineSeven (3)
JINO-ROHIT (2)
MisterBrookT (2)
HuaYZhao (2)
bingo787 (2)
xiabo0816 (2)
Zhang-star-master (2)
JPengLi (2)
xxm1668 (2)

Top Pull Request Authors

hiworldwzj (370)
shihaobai (326)
sufubao (194)
SangChengC (132)
blueswhen (88)
WANDY666 (80)
flyinglandlord (47)
fubaosu (31)
WuSiYu (21)
XHPlus (16)
kingder (16)
theNiemand (14)
wxd000000 (13)
helloyongyang (13)
zhhangBian (10)

Top Issue Labels

bug (66)
enhancement (6)
help wanted (1)
documentation (1)
dependencies (1)

Top Pull Request Labels

bug (2)

Package metadata

Total packages: 2
Total downloads: unknown
Total dependent packages: 0 (may contain duplicates)
Total dependent repositories: 0 (may contain duplicates)
Total versions: 8

proxy.golang.org: github.com/modeltc/lightllm

Homepage:
Documentation: https://pkg.go.dev/github.com/modeltc/lightllm#section-documentation
Licenses: apache-2.0
Latest release: v1.2.0 (published 2 months ago)
Last Synced: 2026-10-17T08:02:50.744Z (2 days ago)
Versions: 4
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent packages count: 5.73%
- Average: 5.923%
- Dependent repos count: 6.115%

proxy.golang.org: github.com/ModelTC/lightllm

Homepage:
Documentation: https://pkg.go.dev/github.com/ModelTC/lightllm#section-documentation
Licenses: apache-2.0
Latest release: v1.2.0 (published 2 months ago)
Last Synced: 2026-10-17T08:02:51.188Z (2 days ago)
Versions: 4
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent packages count: 5.73%
- Average: 5.923%
- Dependent repos count: 6.115%

Dependencies

.github/workflows/docker-publish.yml actions

actions/checkout v3 composite
docker/build-push-action ac9327eae2b366085ac7f6a2d02df8aa8ead720a composite
docker/login-action 28218f9b04b4f3f62068d7b6ce6ca5b26e35336c composite
docker/metadata-action 98669ae865ea3cffbcbaa878cf57c20bbf1c6c38 composite
docker/setup-buildx-action 79abd3f86f79a9d68a23c75a09a9a85889262adf composite
sigstore/cosign-installer 6e04d228eb30da1757ee4e1dd75a0ec73a653e06 composite

requirements.txt pypi

Brotli ==1.0.9
Jinja2 ==3.1.2
MarkupSafe ==2.1.3
PySocks ==1.7.1
PyYAML ==6.0.1
anyio ==3.7.1
boltons ==23.0.0
boto3 ==1.28.7
botocore ==1.31.7
certifi ==2023.5.7
cffi ==1.15.1
charset-normalizer ==3.2.0
click ==8.1.6
cmake ==3.27.0
colorama ==0.4.6
coloredlogs ==15.0.1
cryptography ==41.0.2
einops ==0.6.0
environs ==9.5.0
exceptiongroup ==1.1.2
fastapi ==0.89.1
filelock ==3.12.2
fsspec ==2023.6.0
gmpy2 ==2.1.2
h11 ==0.14.0
huggingface-hub ==0.16.4
humanfriendly ==10.0
humanize ==4.7.0
idna ==3.4
jmespath ==1.0.1
jsonpatch ==1.32
jsonpointer ==2.0
marshmallow ==3.19.0
mpmath ==1.3.0
multiprocessing-logging ==0.3.4
networkx ==3.1
ninja ==1.11.1
numpy ==1.25.1
packaging ==23.1
pip ==23.0.1
pluggy ==1.2.0
plumbum ==1.8.2
protobuf ==4.22.3
pyOpenSSL ==23.2.0
pycparser ==2.21
pydantic ==1.10.11
python-dateutil ==2.8.2
python-dotenv ==1.0.0
pyzmq ==25.1.1b2
regex ==2023.6.3
requests ==2.31.0
rpyc ==5.3.1
ruamel.yaml ==0.17.32
ruamel.yaml.clib ==0.2.7
s3transfer ==0.6.1
safetensors ==0.3.1
sentencepiece ==0.1.99
setuptools ==65.6.3
six ==1.16.0
sniffio ==1.3.0
starlette ==0.22.0
sympy ==1.12
tokenizers ==0.13.3
toolz ==0.12.0
torch ==2.0.0
tqdm ==4.65.0
transformers ==4.29.2
triton ==2.1.0
typing_extensions ==4.7.1
urllib3 ==1.26.16
uvicorn ==0.19.0
uvloop ==0.17.0
wheel ==0.40.0
zstandard ==0.19.0

setup.py pypi

einops *
ninja *
packaging *
pyzmq *
rpyc *
safetensors *
torch *
transformers *
triton ==2.0.0.dev20221202
uvloop *

.github/workflows/pre-commit.yml actions

actions/checkout v2 composite
actions/setup-python v2 composite

docker/Dockerfile docker

nvidia/cuda ${CUDA_VERSION}-cudnn-devel-ubuntu22.04 build

docs/CN/requirements-docs.txt pypi

myst-parser ==2.0.0
numpy *
openai *
pydantic *
sphinx ==6.2.1
sphinx-argparse *
sphinx-book-theme ==1.0.1
sphinx-copybutton ==0.5.2
sphinxcontrib.openapi *
sphinxcontrib.redoc *

docs/EN/requirements-docs.txt pypi

myst-parser ==2.0.0
numpy *
openai *
pydantic *
sphinx ==6.2.1
sphinx-argparse *
sphinx-book-theme ==1.0.1
sphinx-copybutton ==0.5.2
sphinxcontrib.openapi *
sphinxcontrib.redoc *

test/acc/bfcl/requirements.txt pypi

aiohttp >=3.8.0 test
huggingface_hub >=0.20.0 test
numpy >=1.21.0 test
openai >=1.0.0 test
tqdm >=4.64.0 test
transformers >=4.30.0 test

ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Summary