awesome-llama: https://github.com/ModelTC/lightllm
deep-learning gpt llama llm model-serving nlp openai-triton
Score: -Infinity
Last synced: about 1 hour ago
JSON representation
Repository metadata:
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
- Host: GitHub
- URL: https://github.com/ModelTC/lightllm
- Owner: ModelTC
- License: apache-2.0
- Created: 2023-07-22T08:11:15.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2026-03-24T15:54:28.000Z (10 days ago)
- Last Synced: 2026-03-25T01:59:38.812Z (9 days ago)
- Topics: deep-learning, gpt, llama, llm, model-serving, nlp, openai-triton
- Language: Python
- Homepage:
- Size: 46.3 MB
- Stars: 3,966
- Watchers: 33
- Forks: 312
- Open Issues: 122
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
Owner metadata:
- Name: ModelTC
- Login: ModelTC
- Email:
- Kind: organization
- Description: Model Infra
- Website:
- Location:
- Twitter:
- Company:
- Icon url: https://avatars.githubusercontent.com/u/69665675?v=4
- Repositories: 8
- Last Synced at: 2023-03-03T20:14:52.752Z
- Profile URL: https://github.com/ModelTC
GitHub Events
Total
- Create event: 111
- Delete event: 81
- Fork event: 13
- Issue comment event: 73
- Issues event: 13
- Pull request event: 147
- Pull request review comment event: 257
- Pull request review event: 112
- Push event: 913
- Watch event: 245
- Total: 1965
Last Year
- Create event: 111
- Delete event: 81
- Fork event: 13
- Issue comment event: 73
- Issues event: 13
- Pull request event: 147
- Pull request review comment event: 257
- Pull request review event: 112
- Push event: 913
- Watch event: 245
- Total: 1965
Committers metadata
Last synced: 4 days ago
Total Commits: 785
Total Committers: 44
Avg Commits per committer: 17.841
Development Distribution Score (DDS): 0.655
Commits in past year: 316
Committers in past year: 19
Avg Commits per committer in past year: 16.632
Development Distribution Score (DDS) in past year: 0.722
| Name | Commits | |
|---|---|---|
| hiworldwzj | 3****j | 271 |
| shihaobai | 4****i | 195 |
| sangchengmeng | 1****C | 55 |
| wanzihao | 1****0@q****m | 39 |
| sufubao | 4****o | 35 |
| blueswhen | g****l@1****m | 34 |
| FlyingFlame | c****i@s****m | 25 |
| XHPlus | x****s@1****m | 13 |
| LiangLiu | 1****4@q****m | 10 |
| llehtahw | q****w@g****m | 10 |
| wxd000000 | 8****6@q****m | 8 |
| Wu SiYu | w****u@h****m | 8 |
| wangzaijun | w****n@s****m | 8 |
| Yang Yong | y****0@1****m | 7 |
| fubaosu | 4****u | 7 |
| fuheaven | 4****n | 6 |
| Chielo | C****e@Y****m | 6 |
| baishihao | b****o@s****m | 5 |
| and_gate | 3****o | 5 |
| Yunqian Fan | p****f@f****m | 4 |
| Weichao Luo | l****6@h****m | 3 |
| black_eleven | 6****7@q****m | 3 |
| Tracin | 9****1@q****m | 2 |
| andy-yang-1 | a****g@s****n | 2 |
| pigKiller | 2****7@b****n | 2 |
| singularity | 1****0 | 2 |
| wangzhihong | s****2@1****m | 2 |
| R0CKSTAR | x****e@m****m | 2 |
| xfplus | x****s@g****m | 1 |
| thecaptain789 | 2****9 | 1 |
| and 14 more... | ||
Issue and Pull Request metadata
Last synced: 2 days ago
Total issues: 149
Total pull requests: 1,184
Average time to close issues: 9 days
Average time to close pull requests: 4 days
Total issue authors: 114
Total pull request authors: 46
Average comments per issue: 2.98
Average comments per pull request: 0.12
Merged pull request: 885
Bot issues: 0
Bot pull requests: 0
Past year issues: 22
Past year pull requests: 462
Past year average time to close issues: 2 days
Past year average time to close pull requests: 3 days
Past year issue authors: 19
Past year pull request authors: 24
Past year average comments per issue: 1.68
Past year average comments per pull request: 0.2
Past year merged pull request: 302
Past year bot issues: 0
Past year bot pull requests: 0
Top Issue Authors
- harvinyou (5)
- leiwen83 (4)
- shihaobai (3)
- tonylin52 (3)
- ChristineSeven (3)
- 302178 (3)
- hiworldwzj (3)
- inkhare (2)
- MisterBrookT (2)
- Lvjinhong (2)
- bingo787 (2)
- HuaYZhao (2)
- Zhang-star-master (2)
- fengenbao (2)
- WANDY666 (2)
Top Pull Request Authors
- hiworldwzj (322)
- shihaobai (288)
- SangChengC (130)
- sufubao (83)
- blueswhen (55)
- WANDY666 (48)
- flyinglandlord (44)
- fubaosu (31)
- WuSiYu (19)
- XHPlus (15)
- helloyongyang (13)
- theNiemand (13)
- wxd000000 (13)
- kingder (12)
- PannenetsF (10)
Top Issue Labels
- bug (53)
- enhancement (6)
- help wanted (1)
- documentation (1)
Top Pull Request Labels
- bug (2)
Package metadata
- Total packages: 2
- Total downloads: unknown
- Total dependent packages: 0 (may contain duplicates)
- Total dependent repositories: 0 (may contain duplicates)
- Total versions: 6
proxy.golang.org: github.com/ModelTC/lightllm
- Homepage:
- Documentation: https://pkg.go.dev/github.com/ModelTC/lightllm#section-documentation
- Licenses: apache-2.0
- Latest release: v1.1.0 (published 7 months ago)
- Last Synced: 2026-03-30T03:02:36.435Z (4 days ago)
- Versions: 3
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent packages count: 5.73%
- Average: 5.923%
- Dependent repos count: 6.115%
proxy.golang.org: github.com/modeltc/lightllm
- Homepage:
- Documentation: https://pkg.go.dev/github.com/modeltc/lightllm#section-documentation
- Licenses: apache-2.0
- Latest release: v1.1.0 (published 7 months ago)
- Last Synced: 2026-03-28T02:02:41.853Z (6 days ago)
- Versions: 3
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent packages count: 5.73%
- Average: 5.923%
- Dependent repos count: 6.115%
Dependencies
- actions/checkout v3 composite
- docker/build-push-action ac9327eae2b366085ac7f6a2d02df8aa8ead720a composite
- docker/login-action 28218f9b04b4f3f62068d7b6ce6ca5b26e35336c composite
- docker/metadata-action 98669ae865ea3cffbcbaa878cf57c20bbf1c6c38 composite
- docker/setup-buildx-action 79abd3f86f79a9d68a23c75a09a9a85889262adf composite
- sigstore/cosign-installer 6e04d228eb30da1757ee4e1dd75a0ec73a653e06 composite
- nvidia/cuda 11.8.0-runtime-ubuntu20.04 build
- Brotli ==1.0.9
- Jinja2 ==3.1.2
- MarkupSafe ==2.1.3
- PySocks ==1.7.1
- PyYAML ==6.0.1
- anyio ==3.7.1
- boltons ==23.0.0
- boto3 ==1.28.7
- botocore ==1.31.7
- certifi ==2023.5.7
- cffi ==1.15.1
- charset-normalizer ==3.2.0
- click ==8.1.6
- cmake ==3.27.0
- colorama ==0.4.6
- coloredlogs ==15.0.1
- cryptography ==41.0.2
- einops ==0.6.0
- environs ==9.5.0
- exceptiongroup ==1.1.2
- fastapi ==0.89.1
- filelock ==3.12.2
- fsspec ==2023.6.0
- gmpy2 ==2.1.2
- h11 ==0.14.0
- huggingface-hub ==0.16.4
- humanfriendly ==10.0
- humanize ==4.7.0
- idna ==3.4
- jmespath ==1.0.1
- jsonpatch ==1.32
- jsonpointer ==2.0
- marshmallow ==3.19.0
- mpmath ==1.3.0
- multiprocessing-logging ==0.3.4
- networkx ==3.1
- ninja ==1.11.1
- numpy ==1.25.1
- packaging ==23.1
- pip ==23.0.1
- pluggy ==1.2.0
- plumbum ==1.8.2
- protobuf ==4.22.3
- pyOpenSSL ==23.2.0
- pycparser ==2.21
- pydantic ==1.10.11
- python-dateutil ==2.8.2
- python-dotenv ==1.0.0
- pyzmq ==25.1.1b2
- regex ==2023.6.3
- requests ==2.31.0
- rpyc ==5.3.1
- ruamel.yaml ==0.17.32
- ruamel.yaml.clib ==0.2.7
- s3transfer ==0.6.1
- safetensors ==0.3.1
- sentencepiece ==0.1.99
- setuptools ==65.6.3
- six ==1.16.0
- sniffio ==1.3.0
- starlette ==0.22.0
- sympy ==1.12
- tokenizers ==0.13.3
- toolz ==0.12.0
- torch ==2.0.0
- tqdm ==4.65.0
- transformers ==4.29.2
- triton ==2.1.0
- typing_extensions ==4.7.1
- urllib3 ==1.26.16
- uvicorn ==0.19.0
- uvloop ==0.17.0
- wheel ==0.40.0
- zstandard ==0.19.0
- einops *
- ninja *
- packaging *
- pyzmq *
- rpyc *
- safetensors *
- torch *
- transformers *
- triton ==2.0.0.dev20221202
- uvloop *