awesome-llama: https://github.com/Tiiny-AI/PowerInfer
large-language-models llama llm llm-inference local-inference
Score: 15.060010913466279
Last synced: about 19 hours ago
JSON representation
Repository metadata:
High-speed Large Language Model Serving for Local Deployment
- Host: GitHub
- URL: https://github.com/Tiiny-AI/PowerInfer
- Owner: SJTU-IPADS
- License: mit
- Created: 2023-12-15T02:24:10.000Z (about 2 years ago)
- Default Branch: main
- Last Pushed: 2025-08-02T03:36:13.000Z (6 months ago)
- Last Synced: 2026-01-11T16:36:30.262Z (24 days ago)
- Topics: large-language-models, llama, llm, llm-inference, local-inference
- Language: C++
- Homepage:
- Size: 21.7 MB
- Stars: 8,553
- Watchers: 84
- Forks: 470
- Open Issues: 125
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Owner metadata:
- Name: IPADS
- Login: SJTU-IPADS
- Email:
- Kind: organization
- Description: Institute of Parallel and Distributed Systems (IPADS)
- Website: http://ipads.se.sjtu.edu.cn/
- Location: Shanghai, China
- Twitter:
- Company:
- Icon url: https://avatars.githubusercontent.com/u/10797537?v=4
- Repositories: 18
- Last Synced at: 2023-03-01T03:50:23.724Z
- Profile URL: https://github.com/SJTU-IPADS
GitHub Events
Total
- Create event: 4
- Delete event: 1
- Fork event: 51
- Issue comment event: 41
- Issues event: 38
- Member event: 1
- Pull request event: 14
- Pull request review event: 3
- Push event: 9
- Watch event: 540
- Total: 702
Last Year
- Create event: 4
- Delete event: 1
- Fork event: 36
- Issue comment event: 29
- Issues event: 26
- Member event: 1
- Pull request event: 13
- Pull request review event: 3
- Push event: 9
- Watch event: 382
- Total: 504
Committers metadata
Last synced: 19 days ago
Total Commits: 1,587
Total Committers: 400
Avg Commits per committer: 3.968
Development Distribution Score (DDS): 0.747
Commits in past year: 6
Committers in past year: 3
Avg Commits per committer in past year: 2.0
Development Distribution Score (DDS) in past year: 0.333
| Name | Commits | |
|---|---|---|
| Georgi Gerganov | g****v@g****m | 401 |
| slaren | s****h@g****m | 81 |
| Cebtenzzre | c****e@g****m | 60 |
| Johannes Gäßler | j****g@5****e | 59 |
| Kawrakow | 4****w | 49 |
| Holden X | h****x@g****m | 38 |
| Kerfuffle | 4****2 | 38 |
| Stephan Walter | s****n@w****e | 32 |
| Pavol Rusnak | p****l@r****o | 26 |
| Jhen-Jie Hong | i****9@g****m | 23 |
| Howard Su | h****u@g****m | 21 |
| anzz1 | a****1@l****m | 21 |
| Henri Vasserman | h****v@h****e | 19 |
| DannyDaemonic | D****c@g****m | 17 |
| Erik Scholz | G****y | 15 |
| Jeremy Song | y****g@s****n | 13 |
| xaedes | x****s@g****m | 11 |
| Evan Jones | e****s@g****m | 11 |
| M. Yusuf Sarıgöz | y****z@g****m | 11 |
| Shouzheng Liu | l****i@g****m | 10 |
| CRD716 | c****6@g****m | 7 |
| Galunid | k****6@g****m | 7 |
| Ivan Stepanov | i****w@g****m | 7 |
| Jiahao Li | l****7@1****m | 7 |
| comex | c****k@g****m | 7 |
| goerch | j****r@t****e | 7 |
| shibe2 | s****e@t****o | 7 |
| tjohnman | t****n | 7 |
| Eve | 1****e | 6 |
| Matvey Soloviev | b****9@g****m | 6 |
| and 370 more... | ||
Issue and Pull Request metadata
Last synced: 4 months ago
Total issues: 180
Total pull requests: 70
Average time to close issues: 7 days
Average time to close pull requests: 2 days
Total issue authors: 135
Total pull request authors: 20
Average comments per issue: 1.18
Average comments per pull request: 0.17
Merged pull request: 57
Bot issues: 0
Bot pull requests: 0
Past year issues: 36
Past year pull requests: 13
Past year average time to close issues: about 14 hours
Past year average time to close pull requests: 5 days
Past year issue authors: 29
Past year pull request authors: 5
Past year average comments per issue: 0.08
Past year average comments per pull request: 0.0
Past year merged pull request: 8
Past year bot issues: 0
Past year bot pull requests: 0
Top Issue Authors
- hodlen (14)
- YuMJie (6)
- Gengchunsheng (4)
- NerounCstate (3)
- LHQUer (3)
- homosapien-lcy (3)
- Yues007 (3)
- bulaikexiansheng (3)
- kimjoohyungsd (3)
- shmily91 (2)
- wuooo339 (2)
- hua-bang (2)
- onlyone-hyphen (2)
- Irfanmuzni (2)
- czq693497091 (2)
Top Pull Request Authors
- hodlen (31)
- YixinSong-e (11)
- wisman-tccr (6)
- Szy0127 (2)
- AliceRayLu (2)
- KiritoHugh (2)
- ZeyuMi (2)
- Tworan (2)
- 3x0dv5 (1)
- bobozi-cmd (1)
- samehpalas (1)
- mack-w (1)
- eltociear (1)
- tankvpython (1)
- MatthewCroughan (1)
Top Issue Labels
- question (83)
- enhancement (28)
- bug-unconfirmed (14)
- bug (10)
- tracker (7)
- help wanted (6)
- duplicate (3)
- invalid (1)
Top Pull Request Labels
Dependencies
- Jimver/cuda-toolkit v0.2.11 composite
- actions/checkout v1 composite
- actions/checkout v3 composite
- actions/download-artifact v3 composite
- actions/github-script v3 composite
- actions/upload-artifact v3 composite
- anzz1/action-create-release v1 composite
- actions/checkout v3 composite
- codecov/codecov-action v3 composite
- actions/checkout v3 composite
- docker/build-push-action v4 composite
- docker/login-action v2 composite
- docker/setup-buildx-action v2 composite
- docker/setup-qemu-action v2 composite
- actions/checkout v3 composite
- editorconfig-checker/action-editorconfig-checker main composite
- actions/checkout v3 composite
- actions/setup-python v2 composite
- pypa/gh-action-pypi-publish release/v1 composite
- ZedThree/clang-tidy-review/post v0.13.0 composite
- ZedThree/clang-tidy-review v0.13.0 composite
- ZedThree/clang-tidy-review/upload v0.13.0 composite
- actions/checkout v3 composite
- actions/checkout v3 composite
- goto-bus-stop/setup-zig v2 composite
- pytest ^5.2 develop
- numpy >=1.17
- python >=3.8
- cvxopt ==1.3.2
- torch >=2
- numpy >=1.24.4
- sentencepiece >=0.1.98
- transformers >=4.33.2