awesome-llama: https://github.com/Tiiny-AI/PowerInfer
large-language-models llama llm llm-inference local-inference
Score: 15.159732142662257
Last synced: about 21 hours ago
JSON representation
Repository metadata:
High-speed Large Language Model Serving for Local Deployment
- Host: GitHub
- URL: https://github.com/Tiiny-AI/PowerInfer
- Owner: Tiiny-AI
- License: mit
- Created: 2023-12-15T02:24:10.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2026-05-11T06:48:06.000Z (about 1 month ago)
- Last Synced: 2026-05-16T03:34:05.178Z (28 days ago)
- Topics: large-language-models, llama, llm, llm-inference, local-inference
- Language: C++
- Homepage:
- Size: 20 MB
- Stars: 9,458
- Watchers: 102
- Forks: 576
- Open Issues: 130
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Owner metadata:
- Name: Tiiny AI
- Login: Tiiny-AI
- Email: dev@tiiny.ai
- Kind: organization
- Description:
- Website: http://tiiny.ai/
- Location:
- Twitter: TiinyAILab
- Company:
- Icon url: https://avatars.githubusercontent.com/u/256922953?v=4
- Repositories: 1
- Last Synced at: 2026-01-24T17:17:09.977Z
- Profile URL: https://github.com/Tiiny-AI
GitHub Events
Total
- Create event: 2
- Fork event: 16
- Issues event: 1
- Member event: 5
- Pull request review comment event: 3
- Push event: 2
- Watch event: 147
- Total: 176
Last Year
- Create event: 2
- Fork event: 16
- Issues event: 1
- Member event: 5
- Pull request review comment event: 3
- Push event: 2
- Watch event: 147
- Total: 176
Committers metadata
Last synced: 28 days ago
Total Commits: 1,590
Total Committers: 400
Avg Commits per committer: 3.975
Development Distribution Score (DDS): 0.748
Commits in past year: 7
Committers in past year: 3
Avg Commits per committer in past year: 2.333
Development Distribution Score (DDS) in past year: 0.429
| Name | Commits | |
|---|---|---|
| Georgi Gerganov | g****v@g****m | 401 |
| slaren | s****h@g****m | 81 |
| Cebtenzzre | c****e@g****m | 60 |
| Johannes Gäßler | j****g@5****e | 59 |
| Kawrakow | 4****w | 49 |
| Holden X | h****x@g****m | 38 |
| Kerfuffle | 4****2 | 38 |
| Stephan Walter | s****n@w****e | 32 |
| Pavol Rusnak | p****l@r****o | 26 |
| Jhen-Jie Hong | i****9@g****m | 23 |
| Howard Su | h****u@g****m | 21 |
| anzz1 | a****1@l****m | 21 |
| Henri Vasserman | h****v@h****e | 19 |
| DannyDaemonic | D****c@g****m | 17 |
| Erik Scholz | G****y | 15 |
| Jeremy Song | y****g@s****n | 14 |
| xaedes | x****s@g****m | 11 |
| Evan Jones | e****s@g****m | 11 |
| M. Yusuf Sarıgöz | y****z@g****m | 11 |
| Shouzheng Liu | l****i@g****m | 10 |
| CRD716 | c****6@g****m | 7 |
| Galunid | k****6@g****m | 7 |
| Ivan Stepanov | i****w@g****m | 7 |
| Jiahao Li | l****7@1****m | 7 |
| comex | c****k@g****m | 7 |
| goerch | j****r@t****e | 7 |
| shibe2 | s****e@t****o | 7 |
| tjohnman | t****n | 7 |
| Matvey Soloviev | b****9@g****m | 6 |
| Qingyou Meng | m****u@g****m | 6 |
| and 370 more... | ||
Issue and Pull Request metadata
Last synced: about 1 month ago
Total issues: 1
Total pull requests: 2
Average time to close issues: N/A
Average time to close pull requests: 4 minutes
Total issue authors: 1
Total pull request authors: 2
Average comments per issue: 0.0
Average comments per pull request: 0.0
Merged pull request: 1
Bot issues: 0
Bot pull requests: 0
Past year issues: 1
Past year pull requests: 2
Past year average time to close issues: N/A
Past year average time to close pull requests: 4 minutes
Past year issue authors: 1
Past year pull request authors: 2
Past year average comments per issue: 0.0
Past year average comments per pull request: 0.0
Past year merged pull request: 1
Past year bot issues: 0
Past year bot pull requests: 0
Top Issue Authors
- tyoc213 (1)
Top Pull Request Authors
- OpenByteDev (1)
- ZeyuMi (1)
Top Issue Labels
- question (1)
Top Pull Request Labels
Dependencies
- Jimver/cuda-toolkit v0.2.11 composite
- actions/checkout v1 composite
- actions/checkout v3 composite
- actions/download-artifact v3 composite
- actions/github-script v3 composite
- actions/upload-artifact v3 composite
- anzz1/action-create-release v1 composite
- actions/checkout v3 composite
- codecov/codecov-action v3 composite
- actions/checkout v3 composite
- docker/build-push-action v4 composite
- docker/login-action v2 composite
- docker/setup-buildx-action v2 composite
- docker/setup-qemu-action v2 composite
- actions/checkout v3 composite
- editorconfig-checker/action-editorconfig-checker main composite
- actions/checkout v3 composite
- actions/setup-python v2 composite
- pypa/gh-action-pypi-publish release/v1 composite
- ZedThree/clang-tidy-review/post v0.13.0 composite
- ZedThree/clang-tidy-review v0.13.0 composite
- ZedThree/clang-tidy-review/upload v0.13.0 composite
- actions/checkout v3 composite
- actions/checkout v3 composite
- goto-bus-stop/setup-zig v2 composite
- pytest ^5.2 develop
- numpy >=1.17
- python >=3.8
- cvxopt ==1.3.2
- torch >=2
- numpy >=1.24.4
- sentencepiece >=0.1.98
- transformers >=4.33.2