awesome-llama: https://github.com/microsoft/sarathi-serve
llama llm-inference pytorch transformer
Score: 8.556413904569519
Last synced: about 11 hours ago
JSON representation
Repository metadata:
A low-latency & high-throughput serving engine for LLMs
- Host: GitHub
- URL: https://github.com/microsoft/sarathi-serve
- Owner: microsoft
- License: apache-2.0
- Created: 2023-11-02T13:38:16.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2026-01-08T05:10:57.000Z (5 months ago)
- Last Synced: 2026-05-26T09:35:37.278Z (7 days ago)
- Topics: llama, llm-inference, pytorch, transformer
- Language: Python
- Homepage:
- Size: 2.74 MB
- Stars: 504
- Watchers: 7
- Forks: 63
- Open Issues: 16
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md
- Security: SECURITY.md
- Support: SUPPORT.md
Owner metadata:
- Name: Microsoft
- Login: microsoft
- Email: opensource@microsoft.com
- Kind: organization
- Description: Open source projects and samples from Microsoft
- Website: https://opensource.microsoft.com
- Location: Redmond, WA
- Twitter: OpenAtMicrosoft
- Company:
- Icon url: https://avatars.githubusercontent.com/u/6154722?v=4
- Repositories: 7804
- Last Synced at: 2026-05-19T00:57:03.114Z
- Profile URL: https://github.com/microsoft
GitHub Events
Total
- Create event: 1
- Delete event: 1
- Fork event: 31
- Issue comment event: 20
- Issues event: 11
- Member event: 2
- Pull request event: 12
- Pull request review event: 4
- Push event: 1
- Watch event: 188
- Total: 271
Last Year
- Create event: 1
- Delete event: 1
- Fork event: 27
- Issue comment event: 12
- Issues event: 9
- Member event: 2
- Pull request event: 11
- Pull request review event: 4
- Push event: 1
- Watch event: 151
- Total: 219
Committers metadata
Last synced: 7 months ago
Total Commits: 33
Total Committers: 10
Avg Commits per committer: 3.3
Development Distribution Score (DDS): 0.455
Commits in past year: 3
Committers in past year: 3
Avg Commits per committer in past year: 1.0
Development Distribution Score (DDS) in past year: 0.667
| Name | Commits | |
|---|---|---|
| Amey Agrawal | a****2@g****m | 18 |
| Microsoft Open Source | m****e | 5 |
| Nitin Kedia | n****7@g****m | 3 |
| yuhkalhic | 1****c | 1 |
| microsoft-github-operations[bot] | 5****] | 1 |
| Varun Komperla | 1****9 | 1 |
| Mohammed Wazir Adain | m****n@g****m | 1 |
| Kasra Alexander Sohrab | 6****b | 1 |
| Ashish Panwar | 3****c | 1 |
| Anirudha Agrawal | 4****l | 1 |
Issue and Pull Request metadata
Last synced: 7 months ago
Total issues: 28
Total pull requests: 65
Average time to close issues: 7 days
Average time to close pull requests: 2 days
Total issue authors: 24
Total pull request authors: 12
Average comments per issue: 1.43
Average comments per pull request: 0.48
Merged pull request: 42
Bot issues: 2
Bot pull requests: 4
Past year issues: 11
Past year pull requests: 19
Past year average time to close issues: 6 days
Past year average time to close pull requests: 21 days
Past year issue authors: 11
Past year pull request authors: 8
Past year average comments per issue: 0.45
Past year average comments per pull request: 0.79
Past year merged pull request: 1
Past year bot issues: 0
Past year bot pull requests: 4
Top Issue Authors
- Sunt-ing (4)
- microsoft-github-policy-service[bot] (2)
- Hudayday (1)
- amansahu278 (1)
- lambda7xx (1)
- Jaxcong (1)
- zhypku (1)
- irasin (1)
- marwage (1)
- Mrxiangli (1)
- aniketmaurya (1)
- deciding (1)
- JuiceLemonLemon (1)
- yunoJ (1)
- genglinWang (1)
Top Pull Request Authors
- AgrawalAmey (34)
- nitinkedia7 (7)
- kasohrab (6)
- dependabot[bot] (4)
- jadewang21 (2)
- alvi75 (2)
- vmehrotra50 (2)
- kompy99 (2)
- tianhao909 (2)
- yuhkalhic (2)
- MohammedAdain (1)
- apanwariisc (1)
Top Issue Labels
Top Pull Request Labels
- dependencies (4)
- python (4)
Dependencies
- actions/checkout v2 composite
- actions/setup-python v2 composite
- nbdime * development
- pylint ==2.8.2 development
- types-PyYAML * development
- types-requests * development
- types-setuptools * development
- yapf ==0.40.2 development
- ddsketch *
- flashinfer *
- grpcio *
- jupyterlab *
- kaleido *
- matplotlib *
- ninja *
- numpy *
- pandas *
- pillow *
- plotly_express *
- psutil *
- pyarrow *
- ray >=2.5.1
- seaborn *
- sentencepiece *
- tiktoken *
- torch ==2.2.2
- tqdm *
- transformers >=4.37.0
- wandb *