awesome-llama: https://github.com/vectorch-ai/ScaleLLM

cuda efficiency gpu inference llama llama3 llm llm-inference model performance production serving speculative transformer

Score: 12.049909942941962

Last synced: about 2 hours ago
JSON representation

Repository metadata:

A high-performance inference system for large language models, designed for production environments.

• Host: GitHub
• URL: https://github.com/vectorch-ai/ScaleLLM
• Owner: vectorch-ai
• License: apache-2.0
• Created: 2023-07-24T20:14:28.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2025-11-03T04:00:01.000Z (3 months ago)
• Last Synced: 2025-11-03T06:05:10.735Z (3 months ago)
• Topics: cuda, efficiency, gpu, inference, llama, llama3, llm, llm-inference, model, performance, production, serving, speculative, transformer
• Language: C++
• Homepage: https://docs.vectorch.com/
• Size: 19.3 MB
• Stars: 481
• Watchers: 16
• Forks: 37
• Open Issues: 57
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE

---

Owner metadata:

• Name: vectorch-ai
• Login: vectorch-ai
• Email:
• Kind: organization
• Description:
• Website:
• Location:
• Twitter:
• Company:
• Icon url: https://avatars.githubusercontent.com/u/136120791?v=4
• Repositories: 1
• Last Synced at: 2023-07-24T21:41:44.702Z
• Profile URL: https://github.com/vectorch-ai

---

GitHub Events

Total

• Create event: 123
• Delete event: 100
• Fork event: 9
• Issue comment event: 4
• Issues event: 18
• Pull request event: 233
• Pull request review event: 4
• Push event: 419
• Release event: 4
• Watch event: 79
• Total: 993

Last Year

• Create event: 120
• Delete event: 98
• Fork event: 9
• Issue comment event: 4
• Issues event: 16
• Pull request event: 230
• Pull request review event: 4
• Push event: 405
• Release event: 3
• Watch event: 76
• Total: 965

---

Committers metadata

Last synced: 3 months ago

Name	Email	Commits
Michael Mi	g****i@g****m	741
Tongxuan Liu	t****x@m****n	22
Xiao Liang	s****n@g****m	4
xianzhedong	8****e	1
panhengyu	4****5	1
Kevin Li	k****5@g****m	1

---

Issue and Pull Request metadata

Last synced: 4 months ago

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/vectorch-ai/ScaleLLM

---

---

---

Package metadata

• Total packages: 1
• Total downloads:
  • pypi: 52 last-month
• Total dependent packages: 0
• Total dependent repositories: 0
• Total versions: 19
• Total maintainers: 1

---

Dependencies