awesome-llama: https://github.com/vectorch-ai/ScaleLLM

cuda efficiency gpu inference llama llama3 llm llm-inference model performance production serving speculative transformer

Score: 12.645127256631893

Last synced: about 11 hours ago
JSON representation

Repository metadata:

A high-performance inference system for large language models, designed for production environments.

• Host: GitHub
• URL: https://github.com/vectorch-ai/ScaleLLM
• Owner: vectorch-ai
• License: apache-2.0
• Archived: true
• Created: 2023-07-24T20:14:28.000Z (about 3 years ago)
• Default Branch: main
• Last Pushed: 2025-12-19T04:19:34.000Z (8 months ago)
• Last Synced: 2026-08-05T20:57:35.763Z (8 days ago)
• Topics: cuda, efficiency, gpu, inference, llama, llama3, llm, llm-inference, model, performance, production, serving, speculative, transformer
• Language: C++
• Homepage: https://docs.vectorch.com/
• Size: 19.8 MB
• Stars: 500
• Watchers: 17
• Forks: 41
• Open Issues: 56
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE

---

Owner metadata:

• Name: vectorch-ai
• Login: vectorch-ai
• Email:
• Kind: organization
• Description:
• Website:
• Location:
• Twitter:
• Company:
• Icon url: https://avatars.githubusercontent.com/u/136120791?v=4
• Repositories: 1
• Last Synced at: 2023-07-24T21:41:44.702Z
• Profile URL: https://github.com/vectorch-ai

---

GitHub Events

Total

• Create event: 123
• Delete event: 100
• Fork event: 10
• Issue comment event: 4
• Issues event: 18
• Pull request event: 233
• Pull request review event: 4
• Push event: 424
• Release event: 4
• Watch event: 85
• Total: 1005

Last Year

• Create event: 4
• Delete event: 7
• Fork event: 1
• Pull request event: 7
• Push event: 33
• Release event: 1
• Watch event: 15
• Total: 68

---

Committers metadata

Last synced: 1 day ago

Name	Email	Commits
Michael Mi	g****i@g****m	743
Tongxuan Liu	t****x@m****n	22
Xiao Liang	s****n@g****m	4
xianzhedong	8****e	1
panhengyu	4****5	1
Kevin Li	k****5@g****m	1

---

Issue and Pull Request metadata

Last synced: 6 months ago

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/vectorch-ai/ScaleLLM

---

---

---

Package metadata

• Total packages: 1
• Total downloads:
  • pypi: 92 last-month
• Total dependent packages: 0
• Total dependent repositories: 0
• Total versions: 19
• Total maintainers: 1

---

Dependencies