awesome-llama: https://github.com/vectorch-ai/ScaleLLM

cuda efficiency gpu inference llama llama3 llm llm-inference model performance production serving speculative transformer

Score: 11.746510315701725

Last synced: about 3 hours ago
JSON representation

Repository metadata:

A high-performance inference system for large language models, designed for production environments.

• Host: GitHub
• URL: https://github.com/vectorch-ai/ScaleLLM
• Owner: vectorch-ai
• License: apache-2.0
• Archived: true
• Created: 2023-07-24T20:14:28.000Z (over 3 years ago)
• Default Branch: main
• Last Pushed: 2025-12-19T04:19:34.000Z (10 months ago)
• Last Synced: 2026-10-25T07:14:02.580Z (2 days ago)
• Topics: cuda, efficiency, gpu, inference, llama, llama3, llm, llm-inference, model, performance, production, serving, speculative, transformer
• Language: C++
• Homepage: https://docs.vectorch.com/
• Size: 19.8 MB
• Stars: 498
• Watchers: 17
• Forks: 41
• Open Issues: 56
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE

---

Owner metadata:

• Name: Vectorch AI
• Login: vectorch-ai
• Email: info@vectorch.com
• Kind: organization
• Description: Empowering Teams to Unleash Discoverability
• Website: http://www.vectorch.com
• Location: United States of America
• Twitter:
• Company:
• Icon url: https://avatars.githubusercontent.com/u/136120791?v=4
• Repositories: 19
• Last Synced at: 2026-10-25T07:25:30.754Z
• Profile URL: https://github.com/vectorch-ai

---

GitHub Events

Total

• Create event: 123
• Delete event: 100
• Fork event: 10
• Issue comment event: 4
• Issues event: 18
• Pull request event: 233
• Pull request review event: 4
• Push event: 424
• Release event: 4
• Watch event: 85
• Total: 1005

Last Year

• Fork event: 1
• Push event: 5
• Watch event: 7
• Total: 13

---

Committers metadata

Last synced: 1 day ago

Name	Email	Commits
Michael Mi	g****i@g****m	743
Tongxuan Liu	t****x@m****n	22
Xiao Liang	s****n@g****m	4
xianzhedong	8****e	1
panhengyu	4****5	1
Kevin Li	k****5@g****m	1

---

Issue and Pull Request metadata

Last synced: 1 day ago

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/vectorch-ai/ScaleLLM

---

---

---

Package metadata

• Total packages: 1
• Total downloads:
  • pypi: 37 last-month
• Total dependent packages: 0
• Total dependent repositories: 0
• Total versions: 19
• Total maintainers: 1

---

Dependencies