awesome-llama: https://github.com/AI-Hypercomputer/jetstream-pytorch

attention batching gemma inference llama llama2 llm llm-inference model-serving pytorch tpu

Score: 7.387090235656757

Last synced: about 13 hours ago
JSON representation

Repository metadata:

PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"

• Host: GitHub
• URL: https://github.com/AI-Hypercomputer/jetstream-pytorch
• Owner: AI-Hypercomputer
• License: apache-2.0
• Archived: true
• Created: 2024-04-02T20:27:00.000Z (about 2 years ago)
• Default Branch: main
• Last Pushed: 2025-12-18T06:02:32.000Z (6 months ago)
• Last Synced: 2026-06-03T11:03:39.094Z (14 days ago)
• Topics: attention, batching, gemma, inference, llama, llama2, llm, llm-inference, model-serving, pytorch, tpu
• Language: Python
• Homepage:
• Size: 1.42 MB
• Stars: 82
• Watchers: 7
• Forks: 21
• Open Issues: 13
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE

---

Owner metadata:

• Name: AI-Hypercomputer
• Login: AI-Hypercomputer
• Email:
• Kind: organization
• Description: Reference implementations, benchmarks, recipes, and all things AI Hypercomputer
• Website: https://cloud.google.com/solutions/ai-hypercomputer#ai-hypercomputer
• Location:
• Twitter:
• Company:
• Icon url: https://avatars.githubusercontent.com/u/181000646?v=4
• Repositories: 1
• Last Synced at: 2024-09-25T00:50:38.797Z
• Profile URL: https://github.com/AI-Hypercomputer

---

GitHub Events

Total

• Create event: 9
• Fork event: 4
• Issue comment event: 5
• Issues event: 1
• Member event: 2
• Pull request event: 32
• Pull request review comment event: 11
• Pull request review event: 25
• Push event: 32
• Release event: 1
• Watch event: 35
• Total: 157

Last Year

• Create event: 1
• Fork event: 2
• Member event: 1
• Pull request event: 1
• Pull request review event: 1
• Push event: 1
• Watch event: 13
• Total: 20

---

Committers metadata

Last synced: 4 days ago

Name	Email	Commits
Fanhai Lu	1****1	80
qihqi	h****q@g****m	59
Lance Wang	l****g@g****m	54
Siyuan Liu	l****n@g****m	11
Richard Liu	3****u	8
Bhavya Bahl	b****l@g****m	6
sixiang-google	s****g@g****m	6
Alvaro Moran	6****o	5
Brendan Slabe	b****3@g****m	5
vivianrwu	v****u@g****m	4
Brittany	2****l	3
Zijun Zhou	z****u@g****m	3
Andy Ye	a****3@g****m	1
JackCaoG	5****G	1
Justin Waugh	9****t	1
Sam Shi	y****i@g****m	1
cloudchrischan	c****n@g****m	1

---

Issue and Pull Request metadata

Last synced: 22 days ago

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/AI-Hypercomputer/jetstream-pytorch

---

---

---

Dependencies