awesome-llama: https://github.com/AI-Hypercomputer/JetStream
gemma gpt gpu inference jax large-language-models llama llama2 llm llm-inference llmops mlops model-serving pytorch tpu transformer
Score: 9.699043078654402
Last synced: about 9 hours ago
JSON representation
Repository metadata:
JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).
- Host: GitHub
- URL: https://github.com/AI-Hypercomputer/JetStream
- Owner: AI-Hypercomputer
- License: apache-2.0
- Created: 2024-03-01T00:24:07.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2026-01-05T17:51:16.000Z (about 1 month ago)
- Last Synced: 2026-01-29T10:25:14.427Z (9 days ago)
- Topics: gemma, gpt, gpu, inference, jax, large-language-models, llama, llama2, llm, llm-inference, llmops, mlops, model-serving, pytorch, tpu, transformer
- Language: Python
- Homepage:
- Size: 6.33 MB
- Stars: 403
- Watchers: 21
- Forks: 58
- Open Issues: 26
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Codeowners: .github/CODEOWNERS
- Authors: AUTHORS
Owner metadata:
- Name: AI-Hypercomputer
- Login: AI-Hypercomputer
- Email:
- Kind: organization
- Description: Reference implementations, benchmarks, recipes, and all things AI Hypercomputer
- Website: https://cloud.google.com/solutions/ai-hypercomputer#ai-hypercomputer
- Location:
- Twitter:
- Company:
- Icon url: https://avatars.githubusercontent.com/u/181000646?v=4
- Repositories: 1
- Last Synced at: 2024-09-25T00:50:38.797Z
- Profile URL: https://github.com/AI-Hypercomputer
GitHub Events
Total
- Commit comment event: 2
- Create event: 128
- Delete event: 81
- Fork event: 20
- Issue comment event: 77
- Issues event: 18
- Member event: 23
- Pull request event: 218
- Pull request review comment event: 104
- Pull request review event: 225
- Push event: 663
- Watch event: 159
- Total: 1718
Last Year
- Commit comment event: 2
- Create event: 96
- Delete event: 61
- Fork event: 13
- Issue comment event: 52
- Issues event: 2
- Member event: 9
- Pull request event: 168
- Pull request review comment event: 91
- Pull request review event: 185
- Push event: 456
- Watch event: 100
- Total: 1235
Committers metadata
Last synced: 4 days ago
Total Commits: 232
Total Committers: 38
Avg Commits per committer: 6.105
Development Distribution Score (DDS): 0.815
Commits in past year: 93
Committers in past year: 20
Avg Commits per committer in past year: 4.65
Development Distribution Score (DDS) in past year: 0.839
| Name | Commits | |
|---|---|---|
| Zijun Zhou | z****u@g****m | 43 |
| Fanhai Lu | 1****1 | 19 |
| Yong Xia | y****x@g****m | 15 |
| Brendan Slabe | s****e@g****m | 12 |
| Vipan Nalla | 3****a | 12 |
| Yuyan Peng | y****g@g****m | 11 |
| Morgan Du | m****u@g****m | 9 |
| Yijia | j****4@g****m | 9 |
| Lumosis | 3****s | 9 |
| Vijaya | m****h@g****m | 8 |
| wyzhang | w****g@g****m | 8 |
| Zhihao Shan | 6****e | 7 |
| jetstream authors | n****y@g****m | 7 |
| Aman Gupta | 4****0 | 6 |
| dependabot[bot] | 4****] | 6 |
| Yijia Jin | y****j@g****m | 6 |
| vivianrwu | v****u@g****m | 5 |
| Bhavya Bahl | b****l@g****m | 4 |
| bzgoogle | b****z@g****m | 4 |
| jwyang-google | 1****e | 4 |
| Andy Ye | a****3@g****m | 3 |
| Lance Wang | l****g@g****m | 3 |
| deqiangc | 8****c | 3 |
| qihqi | h****q@g****m | 3 |
| Pate Motter | p****@t****m | 2 |
| wenxindongwork | w****g@g****m | 2 |
| sixiang-google | s****g@g****m | 1 |
| singh-mitali | m****h@g****m | 1 |
| gpolovets1 | g****s@g****m | 1 |
| fenghuizhang | 1****g | 1 |
| and 8 more... | ||
Issue and Pull Request metadata
Last synced: 26 days ago
Total issues: 14
Total pull requests: 236
Average time to close issues: 16 days
Average time to close pull requests: 2 days
Total issue authors: 6
Total pull request authors: 29
Average comments per issue: 0.07
Average comments per pull request: 0.59
Merged pull request: 173
Bot issues: 0
Bot pull requests: 2
Past year issues: 2
Past year pull requests: 222
Past year average time to close issues: N/A
Past year average time to close pull requests: 2 days
Past year issue authors: 2
Past year pull request authors: 26
Past year average comments per issue: 0.0
Past year average comments per pull request: 0.53
Past year merged pull request: 162
Past year bot issues: 0
Past year bot pull requests: 2
Top Issue Authors
- barbaryyazd09133545880 (8)
- salaki (2)
- samos123 (1)
- ChewKokWah (1)
- JeffLuoo (1)
- peregilk (1)
Top Pull Request Authors
- xy12181 (35)
- jyj0w0 (26)
- yuyanpeng-google (24)
- Lumosis (19)
- wyzhang (15)
- vipannalla (15)
- mailvijayasingh (14)
- deqiangc (12)
- aman2930 (10)
- bzgoogle (9)
- wang2yn84 (9)
- wenxindongwork (6)
- sixiang-google (4)
- zhihaoshan-google (4)
- karan (4)
Top Issue Labels
Top Pull Request Labels
- pull ready (59)
- dependencies (2)
- python (2)
Dependencies
- absl-py *
- flax *
- grpcio *
- jax *
- jaxlib *
- numpy *
- portpicker *
- seqio *
- absl-py ==1.4.0
- array-record ==0.5.0
- astunparse ==1.6.3
- cachetools ==5.3.2
- certifi ==2024.2.2
- charset-normalizer ==3.3.2
- chex ==0.1.7
- click ==8.1.7
- clu ==0.0.10
- contextlib2 ==21.6.0
- dm-tree ==0.1.8
- docstring-parser ==0.15
- editdistance ==0.6.2
- etils ==1.6.0
- flatbuffers ==23.5.26
- flax ==0.8.0
- fsspec ==2023.12.2
- gast ==0.4.0
- google-auth ==2.27.0
- google-auth-oauthlib ==1.0.0
- google-pasta ==0.2.0
- googleapis-common-protos ==1.62.0
- grpcio ==1.60.1
- h5py ==3.10.0
- idna ==3.6
- importlib-resources ==6.1.1
- jax ==0.4.23
- jaxlib ==0.4.23
- keras ==2.13.1
- libclang ==16.0.6
- markdown ==3.5.2
- markdown-it-py ==3.0.0
- markupsafe ==2.1.5
- mdurl ==0.1.2
- ml-collections ==0.1.1
- ml-dtypes ==0.3.2
- msgpack ==1.0.7
- nest-asyncio ==1.6.0
- numpy ==1.23.1
- oauthlib ==3.2.2
- opt-einsum ==3.3.0
- optax ==0.1.8
- orbax-checkpoint ==0.5.2
- packaging ==23.2
- portpicker ==1.6.0
- promise ==2.3
- protobuf ==3.20.3
- psutil ==5.9.8
- pyasn1 ==0.5.1
- pyasn1-modules ==0.3.0
- pyglove ==0.4.4
- pygments ==2.17.2
- pyyaml ==6.0.1
- requests ==2.31.0
- requests-oauthlib ==1.3.1
- rich ==13.7.0
- rsa ==4.9
- scipy ==1.12.0
- sentencepiece ==0.1.99
- seqio ==0.0.19
- six ==1.16.0
- tensorboard ==2.13.0
- tensorboard-data-server ==0.7.2
- tensorflow ==2.13.1
- tensorflow-estimator ==2.13.0
- tensorflow-hub ==0.16.1
- tensorflow-io-gcs-filesystem ==0.35.0
- tensorflow-metadata ==1.14.0
- tensorflow-text ==2.13.0
- tensorstore ==0.1.52
- termcolor ==2.4.0
- tf-keras ==2.15.0
- tfds-nightly ==4.9.2.dev202308090034
- toml ==0.10.2
- toolz ==0.12.1
- tqdm ==4.66.1
- typing-extensions ==4.5.0
- urllib3 ==2.2.0
- werkzeug ==3.0.1
- wheel ==0.42.0
- wrapt ==1.16.0
- zipp ==3.17.0
- evaluate *
- nltk *
- rouge-score *
- actions/checkout v4 composite
- actions/github-script v6 composite
- actions/setup-python v4 composite
- pypa/gh-action-pypi-publish release/v1 composite
- actions/checkout v4 composite
- actions/setup-python v4 composite