awesome-llama: https://github.com/alibaba/Megatron-LLaMA
deepspeed distributed-training llama llm megatron-lm pretraining pytorch
Score: 10.749269979519667
Last synced: about 15 hours ago
JSON representation
Repository metadata:
Best practice for training LLaMA models in Megatron-LM
- Host: GitHub
- URL: https://github.com/alibaba/Megatron-LLaMA
- Owner: alibaba
- License: other
- Fork: true (NVIDIA/Megatron-LM)
- Created: 2023-09-01T02:32:25.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2024-01-02T14:28:21.000Z (about 2 years ago)
- Last Synced: 2026-01-23T09:04:22.390Z (17 days ago)
- Topics: deepspeed, distributed-training, llama, llm, megatron-lm, pretraining, pytorch
- Language: Python
- Homepage:
- Size: 4.18 MB
- Stars: 664
- Watchers: 6
- Forks: 57
- Open Issues: 42
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Owner metadata:
- Name: Alibaba
- Login: alibaba
- Email:
- Kind: organization
- Description: Alibaba Open Source
- Website: https://opensource.alibaba.com/
- Location: Hangzhou, China
- Twitter:
- Company:
- Icon url: https://avatars.githubusercontent.com/u/1961952?v=4
- Repositories: 420
- Last Synced at: 2024-05-21T04:56:07.141Z
- Profile URL: https://github.com/alibaba
GitHub Events
Total
- Fork event: 9
- Issue comment event: 5
- Issues event: 3
- Watch event: 52
- Total: 69
Last Year
- Fork event: 1
- Issue comment event: 5
- Issues event: 1
- Watch event: 29
- Total: 36
Committers metadata
Last synced: 10 days ago
Total Commits: 1,390
Total Committers: 66
Avg Commits per committer: 21.061
Development Distribution Score (DDS): 0.82
Commits in past year: 0
Committers in past year: 0
Avg Commits per committer in past year: 0.0
Development Distribution Score (DDS) in past year: 0.0
| Name | Commits | |
|---|---|---|
| mohammad | m****i@n****m | 250 |
| Lawrence McAfee | l****e@n****m | 181 |
| Neel Kant | n****t@n****m | 139 |
| Jared Casper | j****r@n****m | 131 |
| Vijay Korthikanti | v****i@n****m | 107 |
| Mostofa Patwary | m****y@g****m | 83 |
| zihanl | z****l@n****m | 75 |
| rprenger | r****r@n****m | 72 |
| Deepak Narayanan | d****n@n****m | 61 |
| Mostofa Patwary | m****y@n****m | 42 |
| Maanu Grover | m****g@n****m | 25 |
| Raul Puri | r****p@n****m | 24 |
| shanmugamr | s****r@n****m | 23 |
| Boris Fomitchev | b****v@n****m | 19 |
| Evelina Bakhturina | e****a@n****m | 16 |
| Sangkug Lym | s****m@n****m | 16 |
| Steven Steinke | s****e@n****m | 10 |
| liyidong.lyd | l****d@a****m | 8 |
| Peng Xu | p****x@n****m | 8 |
| Abhinav Khattar | a****7@g****m | 7 |
| John Kamalu | j****u@n****m | 6 |
| Jimmy Zhang | j****z@n****m | 6 |
| MaximumEntropy | s****1@u****a | 6 |
| eharper | e****r@n****m | 5 |
| hyunwoongko | g****2@n****m | 5 |
| Stas Bekman | s****0 | 4 |
| Satpal Singh Rathore | s****e@g****m | 4 |
| Raul Puri | r****c@b****u | 4 |
| Rewon Child | r****d@n****m | 4 |
| Kirthi Shankar Sivamani | s****r@g****m | 3 |
| and 36 more... | ||
Issue and Pull Request metadata
Last synced: 5 months ago
Total issues: 63
Total pull requests: 5
Average time to close issues: 16 days
Average time to close pull requests: 2 days
Total issue authors: 40
Total pull request authors: 3
Average comments per issue: 2.76
Average comments per pull request: 2.0
Merged pull request: 3
Bot issues: 0
Bot pull requests: 0
Past year issues: 2
Past year pull requests: 0
Past year average time to close issues: 6 months
Past year average time to close pull requests: N/A
Past year issue authors: 2
Past year pull request authors: 0
Past year average comments per issue: 0.0
Past year average comments per pull request: 0
Past year merged pull request: 0
Past year bot issues: 0
Past year bot pull requests: 0
Top Issue Authors
- 13416157913 (12)
- Double-bear (3)
- jingjie01ai (3)
- chivychao (2)
- EthanChen1234 (2)
- Baibaifan (2)
- yuanzhoulvpi2017 (2)
- yinzhijian (2)
- yuzhiguo07 (2)
- xealml (1)
- Richie-yan (1)
- iMountTai (1)
- YuanLiuuuuuu (1)
- donghucey (1)
- YaboSun (1)
Top Pull Request Authors
- 13416157913 (2)
- li-yi-dong (2)
- qyccc (1)