awesome-llama: https://github.com/aws-samples/foundation-model-benchmarking-tool
bedrock benchmark benchmarking deepseek deepseek-r1 evaluation-metrics foundation-models g5 g6 g6e generative-ai inferentia llama2 llama3 p4d p5 sagemaker trainium
Score: -Infinity
Last synced: about 7 hours ago
JSON representation
Repository metadata:
Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stack options.
- Host: GitHub
- URL: https://github.com/aws-samples/foundation-model-benchmarking-tool
- Owner: aws-samples
- License: mit-0
- Created: 2024-01-09T20:52:34.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2025-04-11T15:02:22.000Z (about 1 year ago)
- Last Synced: 2026-05-18T08:36:37.708Z (about 1 month ago)
- Topics: bedrock, benchmark, benchmarking, deepseek, deepseek-r1, evaluation-metrics, foundation-models, g5, g6, g6e, generative-ai, inferentia, llama2, llama3, p4d, p5, sagemaker, trainium
- Language: Jupyter Notebook
- Homepage: https://aws-samples.github.io/foundation-model-benchmarking-tool/
- Size: 95.9 MB
- Stars: 256
- Watchers: 7
- Forks: 44
- Open Issues: 52
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md
- Citation: CITATION.cff
Owner metadata:
- Name: AWS Samples
- Login: aws-samples
- Email:
- Kind: organization
- Description:
- Website: https://amazon.com/aws
- Location:
- Twitter:
- Company:
- Icon url: https://avatars.githubusercontent.com/u/8931462?v=4
- Repositories: 6789
- Last Synced at: 2025-06-05T08:13:20.294Z
- Profile URL: https://github.com/aws-samples
GitHub Events
Total
- Create event: 25
- Fork event: 16
- Issue comment event: 9
- Issues event: 17
- Pull request event: 111
- Pull request review comment event: 22
- Pull request review event: 71
- Push event: 193
- Release event: 14
- Watch event: 57
- Total: 535
Last Year
- Create event: 2
- Fork event: 3
- Issues event: 1
- Pull request event: 3
- Pull request review event: 2
- Push event: 10
- Release event: 1
- Watch event: 15
- Total: 37
Committers metadata
Last synced: 22 days ago
Total Commits: 1,285
Total Committers: 61
Avg Commits per committer: 21.066
Development Distribution Score (DDS): 0.64
Commits in past year: 0
Committers in past year: 0
Avg Commits per committer in past year: 0.0
Development Distribution Score (DDS) in past year: 0.0
| Name | Commits | |
|---|---|---|
| Madhur Prashant | 1****h | 462 |
| Amit Arora | a****i@a****m | 365 |
| Madhur prashant | M****t@a****m | 109 |
| annn | 4****8 | 109 |
| dheerajoruganty | d****b@g****m | 88 |
| madhur | m****s@g****m | 15 |
| Ubuntu | u****u@i****l | 10 |
| Karanbir Bains | b****b@a****m | 9 |
| Ubuntu | u****u@i****l | 8 |
| Rajesh Ramchander | R****r@g****m | 6 |
| Ubuntu | u****u@i****l | 6 |
| Ubuntu | u****u@i****l | 6 |
| Ubuntu | u****u@i****l | 6 |
| EC2 Default User | e****r@i****l | 5 |
| EC2 Default User | e****r@i****l | 5 |
| Ubuntu | u****u@i****l | 4 |
| Ubuntu | u****u@i****l | 4 |
| EC2 Default User | e****r@i****l | 4 |
| Jim Burtoft | 3****t | 3 |
| Ubuntu | u****u@i****l | 3 |
| Ubuntu | u****u@i****l | 3 |
| Ubuntu | u****u@i****l | 3 |
| Ubuntu | u****u@i****l | 2 |
| Ubuntu | u****u@i****l | 2 |
| Ubuntu | u****u@i****l | 2 |
| Ubuntu | u****u@i****l | 2 |
| Ubuntu | u****u@i****l | 2 |
| Ubuntu | u****u@i****l | 2 |
| EC2 Default User | e****r@i****l | 2 |
| EC2 Default User | e****r@i****l | 2 |
| and 31 more... | ||
Issue and Pull Request metadata
Last synced: 10 months ago
Total issues: 58
Total pull requests: 209
Average time to close issues: 21 days
Average time to close pull requests: 2 days
Total issue authors: 16
Total pull request authors: 9
Average comments per issue: 0.34
Average comments per pull request: 0.05
Merged pull request: 173
Bot issues: 0
Bot pull requests: 10
Past year issues: 20
Past year pull requests: 109
Past year average time to close issues: 7 days
Past year average time to close pull requests: 2 days
Past year issue authors: 10
Past year pull request authors: 6
Past year average comments per issue: 0.2
Past year average comments per pull request: 0.09
Past year merged pull request: 95
Past year bot issues: 0
Past year bot pull requests: 0
Top Issue Authors
- madhurprash (27)
- aarora79 (14)
- athewsey (4)
- Yiwen-Zhang (3)
- jimburtoft (3)
- NidPlays (2)
- prasad-nair-amd (2)
- antara678 (2)
- prasadwrites (1)
- wilalbto (1)
- zhimin-z (1)
- dheerajoruganty (1)
- dickren123 (1)
- RajeshRamchander (1)
- lxning (1)
Top Pull Request Authors
- madhurprash (208)
- aarora79 (59)
- dheerajoruganty (48)
- antara678 (39)
- dependabot[bot] (21)
- haozhx23 (4)
- tonyksong (4)
- jimburtoft (4)
- bainskb (3)
- RajeshRamchander (2)
- fespigares (2)
- athewsey (1)
Top Issue Labels
- enhancement (5)
- help wanted (2)
- documentation (1)
- good first issue (1)
- bug (1)
Top Pull Request Labels
- dependencies (21)
Package metadata
- Total packages: 1
- Total downloads: unknown
- Total dependent packages: 0
- Total dependent repositories: 0
- Total versions: 59
proxy.golang.org: github.com/aws-samples/foundation-model-benchmarking-tool
- Homepage:
- Documentation: https://pkg.go.dev/github.com/aws-samples/foundation-model-benchmarking-tool#section-documentation
- Licenses: mit-0
- Latest release: v2.1.6+incompatible (published about 1 year ago)
- Last Synced: 2026-05-07T05:01:40.781Z (about 1 month ago)
- Versions: 59
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent packages count: 5.432%
- Average: 5.615%
- Dependent repos count: 5.797%
Dependencies
- datasets ==2.16.1
- ipywidgets ==8.1.1
- pandas ==2.1.4
- sagemaker ==2.203.0
- seaborn ==0.13.1
- tomark ==0.1.4
- transformers ==4.36.2