An open API service for producing an overview of a list of open source projects.

awesome-llama: https://github.com/EvilFreelancer/benchmarking-llms

benchmark llama llm mgpt mpt rugpt

Score: 2.4849066497880004

Last synced: about 5 hours ago
JSON representation

Repository metadata:

Comprehensive benchmarks and evaluations of Large Language Models (LLMs) with a focus on hardware usage, generation speed, and memory requirements.


Owner metadata:


GitHub Events

Total
Last Year

Committers metadata

Last synced: 2 days ago

Total Commits: 10
Total Committers: 1
Avg Commits per committer: 10.0
Development Distribution Score (DDS): 0.0

Commits in past year: 0
Committers in past year: 0
Avg Commits per committer in past year: 0.0
Development Distribution Score (DDS) in past year: 0.0

Name Email Commits
Paul Rock p****l@d****s 10

Issue and Pull Request metadata

Last synced: 5 months ago

Total issues: 0
Total pull requests: 0
Average time to close issues: N/A
Average time to close pull requests: N/A
Total issue authors: 0
Total pull request authors: 0
Average comments per issue: 0
Average comments per pull request: 0
Merged pull request: 0
Bot issues: 0
Bot pull requests: 0

Past year issues: 0
Past year pull requests: 0
Past year average time to close issues: N/A
Past year average time to close pull requests: N/A
Past year issue authors: 0
Past year pull request authors: 0
Past year average comments per issue: 0
Past year average comments per pull request: 0
Past year merged pull request: 0
Past year bot issues: 0
Past year bot pull requests: 0

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/EvilFreelancer/benchmarking-llms

Top Issue Authors

Top Pull Request Authors


Top Issue Labels

Top Pull Request Labels


Dependencies

Dockerfile docker
  • nvidia/cuda 11.7.1-devel-ubuntu22.04 build
docker-compose.yml docker
requirements-xl.txt pypi
  • deepspeed ==0.10.0
  • huggingface-hub ==0.16.4
  • numpy ==1.24.2
  • packaging ==23.0
  • pandas ==1.5.3
  • tensorboard ==2.12.0
  • tokenizers ==0.13.3
  • torch ==1.13.1
  • transformers ==4.31.0
  • urllib3 ==1.25.4
requirements.txt pypi
  • accelerate ==0.21.0
  • tokenizers ==0.13.3
  • transformers ==4.31.0
  • xformers ==0.0.20