awesome-llama: https://github.com/open-compass/opencompass
benchmark evaluation large-language-model llm llm-eval
Score: 22.33306930815576
Last synced: about 13 hours ago
JSON representation
Repository metadata:
OpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety.
- Host: GitHub
- URL: https://github.com/open-compass/opencompass
- Owner: open-compass
- License: apache-2.0
- Created: 2023-06-15T12:42:58.000Z (over 3 years ago)
- Default Branch: main
- Last Pushed: 2026-10-28T12:12:20.000Z (4 days ago)
- Last Synced: 2026-10-28T17:32:27.420Z (4 days ago)
- Topics: benchmark, evaluation, large-language-model, llm, llm-eval
- Language: Python
- Homepage: https://opencompass.org.cn/
- Size: 7.73 MB
- Stars: 7,554
- Watchers: 29
- Forks: 894
- Open Issues: 334
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Owner metadata:
- Name: OpenCompass
- Login: open-compass
- Email: opencompass@pjlab.org.cn
- Kind: organization
- Description:
- Website: opencompass.org.cn
- Location: China
- Twitter: OpenCompassX
- Company:
- Icon url: https://avatars.githubusercontent.com/u/143521324?v=4
- Repositories: 52
- Last Synced at: 2026-10-24T21:34:11.791Z
- Profile URL: https://github.com/open-compass
GitHub Events
Total
- Create event: 23
- Delete event: 6
- Discussion event: 1
- Fork event: 266
- Issue comment event: 642
- Issues event: 277
- Member event: 4
- Pull request event: 707
- Pull request review comment event: 174
- Pull request review event: 523
- Push event: 337
- Release event: 10
- Watch event: 2126
- Total: 5096
Last Year
- Create event: 3
- Delete event: 1
- Discussion event: 1
- Fork event: 22
- Issue comment event: 20
- Issues event: 20
- Pull request event: 65
- Pull request review comment event: 5
- Pull request review event: 26
- Push event: 78
- Watch event: 220
- Total: 461
Committers metadata
Last synced: 2 days ago
Total Commits: 1,279
Total Committers: 209
Avg Commits per committer: 6.12
Development Distribution Score (DDS): 0.892
Commits in past year: 254
Committers in past year: 63
Avg Commits per committer in past year: 4.032
Development Distribution Score (DDS) in past year: 0.583
| Name | Commits | |
|---|---|---|
| Myhs_phz | d****4@1****m | 138 |
| Fengzhe Zhou | z****7@1****m | 112 |
| Linchen Xiao | x****3@g****m | 110 |
| bittersweet1999 | 1****9 | 82 |
| Songyang Zhang | t****y | 82 |
| Tong Gao | g****o@g****m | 60 |
| zhulinJulia24 | 1****4 | 56 |
| Hubert | 4****u | 56 |
| ssiq | l****e@h****m | 50 |
| liushz | q****5@1****m | 48 |
| Yu Sun | y****p@g****m | 18 |
| Mo Li | 8****i | 18 |
| Junnan Liu | t****n@o****m | 17 |
| Jingming | 1****o | 15 |
| Ma Zerun | m****6@1****m | 15 |
| Dongsheng Zhu | 5****5 | 13 |
| Yuan Liu | 3****u | 12 |
| Xu Song | x****p@g****m | 11 |
| Haodong Duan | d****z@g****m | 11 |
| Lyu Han | l****8@1****m | 10 |
| Alexander Lam | l****o@p****n | 9 |
| klein | z****2@s****n | 8 |
| fly2tomato | x****0@g****m | 8 |
| Yang Yong | y****0@1****m | 8 |
| Kevin Wang | w****3@1****m | 8 |
| Ezra-Yu | 1****u | 8 |
| Connor-Shen | 0****3@g****m | 7 |
| Yike Yuan | 3****w | 7 |
| RunningLeon | m****g@y****t | 6 |
| philipwangOvO | 7****O | 6 |
| and 179 more... | ||
Issue and Pull Request metadata
Last synced: 2 days ago
Total issues: 692
Total pull requests: 1,838
Average time to close issues: 6 months
Average time to close pull requests: 23 days
Total issue authors: 432
Total pull request authors: 270
Average comments per issue: 1.78
Average comments per pull request: 0.33
Merged pull request: 1,343
Bot issues: 1
Bot pull requests: 0
Past year issues: 27
Past year pull requests: 177
Past year average time to close issues: 3 months
Past year average time to close pull requests: 28 days
Past year issue authors: 23
Past year pull request authors: 75
Past year average comments per issue: 0.56
Past year average comments per pull request: 0.27
Past year merged pull request: 93
Past year bot issues: 1
Past year bot pull requests: 0
Top Issue Authors
- GenerallyCovetous (21)
- tonysy (20)
- 13416157913 (16)
- cobraheleah (8)
- Leymore (7)
- linbeyoung (7)
- Sweetclover (6)
- BeyonderXX (6)
- Ezra-Yu (6)
- del-zhenwu (6)
- zhulinJulia24 (6)
- zhimin-z (5)
- SefaZeng (5)
- kkwhale7 (5)
- bullw (5)
Top Pull Request Authors
- MaiziXiao (216)
- bittersweet1999 (163)
- Leymore (155)
- tonysy (112)
- Myhs-phz (94)
- zhulinJulia24 (93)
- liushz (69)
- yingfhu (33)
- jnanliu (31)
- DseidLi (31)
- ssiq (30)
- xu-song (25)
- Zhudongsheng75 (25)
- gaotongxiao (22)
- kleinzcy (20)
Top Issue Labels
- backlog (4)
- Enhancement (4)
- Bug:P0 (2)
- planned feature (2)
- documentation (1)
- good first issue (1)
- Bug:P1 (1)
- Bug (1)
Top Pull Request Labels
- Dataset (4)
- documentation (2)
- Enhancement (2)
- WIP (2)
Package metadata
- Total packages: 3
-
Total downloads:
- pypi: 3,033 last-month
- Total dependent packages: 0 (may contain duplicates)
- Total dependent repositories: 0 (may contain duplicates)
- Total versions: 34
- Total maintainers: 1
proxy.golang.org: github.com/open-compass/OpenCompass
- Homepage:
- Status: removed
- Documentation: https://pkg.go.dev/github.com/open-compass/OpenCompass#section-documentation
- Licenses: apache-2.0
- Latest release: v0.0.0-20260910064447-135ab17186aa (published about 2 months ago)
- Last Synced: 2026-10-31T03:07:22.054Z (2 days ago)
- Versions: 2
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent packages count: 4.384%
- Average: 4.532%
- Dependent repos count: 4.679%
proxy.golang.org: github.com/open-compass/opencompass
- Homepage:
- Status: removed
- Documentation: https://pkg.go.dev/github.com/open-compass/opencompass#section-documentation
- Licenses: apache-2.0
- Latest release: v0.0.0-20260812140016-60a28a727d3b (published 3 months ago)
- Last Synced: 2026-10-31T03:04:04.448Z (2 days ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent packages count: 4.482%
- Average: 4.633%
- Dependent repos count: 4.783%
pypi.org: opencompass
A comprehensive toolkit for large model evaluation
- Homepage: https://github.com/open-compass/opencompass
- Documentation: https://opencompass.readthedocs.io/
- Licenses: Apache License 2.0
- Latest release: 0.5.4 (published 2 months ago)
- Last Synced: 2026-10-31T05:41:04.901Z (1 day ago)
- Versions: 31
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 3,033 Last month
-
Rankings:
- Stargazers count: 2.334%
- Forks count: 4.994%
- Dependent packages count: 7.366%
- Average: 20.878%
- Dependent repos count: 68.819%
- Maintainers (1)
Dependencies
- docutils ==0.18.1
- modelindex *
- myst-parser *
- sphinx ==6.1.3
- sphinx-copybutton *
- sphinx-design *
- sphinx-notfound-page *
- sphinx-tabs *
- sphinxcontrib-jquery *
- tabulate *
- actions/checkout v3 composite
- actions/setup-python v4 composite
- jlumbroso/free-disk-space 54081f138730dfa15788a46383842cd2f914a1be composite
- actions/checkout v2 composite
- actions/setup-python v4 composite
- actions/checkout v3 composite
- actions/setup-python v4 composite
- actions/checkout v6 composite
- actions/checkout v6 composite