opencompass

benchmark chatgpt evaluation large-language-model llama2 llama3 llm openai

Score: 22.742355695636746

Last synced: about 8 hours ago
JSON representation

Repository metadata:

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

Host: GitHub
URL: https://github.com/open-compass/opencompass
Owner: open-compass
License: apache-2.0
Created: 2023-06-15T12:42:58.000Z (about 3 years ago)
Default Branch: main
Last Pushed: 2026-08-04T03:05:12.000Z (9 days ago)
Last Synced: 2026-08-09T01:58:21.303Z (4 days ago)
Topics: benchmark, chatgpt, evaluation, large-language-model, llama2, llama3, llm, openai
Language: Python
Homepage: https://opencompass.org.cn/
Size: 7.11 MB
Stars: 7,286
Watchers: 27
Forks: 828
Open Issues: 368
Metadata Files:
- Readme: README.md
- License: LICENSE

Owner metadata:

Name: OpenCompass
Login: open-compass
Email: opencompass@pjlab.org.cn
Kind: organization
Description:
Website: opencompass.org.cn
Location: China
Twitter: OpenMMLab
Company:
Icon url: https://avatars.githubusercontent.com/u/143521324?v=4
Repositories: 16
Last Synced at: 2024-05-11T05:52:19.107Z
Profile URL: https://github.com/open-compass

GitHub Events

Total

Create event: 20
Delete event: 5
Fork event: 244
Issue comment event: 614
Issues event: 253
Member event: 4
Pull request event: 639
Pull request review comment event: 169
Pull request review event: 492
Push event: 257
Release event: 10
Watch event: 1862
Total: 4569

Last Year

Create event: 20
Delete event: 5
Fork event: 244
Issue comment event: 614
Issues event: 253
Member event: 4
Pull request event: 640
Pull request review comment event: 169
Pull request review event: 492
Push event: 258
Release event: 10
Watch event: 1871
Total: 4580

Committers metadata

Last synced: 1 day ago

Total Commits: 1,212
Total Committers: 183
Avg Commits per committer: 6.623
Development Distribution Score (DDS): 0.908

Commits in past year: 213
Committers in past year: 41
Avg Commits per committer in past year: 5.195
Development Distribution Score (DDS) in past year: 0.577

Name	Email	Commits
Fengzhe Zhou	z**7@1**m	112
Myhs_phz	d**4@1**m	112
Linchen Xiao	x**3@g**m	110
bittersweet1999	1****9	82
Songyang Zhang	t****y	82
Tong Gao	g**o@g**m	60
zhulinJulia24	1****4	56
Hubert	4****u	56
liushz	q**5@1**m	47
ssiq	l**e@h**m	46
Mo Li	8****i	18
Yu Sun	y**p@g**m	18
Junnan Liu	t**n@o**m	17
Jingming	1****o	15
Ma Zerun	m**6@1**m	15
Dongsheng Zhu	5****5	12
Yuan Liu	3****u	12
Haodong Duan	d**z@g**m	11
Xu Song	x**p@g**m	11
Lyu Han	l**8@1**m	10
Alexander Lam	l**o@p**n	9
Ezra-Yu	1****u	8
klein	z**2@s**n	8
fly2tomato	x**0@g**m	8
Yang Yong	y**0@1**m	8
Connor-Shen	0**3@g**m	7
Yike Yuan	3****w	7
Kevin Wang	w**3@1**m	6
philipwangOvO	7****O	6
RunningLeon	m**g@y**t	6
and 153 more...

Issue and Pull Request metadata

Last synced: 2 days ago

Total issues: 678
Total pull requests: 1,722
Average time to close issues: 2 months
Average time to close pull requests: 7 days
Total issue authors: 422
Total pull request authors: 219
Average comments per issue: 1.68
Average comments per pull request: 0.32
Merged pull request: 1,271
Bot issues: 0
Bot pull requests: 0

Past year issues: 33
Past year pull requests: 97
Past year average time to close issues: 4 months
Past year average time to close pull requests: 12 days
Past year issue authors: 32
Past year pull request authors: 36
Past year average comments per issue: 0.94
Past year average comments per pull request: 0.3
Past year merged pull request: 53
Past year bot issues: 0
Past year bot pull requests: 0

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/open-compass/opencompass

Top Issue Authors

GenerallyCovetous (21)
tonysy (20)
13416157913 (16)
cobraheleah (8)
linbeyoung (7)
Leymore (7)
zhulinJulia24 (6)
Sweetclover (6)
Ezra-Yu (6)
BeyonderXX (6)
del-zhenwu (6)
bullw (5)
kkwhale7 (5)
SefaZeng (5)
zhimin-z (5)

Top Pull Request Authors

MaiziXiao (217)
bittersweet1999 (163)
Leymore (155)
tonysy (112)
zhulinJulia24 (93)
liushz (68)
Myhs-phz (60)
yingfhu (33)
DseidLi (31)
jnanliu (31)
ssiq (26)
xu-song (25)
Zhudongsheng75 (24)
gaotongxiao (22)
kleinzcy (20)

Top Issue Labels

Enhancement (4)
backlog (2)
Bug:P0 (2)
planned feature (2)
documentation (1)
good first issue (1)
Bug:P1 (1)
Bug (1)

Top Pull Request Labels

Dataset (4)
documentation (2)
Enhancement (2)
WIP (2)

Package metadata

Total packages: 1
Total downloads:
- pypi: 5,376 last-month
Total dependent packages: 0
Total dependent repositories: 0
Total versions: 30
Total maintainers: 1

pypi.org: opencompass

A comprehensive toolkit for large model evaluation

Homepage: https://github.com/open-compass/opencompass
Documentation: https://opencompass.readthedocs.io/
Licenses: Apache License 2.0
Latest release: 0.5.3 (published about 2 months ago)
Last Synced: 2026-08-11T22:03:57.066Z (1 day ago)
Versions: 30
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 5,376 Last month
Rankings:
- Stargazers count: 2.334%
- Forks count: 4.994%
- Dependent packages count: 7.366%
- Average: 20.878%
- Dependent repos count: 68.819%
Maintainers (1)
- openmmlab

Dependencies

.github/workflows/link-check.yml actions

requirements/docs.txt pypi

docutils ==0.18.1
modelindex *
myst-parser *
sphinx ==6.1.3
sphinx-copybutton *
sphinx-design *
sphinx-notfound-page *
sphinx-tabs *
sphinxcontrib-jquery *
tabulate *

.github/workflows/pr-stage-check.yml actions

actions/checkout v3 composite
actions/setup-python v4 composite
jlumbroso/free-disk-space 54081f138730dfa15788a46383842cd2f914a1be composite

.github/workflows/publish-to-pypi.yml actions

actions/checkout v2 composite
actions/setup-python v4 composite

.github/workflows/lint.yml actions

actions/checkout v3 composite
actions/setup-python v4 composite

requirements.txt pypi

setup.py pypi

.github/workflows/pr-run-test.yml actions

actions/checkout v6 composite

.github/workflows/unit-test.yml actions

actions/checkout v6 composite

ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Summary