https://github.com/mjpost/sacrebleu
Score: 26.299065833476888
Last synced: about 23 hours ago
JSON representation
Repository metadata:
Reference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons
- Host: GitHub
- URL: https://github.com/mjpost/sacrebleu
- Owner: mjpost
- License: apache-2.0
- Created: 2017-09-29T13:06:23.000Z (about 9 years ago)
- Default Branch: master
- Last Pushed: 2026-08-20T07:32:06.000Z (3 months ago)
- Last Synced: 2026-11-02T08:32:24.481Z (7 days ago)
- Language: Python
- Size: 2.35 MB
- Stars: 1,265
- Watchers: 18
- Forks: 186
- Open Issues: 33
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- License: LICENSE.txt
Owner metadata:
- Name: Matt Post
- Login: mjpost
- Email: post@cs.jhu.edu
- Kind: user
- Description: Researcher @ Microsoft Translator | Director @ ACL Anthology
- Website: waypost.net
- Location: Baltimore, MD
- Twitter:
- Company: Microsoft
- Icon url: https://avatars.githubusercontent.com/u/455256?u=db7a481c399a84b9389e5351f25d0e68fe88109f&v=4
- Repositories: 87
- Last Synced at: 2026-11-03T19:28:10.566Z
- Profile URL: https://github.com/mjpost
GitHub Events
Total
- Create event: 7
- Delete event: 4
- Fork event: 9
- Issue comment event: 26
- Issues event: 11
- Pull request event: 12
- Pull request review event: 1
- Push event: 11
- Release event: 1
- Watch event: 130
- Total: 212
Last Year
- Create event: 2
- Delete event: 1
- Fork event: 1
- Issue comment event: 5
- Issues event: 1
- Pull request event: 2
- Push event: 2
- Watch event: 17
- Total: 31
Committers metadata
Last synced: 2 days ago
Total Commits: 302
Total Committers: 47
Avg Commits per committer: 6.426
Development Distribution Score (DDS): 0.51
Commits in past year: 10
Committers in past year: 5
Avg Commits per committer in past year: 2.0
Development Distribution Score (DDS) in past year: 0.6
| Name | Commits | |
|---|---|---|
| Matt Post | p****t@c****u | 148 |
| Matt Post | m****t@a****m | 55 |
| Martin Popel | p****l@u****z | 18 |
| Ozan Caglayan | o****g@g****m | 15 |
| Christian Federmann | c****e@m****m | 5 |
| Dmitry Ustalov | d****v@j****m | 4 |
| Junpei Kawamoto | k****i@g****m | 4 |
| Ales Tamchyna | a****a@m****m | 3 |
| Copilot | 1****t | 3 |
| Thomas Liao | t****o@b****u | 3 |
| Prashant Mathur | p****t@g****m | 3 |
| Makoto Morishita | m****o@g****m | 2 |
| loicbarrault | l****t@g****m | 2 |
| Stephen Mayhew | s****w@g****m | 2 |
| Ondrej Dusek | t****k | 2 |
| Thamme Gowda | t****g@i****u | 2 |
| Bram Vanroy | B****y@U****e | 1 |
| Erwan de Lépinau | e****n@f****m | 1 |
| AbdelRahim A. Elmadany | e****y@g****m | 1 |
| Adam Roberts | a****b@g****m | 1 |
| Arnaud Thery | 1****x | 1 |
| Arya McCarthy | a****y@g****m | 1 |
| Doug Hellmann | d****n@r****m | 1 |
| Elizabeth Salesky | e****y@g****m | 1 |
| Erwan de Lépinau | 3****L | 1 |
| thomasZen | t****l@g****m | 1 |
| sentiasm | 2****m | 1 |
| jhcross | j****i@g****m | 1 |
| heiwais25 | h****5@g****m | 1 |
| abcdenis | a****s | 1 |
| and 17 more... | ||
Issue and Pull Request metadata
Last synced: 2 days ago
Total issues: 95
Total pull requests: 93
Average time to close issues: 3 months
Average time to close pull requests: 4 months
Total issue authors: 77
Total pull request authors: 41
Average comments per issue: 3.4
Average comments per pull request: 2.77
Merged pull request: 57
Bot issues: 0
Bot pull requests: 0
Past year issues: 3
Past year pull requests: 24
Past year average time to close issues: about 7 hours
Past year average time to close pull requests: 1 day
Past year issue authors: 3
Past year pull request authors: 15
Past year average comments per issue: 0.67
Past year average comments per pull request: 0.54
Past year merged pull request: 8
Past year bot issues: 0
Past year bot pull requests: 0
Top Issue Authors
- mjpost (5)
- BramVanroy (3)
- martinpopel (3)
- ozancaglayan (3)
- Phuoc-Hoan-Le (2)
- bricksdont (2)
- DhruvAwasthi (2)
- alvations (2)
- ZJaume (2)
- kpu (2)
- BrightXiaoHan (2)
- Arij-Aladel (2)
- JoyeBright (1)
- alexcoca (1)
- epwalsh (1)
Top Pull Request Authors
- mjpost (19)
- jkawamoto (8)
- martinpopel (7)
- Copilot (4)
- thammegowda (3)
- kocean9-freedom (3)
- BrightXiaoHan (3)
- ozancaglayan (3)
- dustalov (3)
- ernlavr (2)
- TrellixVulnTeam (2)
- dhellmann (2)
- justavibedev (2)
- leeshengis (2)
- St4r4x (2)
Top Issue Labels
- new-feature (4)
- question (3)
- enhancement (3)
- pending (1)
- bug (1)
Top Pull Request Labels
- pending (4)
Package metadata
- Total packages: 16
-
Total downloads:
- conda: 119,780 total
- pypi: 3,116,396 last-month
- Total docker downloads: 1,085,982
- Total dependent packages: 98 (may contain duplicates)
- Total dependent repositories: 4,266 (may contain duplicates)
- Total versions: 198
- Total maintainers: 6
pypi.org: sacrebleu
Hassle-free computation of shareable, comparable, and reproducible BLEU, chrF, and TER scores
- Homepage:
- Documentation: https://sacrebleu.readthedocs.io/
- Licenses: Apache-2.0
- Latest release: 2.6.0 (published 10 months ago)
- Last Synced: 2026-11-07T10:32:56.111Z (2 days ago)
- Versions: 73
- Dependent Packages: 96
- Dependent Repositories: 4,263
- Downloads: 3,116,325 Last month
- Docker Downloads: 1,085,982
-
Rankings:
- Dependent repos count: 0.154%
- Dependent packages count: 0.225%
- Downloads: 0.302%
- Docker downloads count: 0.979%
- Average: 1.309%
- Stargazers count: 2.105%
- Forks count: 4.087%
- Maintainers (3)
nixpkgs-unstable: python313Packages.sacrebleu
Hassle-free computation of shareable, comparable, and reproducible BLEU, chrF, and TER scores
- Homepage: https://github.com/mjpost/sacrebleu
- Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-unstable/pkgs/development/python-modules/sacrebleu/default.nix#L61
- Licenses: Apache-2.0
- Latest release: 2.6.0 (published 10 months ago)
- Last Synced: 2026-11-01T11:11:52.506Z (8 days ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 1.692%
- Forks count: 3.373%
- Stargazers count: 3.395%
- Maintainers (1)
nixpkgs-unstable: python314Packages.sacrebleu
Hassle-free computation of shareable, comparable, and reproducible BLEU, chrF, and TER scores
- Homepage: https://github.com/mjpost/sacrebleu
- Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-unstable/pkgs/development/python-modules/sacrebleu/default.nix#L61
- Licenses: Apache-2.0
- Latest release: 2.6.0 (published 10 months ago)
- Last Synced: 2026-11-01T11:46:07.988Z (8 days ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 1.746%
- Forks count: 3.477%
- Stargazers count: 3.507%
- Maintainers (1)
nixpkgs-23.11: python310Packages.sacrebleu
Hassle-free computation of shareable, comparable, and reproducible BLEU, chrF, and TER scores
- Homepage: https://github.com/mjpost/sacrebleu
- Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-23.11/pkgs/development/python-modules/sacrebleu/default.nix#L62
- Licenses: Apache-2.0
- Latest release: 2.3.1 (published 9 months ago)
- Last Synced: 2026-08-25T04:28:14.621Z (3 months ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 1.814%
- Forks count: 3.53%
- Stargazers count: 3.726%
- Maintainers (1)
proxy.golang.org: github.com/mjpost/sacrebleu
- Homepage:
- Documentation: https://pkg.go.dev/github.com/mjpost/sacrebleu#section-documentation
- Licenses: apache-2.0
- Latest release: v2.6.0+incompatible (published 10 months ago)
- Last Synced: 2026-11-07T10:34:56.936Z (2 days ago)
- Versions: 50
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent packages count: 4.933%
- Average: 5.099%
- Dependent repos count: 5.265%
proxy.golang.org: github.com/mjpost/sacreBLEU
- Homepage:
- Documentation: https://pkg.go.dev/github.com/mjpost/sacreBLEU#section-documentation
- Licenses: apache-2.0
- Latest release: v2.6.0+incompatible (published 10 months ago)
- Last Synced: 2026-11-07T10:38:25.057Z (2 days ago)
- Versions: 50
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent packages count: 4.933%
- Average: 5.099%
- Dependent repos count: 5.265%
pypi.org: sacrebleu-macrof
Hassle-free computation of shareable, comparable, and reproducible BLEU, chrF, and TER scores
- Homepage: https://github.com/mjpost/sacrebleu
- Documentation: https://sacrebleu-macrof.readthedocs.io/
- Licenses: Apache License 2.0
- Latest release: 2.0.1 (published about 5 years ago)
- Last Synced: 2026-11-07T10:38:16.313Z (2 days ago)
- Versions: 1
- Dependent Packages: 1
- Dependent Repositories: 1
- Downloads: 71 Last month
-
Rankings:
- Stargazers count: 2.105%
- Forks count: 4.074%
- Dependent packages count: 4.791%
- Average: 10.89%
- Dependent repos count: 21.535%
- Downloads: 21.945%
- Maintainers (1)
spack.io: py-sacrebleu
SacreBLEU is a standard BLEU implementation that downloads and manages WMT datasets, produces scores on detokenized outputs, and reports a string encapsulating BLEU parameters, facilitating the production of shareable, comparable BLEU scores.
- Homepage: https://github.com/mjpost/sacrebleu
- Licenses: []
- Latest release: 2.0.0 (published over 3 years ago)
- Last Synced: 2026-11-07T10:32:56.583Z (2 days ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Stargazers count: 8.273%
- Forks count: 9.052%
- Average: 18.696%
- Dependent packages count: 57.459%
- Maintainers (1)
conda-forge.org: sacrebleu
SacreBLEU (Post, 2018) provides hassle-free computation of shareable, comparable, and reproducible BLEU scores. Inspired by Rico Sennrich's multi-bleu-detok.perl, it produces the official WMT scores but works with plain text. It also knows all the standard test sets and handles downloading, processing, and tokenization for you.
- Homepage: https://github.com/mjpost/sacrebleu
- Licenses: Apache-2.0
- Latest release: 2.3.1 (published about 4 years ago)
- Last Synced: 2026-04-01T05:17:05.346Z (7 months ago)
- Versions: 10
- Dependent Packages: 1
- Dependent Repositories: 1
- Downloads: 117,930 Total
-
Rankings:
- Stargazers count: 14.257%
- Forks count: 15.605%
- Average: 20.816%
- Dependent repos count: 24.412%
- Dependent packages count: 28.988%
anaconda.org: sacrebleu
SacreBLEU (Post, 2018) provides hassle-free computation of shareable, comparable, and reproducible BLEU scores. Inspired by Rico Sennrich's multi-bleu-detok.perl, it produces the official WMT scores but works with plain text. It also knows all the standard test sets and handles downloading, processing, and tokenization for you.
- Homepage: https://github.com/mjpost/sacrebleu
- Licenses: Apache-2.0
- Latest release: 2.5.1 (published 11 months ago)
- Last Synced: 2026-10-10T07:26:06.617Z (about 1 month ago)
- Versions: 3
- Dependent Packages: 0
- Dependent Repositories: 1
- Downloads: 1,850 Total
-
Rankings:
- Stargazers count: 25.823%
- Forks count: 27.937%
- Average: 39.089%
- Dependent packages count: 51.193%
- Dependent repos count: 51.404%
guix: python-sacrebleu
Compute shareable, comparable, and reproducible BLEU, chrF, and TER scores
- Homepage: https://github.com/mjpost/sacrebleu
- Documentation: https://git.savannah.gnu.org/cgit/guix.git/tree/gnu/packages/machine-learning.scm#n1584
- Licenses: asl2.0
- Latest release: 2.6.0 (published 7 months ago)
- Last Synced: 2026-04-27T17:03:50.147Z (7 months ago)
- Versions: 2
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%
nixpkgs-24.05: python311Packages.sacrebleu
Hassle-free computation of shareable, comparable, and reproducible BLEU, chrF, and TER scores
- Homepage: https://github.com/mjpost/sacrebleu
- Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-24.05/pkgs/development/python-modules/sacrebleu/default.nix#L61
- Licenses: Apache-2.0
- Latest release: 2.3.1 (published 9 months ago)
- Last Synced: 2026-05-12T14:58:52.936Z (6 months ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%
- Maintainers (1)
nixpkgs-24.11: python312Packages.sacrebleu
Hassle-free computation of shareable, comparable, and reproducible BLEU, chrF, and TER scores
- Homepage: https://github.com/mjpost/sacrebleu
- Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-24.11/pkgs/development/python-modules/sacrebleu/default.nix#L61
- Licenses: Apache-2.0
- Latest release: 2.4.2 (published 9 months ago)
- Last Synced: 2026-03-06T08:44:46.733Z (8 months ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%
- Maintainers (1)
nixpkgs-23.11: python311Packages.sacrebleu
Hassle-free computation of shareable, comparable, and reproducible BLEU, chrF, and TER scores
- Homepage: https://github.com/mjpost/sacrebleu
- Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-23.11/pkgs/development/python-modules/sacrebleu/default.nix#L62
- Licenses: Apache-2.0
- Latest release: 2.3.1 (published 9 months ago)
- Last Synced: 2026-08-01T10:18:59.132Z (3 months ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%
- Maintainers (1)
nixpkgs-24.11: python311Packages.sacrebleu
Hassle-free computation of shareable, comparable, and reproducible BLEU, chrF, and TER scores
- Homepage: https://github.com/mjpost/sacrebleu
- Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-24.11/pkgs/development/python-modules/sacrebleu/default.nix#L61
- Licenses: Apache-2.0
- Latest release: 2.4.2 (published 9 months ago)
- Last Synced: 2026-08-05T21:04:43.421Z (3 months ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%
- Maintainers (1)
nixpkgs-24.05: python312Packages.sacrebleu
Hassle-free computation of shareable, comparable, and reproducible BLEU, chrF, and TER scores
- Homepage: https://github.com/mjpost/sacrebleu
- Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-24.05/pkgs/development/python-modules/sacrebleu/default.nix#L61
- Licenses: Apache-2.0
- Latest release: 2.3.1 (published 9 months ago)
- Last Synced: 2026-05-13T08:03:19.261Z (6 months ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%
- Maintainers (1)
Dependencies
- actions/checkout v2 composite
- actions/setup-python v2 composite
- actions/checkout v4 composite
- actions/setup-python v5 composite
- pypa/gh-action-pypi-publish release/v1 composite
- colorama *
- lxml *
- numpy >=1.17
- portalocker *
- regex *
- tabulate >=0.8.9