https://github.com/explosion/curated-tokenizers
Score: 17.467010263309632
Last synced: about 10 hours ago
JSON representation
Repository metadata:
Lightweight piece tokenization library
- Host: GitHub
- URL: https://github.com/explosion/curated-tokenizers
- Owner: explosion
- License: other
- Created: 2022-07-08T19:05:49.000Z (over 4 years ago)
- Default Branch: main
- Last Pushed: 2026-08-24T09:44:26.000Z (2 months ago)
- Last Synced: 2026-10-02T23:29:01.724Z (21 days ago)
- Language: Cython
- Homepage:
- Size: 271 KB
- Stars: 12
- Watchers: 5
- Forks: 7
- Open Issues: 2
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Owner metadata:
- Name: Explosion
- Login: explosion
- Email: contact@explosion.ai
- Kind: organization
- Description: Software company specializing in developer tools and tailored solutions for AI and Natural Language Processing
- Website: https://explosion.ai
- Location: Berlin, Germany
- Twitter:
- Company:
- Icon url: https://avatars.githubusercontent.com/u/20011530?v=4
- Repositories: 80
- Last Synced at: 2026-10-16T22:15:40.113Z
- Profile URL: https://github.com/explosion
GitHub Events
Total
- Issue comment event: 1
- Member event: 1
- Pull request event: 1
- Push event: 1
- Watch event: 1
- Total: 5
Last Year
- Issue comment event: 1
- Push event: 1
- Total: 2
Committers metadata
Last synced: 1 day ago
Total Commits: 66
Total Committers: 5
Avg Commits per committer: 13.2
Development Distribution Score (DDS): 0.258
Commits in past year: 4
Committers in past year: 1
Avg Commits per committer in past year: 4.0
Development Distribution Score (DDS) in past year: 0.0
| Name | Commits | |
|---|---|---|
| Daniël de Kok | m****e@d****u | 49 |
| Madeesh Kannan | s****e | 10 |
| Matthew Honnibal | h****h@g****m | 4 |
| Adriane Boyd | a****d@g****m | 2 |
| Ines Montani | i****s@i****o | 1 |
Issue and Pull Request metadata
Last synced: 1 day ago
Total issues: 1
Total pull requests: 30
Average time to close issues: N/A
Average time to close pull requests: about 14 hours
Total issue authors: 1
Total pull request authors: 4
Average comments per issue: 3.0
Average comments per pull request: 0.13
Merged pull request: 24
Bot issues: 0
Bot pull requests: 0
Past year issues: 1
Past year pull requests: 0
Past year average time to close issues: N/A
Past year average time to close pull requests: N/A
Past year issue authors: 1
Past year pull request authors: 0
Past year average comments per issue: 3.0
Past year average comments per pull request: 0
Past year merged pull request: 0
Past year bot issues: 0
Past year bot pull requests: 0
Top Issue Authors
- cdjameson (1)
Top Pull Request Authors
- danieldk (18)
- shadeMe (8)
- adrianeboyd (2)
- cclauss (2)
Top Issue Labels
Top Pull Request Labels
- enhancement (9)
Package metadata
- Total packages: 4
-
Total downloads:
- pypi: 550,456 last-month
- Total dependent packages: 2 (may contain duplicates)
- Total dependent repositories: 3 (may contain duplicates)
- Total versions: 26
- Total maintainers: 2
proxy.golang.org: github.com/explosion/curated-tokenizers
- Homepage:
- Documentation: https://pkg.go.dev/github.com/explosion/curated-tokenizers#section-documentation
- Licenses: other
- Latest release: v2.0.0+incompatible (published over 2 years ago)
- Last Synced: 2026-10-22T17:32:51.555Z (1 day ago)
- Versions: 12
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent packages count: 4.35%
- Average: 4.496%
- Dependent repos count: 4.643%
pypi.org: curated-tokenizers
Lightweight piece tokenization library
- Homepage: https://github.com/explosion/curated-tokenizers
- Documentation: https://curated-tokenizers.readthedocs.io/
- Licenses: MIT
- Latest release: 2.0.1 (published 2 months ago)
- Last Synced: 2026-10-22T17:32:50.875Z (1 day ago)
- Versions: 12
- Dependent Packages: 2
- Dependent Repositories: 3
- Downloads: 550,456 Last month
-
Rankings:
- Downloads: 1.629%
- Dependent packages count: 3.176%
- Dependent repos count: 8.935%
- Average: 9.299%
- Forks count: 14.234%
- Stargazers count: 18.519%
- Maintainers (1)
nixpkgs-unstable: python313Packages.curated-tokenizers
Lightweight piece tokenization library
- Homepage: https://github.com/explosion/curated-tokenizers
- Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-unstable/pkgs/development/python-modules/curated-tokenizers/default.nix#L55
- Licenses: MIT
- Latest release: 2.0.0 (published 9 months ago)
- Last Synced: 2026-04-02T18:06:54.171Z (7 months ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%
- Maintainers (1)
nixpkgs-unstable: python314Packages.curated-tokenizers
Lightweight piece tokenization library
- Homepage: https://github.com/explosion/curated-tokenizers
- Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-unstable/pkgs/development/python-modules/curated-tokenizers/default.nix#L55
- Licenses: MIT
- Latest release: 2.0.0 (published 9 months ago)
- Last Synced: 2026-08-11T18:10:21.391Z (2 months ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%
- Maintainers (1)
Dependencies
- cython >=0.25
- pytest >=5.2.0
- wheel *
- actions/checkout v1 composite
- actions/setup-python v4 composite