https://github.com/clipperhouse/uax29
go golang nlp tokenization tokenizer uax29 unicode
Score: 24.255355019072883
Last synced: about 3 hours ago
JSON representation
Repository metadata:
A tokenizer based on Unicode text segmentation (UAX #29), for Go. Split graphemes, words, sentences.
- Host: GitHub
- URL: https://github.com/clipperhouse/uax29
- Owner: clipperhouse
- License: mit
- Created: 2020-04-15T18:24:47.000Z (over 6 years ago)
- Default Branch: master
- Last Pushed: 2026-02-16T16:00:46.000Z (6 months ago)
- Last Synced: 2026-08-20T07:11:49.230Z (6 days ago)
- Topics: go, golang, nlp, tokenization, tokenizer, uax29, unicode
- Language: Go
- Homepage:
- Size: 1.17 MB
- Stars: 121
- Watchers: 4
- Forks: 7
- Open Issues: 2
-
Metadata Files:
- Readme: README.md
- License: LICENSE
- Agents: AGENTS.md
Owner metadata:
- Name: Matt Sherman
- Login: clipperhouse
- Email:
- Kind: user
- Description:
- Website: https://clipperhouse.com
- Location: nyc
- Twitter:
- Company: Stack Overflow, Alikewise
- Icon url: https://avatars.githubusercontent.com/u/216057?v=4
- Repositories: 42
- Last Synced at: 2024-04-14T08:23:28.248Z
- Profile URL: https://github.com/clipperhouse
GitHub Events
Total
- Create event: 9
- Delete event: 8
- Fork event: 2
- Issue comment event: 18
- Issues event: 8
- Pull request event: 12
- Pull request review comment event: 28
- Pull request review event: 25
- Push event: 76
- Release event: 2
- Watch event: 21
- Total: 209
Last Year
- Create event: 8
- Delete event: 7
- Fork event: 1
- Issue comment event: 18
- Issues event: 8
- Pull request event: 12
- Pull request review comment event: 28
- Pull request review event: 25
- Push event: 68
- Release event: 1
- Watch event: 13
- Total: 189
Committers metadata
Last synced: 6 days ago
Total Commits: 314
Total Committers: 3
Avg Commits per committer: 104.667
Development Distribution Score (DDS): 0.006
Commits in past year: 46
Committers in past year: 2
Avg Commits per committer in past year: 23.0
Development Distribution Score (DDS) in past year: 0.022
| Name | Commits | |
|---|---|---|
| Matt Sherman | m****n@g****m | 312 |
| dependabot[bot] | 4****] | 1 |
| Ayman Bagabas | a****s@g****m | 1 |
Issue and Pull Request metadata
Last synced: 1 day ago
Total issues: 12
Total pull requests: 39
Average time to close issues: 5 months
Average time to close pull requests: 4 days
Total issue authors: 8
Total pull request authors: 4
Average comments per issue: 1.67
Average comments per pull request: 0.26
Merged pull request: 34
Bot issues: 0
Bot pull requests: 1
Past year issues: 7
Past year pull requests: 9
Past year average time to close issues: 24 days
Past year average time to close pull requests: 1 day
Past year issue authors: 5
Past year pull request authors: 2
Past year average comments per issue: 1.86
Past year average comments per pull request: 1.0
Past year merged pull request: 5
Past year bot issues: 0
Past year bot pull requests: 0
Top Issue Authors
- clipperhouse (4)
- aymanbagabas (2)
- bradbesserman (1)
- Konstantin8105 (1)
- gibmat (1)
- StevenACoffman (1)
- icco (1)
- Tamir198 (1)
Top Pull Request Authors
- clipperhouse (36)
- engmtcdrm (1)
- kevwang (1)
- dependabot[bot] (1)
Top Issue Labels
Top Pull Request Labels
- dependencies (1)
Package metadata
- Total packages: 3
- Total downloads: unknown
- Total docker downloads: 92,670,250
- Total dependent packages: 14 (may contain duplicates)
- Total dependent repositories: 7 (may contain duplicates)
- Total versions: 63
proxy.golang.org: github.com/clipperhouse/uax29
Package uax29 provides Unicode text segmentation (UAX #29) for words, sentences and graphemes.
- Homepage: https://github.com/clipperhouse/uax29
- Documentation: https://pkg.go.dev/github.com/clipperhouse/uax29#section-documentation
- Licenses: mit
- Latest release: v1.16.0 (published 12 months ago)
- Last Synced: 2026-08-24T09:39:54.967Z (2 days ago)
- Versions: 51
- Dependent Packages: 14
- Dependent Repositories: 7
- Docker Downloads: 16
-
Rankings:
- Dependent packages count: 1.357%
- Dependent repos count: 1.933%
- Average: 4.998%
- Stargazers count: 6.757%
- Forks count: 9.946%
proxy.golang.org: github.com/clipperhouse/uax29/v2
Package uax29 provides Unicode text segmentation (UAX #29) for words, sentences and graphemes.
- Homepage: https://github.com/clipperhouse/uax29
- Documentation: https://pkg.go.dev/github.com/clipperhouse/uax29/v2#section-documentation
- Licenses: mit
- Latest release: v2.7.0 (published 6 months ago)
- Last Synced: 2026-08-25T09:35:25.574Z (1 day ago)
- Versions: 11
- Dependent Packages: 0
- Dependent Repositories: 0
- Docker Downloads: 92,670,234
-
Rankings:
- Dependent packages count: 5.189%
- Dependent repos count: 5.537%
- Stargazers count: 6.22%
- Average: 6.553%
- Forks count: 9.267%
guix: go-github-com-clipperhouse-uax29-v2
Tokenizer based on Unicode text segmentation for Go
- Homepage: https://github.com/clipperhouse/uax29
- Documentation: https://git.savannah.gnu.org/cgit/guix.git/tree/gnu/packages/golang-xyz.scm#n6625
- Licenses: expat
- Latest release: 2.7.0 (published 8 days ago)
- Last Synced: 2026-08-19T00:28:53.592Z (8 days ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%
Dependencies
- golang.org/x/text v0.3.7
- golang.org/x/text v0.3.7
- golang.org/x/tools v0.0.0-20180917221912-90fa682c2a6e
- actions/checkout v3 composite
- actions/setup-go v3 composite
- actions/checkout v3 composite
- actions/setup-go v3 composite
- golang.org/x/text v0.16.0
- golang.org/x/text v0.16.0
- github.com/charmbracelet/x/ansi v0.11.6
- github.com/clipperhouse/displaywidth v0.9.0
- github.com/clipperhouse/stringish v0.1.1
- github.com/clipperhouse/uax29/v2 v2.6.0
- github.com/lucasb-eyer/go-colorful v1.3.0
- github.com/mattn/go-runewidth v0.0.19
- github.com/rivo/uniseg v0.4.7
- github.com/blevesearch/segment v0.9.1
- github.com/clipperhouse/uax29/v2 v2.6.0
- github.com/charmbracelet/x/ansi v0.11.6
- github.com/clipperhouse/displaywidth v0.9.0
- github.com/clipperhouse/stringish v0.1.1
- github.com/lucasb-eyer/go-colorful v1.3.0
- github.com/mattn/go-runewidth v0.0.19
- github.com/rivo/uniseg v0.4.7
- github.com/blevesearch/segment v0.9.1