https://github.com/dmitry-brazhenko/SharpToken
cl100kbase csharp gpt gpt-3 gpt-4 openai tokenizer
Score: 22.961647866130786
Last synced: about 4 hours ago
JSON representation
Repository metadata:
SharpToken is a C# library for tokenizing natural language text. It's based on the tiktoken Python library and designed to be fast and accurate.
- Host: GitHub
- URL: https://github.com/dmitry-brazhenko/SharpToken
- Owner: dmitry-brazhenko
- License: mit
- Created: 2023-03-28T10:17:52.000Z (over 3 years ago)
- Default Branch: main
- Last Pushed: 2026-03-25T16:25:16.000Z (7 months ago)
- Last Synced: 2026-10-04T23:14:41.921Z (29 days ago)
- Topics: cl100kbase, csharp, gpt, gpt-3, gpt-4, openai, tokenizer
- Language: C#
- Homepage: https://www.nuget.org/packages/SharpToken
- Size: 4.07 MB
- Stars: 263
- Watchers: 12
- Forks: 19
- Open Issues: 7
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Owner metadata:
- Name: Dmitry Brazhenko
- Login: dmitry-brazhenko
- Email:
- Kind: user
- Description:
- Website:
- Location:
- Twitter:
- Company:
- Icon url: https://avatars.githubusercontent.com/u/61410067?u=2de9ba98c2c74735de168ea1d1c6dece640fea58&v=4
- Repositories: 19
- Last Synced at: 2026-10-30T12:07:43.288Z
- Profile URL: https://github.com/dmitry-brazhenko
GitHub Events
Total
- Create event: 2
- Delete event: 1
- Fork event: 4
- Issue comment event: 4
- Issues event: 3
- Pull request event: 2
- Push event: 5
- Watch event: 36
- Total: 57
Last Year
- Create event: 1
- Fork event: 1
- Issue comment event: 1
- Issues event: 1
- Watch event: 2
- Total: 6
Committers metadata
Last synced: 1 day ago
Total Commits: 58
Total Committers: 8
Avg Commits per committer: 7.25
Development Distribution Score (DDS): 0.155
Commits in past year: 2
Committers in past year: 2
Avg Commits per committer in past year: 1.0
Development Distribution Score (DDS) in past year: 0.5
| Name | Commits | |
|---|---|---|
| dmitry-brazhenko | b****y@g****m | 49 |
| Victor Wilson | v****n@g****m | 2 |
| Dmitry Brazhenko | d****o@m****m | 2 |
| ian-cameron | i****n@d****m | 1 |
| Eric StJohn | e****j@m****m | 1 |
| Edgard David Iván Muñoz Chávez | 1****g | 1 |
| Dmytro Struk | 1****k | 1 |
| Anthony Puppo | a****x@g****m | 1 |
Issue and Pull Request metadata
Last synced: 1 day ago
Total issues: 20
Total pull requests: 40
Average time to close issues: 3 months
Average time to close pull requests: about 18 hours
Total issue authors: 16
Total pull request authors: 10
Average comments per issue: 2.25
Average comments per pull request: 0.63
Merged pull request: 32
Bot issues: 0
Bot pull requests: 0
Past year issues: 1
Past year pull requests: 1
Past year average time to close issues: N/A
Past year average time to close pull requests: 3 minutes
Past year issue authors: 1
Past year pull request authors: 1
Past year average comments per issue: 0.0
Past year average comments per pull request: 0.0
Past year merged pull request: 1
Past year bot issues: 0
Past year bot pull requests: 0
Top Issue Authors
- omri-suissa-clearmash (4)
- vovanb (2)
- vermorel (1)
- ian-cameron (1)
- daniell0gda (1)
- lofcz (1)
- Augustukas (1)
- kzu (1)
- c-vongpaseut (1)
- bsstahl (1)
- abdulkareemnalband (1)
- thomasdc (1)
- zhuzihan728 (1)
- ali-hm (1)
- lyczkop (1)
Top Pull Request Authors
- dmitry-brazhenko (26)
- vwilson (2)
- r-Larch (2)
- splattne (2)
- ericstj (2)
- winzig (2)
- ian-cameron (1)
- okhosting (1)
- dmytrostruk (1)
- anthonypuppo (1)
Top Issue Labels
Top Pull Request Labels
Package metadata
- Total packages: 1
-
Total downloads:
- nuget: 4,341,722 total
- Total dependent packages: 11
- Total dependent repositories: 0
- Total versions: 39
- Total maintainers: 1
nuget.org: sharptoken
Package Description
- Homepage: https://github.com/dmitry-brazhenko/SharpToken
- Licenses: mit
- Latest release: 2.0.6 (published 7 months ago)
- Last Synced: 2026-11-02T00:04:05.276Z (1 day ago)
- Versions: 39
- Dependent Packages: 11
- Dependent Repositories: 0
- Downloads: 4,341,722 Total
-
Rankings:
- Downloads: 2.066%
- Average: 12.461%
- Dependent repos count: 14.978%
- Dependent packages count: 20.338%
- Maintainers (1)
Dependencies
- Microsoft.NET.Test.Sdk 17.1.0
- NUnit 3.13.3
- NUnit.Analyzers 3.3.0
- NUnit3TestAdapter 4.2.1
- coverlet.collector 3.1.2
- actions/checkout v2 composite
- actions/setup-dotnet v1 composite
- actions/checkout v2 composite
- actions/create-release v1 composite
- actions/setup-dotnet v1 composite
- actions/upload-release-asset v1 composite
- actions/checkout v4 composite
- actions/setup-dotnet v4 composite
- BenchmarkDotNet 0.13.12
- Microsoft.DeepDev.TokenizerLib 1.3.3
- Microsoft.ML.Tokenizers 0.22.0-preview.24179.1
- Newtonsoft.Json 13.0.3
- TiktokenSharp 1.0.9