https://github.com/huggingface/xet-core

huggingface-hub rust storage xet

Score: 25.0078842437891

Last synced: about 5 hours ago
JSON representation

Repository metadata:

xet client tech, used in huggingface_hub

Host: GitHub
URL: https://github.com/huggingface/xet-core
Owner: huggingface
License: apache-2.0
Created: 2024-09-10T20:57:29.000Z (almost 2 years ago)
Default Branch: main
Last Pushed: 2026-06-01T23:43:35.000Z (14 days ago)
Last Synced: 2026-06-02T01:15:50.968Z (14 days ago)
Topics: huggingface-hub, rust, storage, xet
Language: Rust
Homepage:
Size: 7.22 MB
Stars: 498
Watchers: 10
Forks: 76
Open Issues: 28
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md

Owner metadata:

Name: Hugging Face
Login: huggingface
Email:
Kind: organization
Description: The AI community building the future.
Website: https://huggingface.co/
Location: NYC + Paris
Twitter: huggingface
Company:
Icon url: https://avatars.githubusercontent.com/u/25720743?v=4
Repositories: 370
Last Synced at: 2025-11-13T02:39:46.174Z
Profile URL: https://github.com/huggingface

Package metadata

Total packages: 14
Total downloads:
- pypi: 137,029,604 last-month
- cargo: 176,764 total
- conda: 1,691 total
- homebrew: 791 last-month
Total docker downloads: 766,135
Total dependent packages: 0 (may contain duplicates)
Total dependent repositories: 0 (may contain duplicates)
Total versions: 181
Total maintainers: 8

proxy.golang.org: github.com/huggingface/xet-core

Homepage:
Documentation: https://pkg.go.dev/github.com/huggingface/xet-core#section-documentation
Licenses:
Latest release: v1.4.3 (published 3 months ago)
Last Synced: 2026-06-07T07:48:19.847Z (9 days ago)
Versions: 77
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent packages count: 4.881%
- Average: 5.045%
- Dependent repos count: 5.209%

crates.io: hf-xet

Client library and tooling for the Hugging Face Xet data storage system.

Homepage: https://github.com/huggingface/xet-core
Documentation: https://docs.rs/hf-xet/
Licenses: Apache-2.0
Latest release: 1.5.2 (published about 2 months ago)
Last Synced: 2026-05-23T07:32:33.936Z (24 days ago)
Versions: 4
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 117,980 Total
Rankings:
- Downloads: 15.079%
- Dependent repos count: 15.496%
- Average: 17.014%
- Dependent packages count: 20.469%
Maintainers (2)
- assafvayner
- seanses

spack.io: py-hf-xet

Fast transfer of large files with the Hugging Face Hub.

Homepage: https://github.com/huggingface/xet-core
Licenses: []
Latest release: 1.4.3 (published 23 days ago)
Last Synced: 2026-05-24T12:08:53.550Z (23 days ago)
Versions: 2
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent repos count: 0.0%
- Average: 27.337%
- Dependent packages count: 54.674%

pypi.org: hf-xet

Fast transfer of large files with the Hugging Face Hub.

Homepage: https://github.com/huggingface/xet-core
Documentation: https://huggingface.co/docs/hub/xet/index
Licenses: Apache Software License
Latest release: 1.5.0 (published about 1 month ago)
Last Synced: 2026-05-11T03:18:02.989Z (about 1 month ago)
Versions: 79
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 137,029,604 Last month
Docker Downloads: 766,135
Rankings:
- Dependent packages count: 9.783%
- Average: 32.425%
- Dependent repos count: 55.067%
Maintainers (4)
- chaumond
- hf-xet
- rajatarya1
- seanses

formulae.brew.sh: git-xet

Git LFS plugin that uploads and downloads using the Xet protocol

Homepage: https://github.com/huggingface/xet-core
Licenses: Apache-2.0
Latest release: 0.2.1 (published 4 months ago)
Last Synced: 2026-05-07T03:31:06.339Z (about 1 month ago)
Versions: 2
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 791 Last month
Rankings:
- Dependent packages count: 15.353%
- Average: 33.575%
- Downloads: 40.696%
- Dependent repos count: 44.676%

crates.io: xet-client

Client library for communicating with Hugging Face Xet storage servers. Use through the hf-xet crate.

Homepage: https://github.com/huggingface/xet-core
Documentation: https://docs.rs/xet-client/
Licenses: Apache-2.0
Latest release: 1.5.1 (published 2 months ago)
Last Synced: 2026-05-11T23:04:04.610Z (about 1 month ago)
Versions: 3
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 441 Total
Rankings:
- Dependent repos count: 15.91%
- Dependent packages count: 21.016%
- Average: 38.287%
- Downloads: 77.936%
Maintainers (2)
- assafvayner
- seanses

crates.io: xet-data

Placeholder – see repository

Homepage:
Documentation: https://docs.rs/xet-data/
Licenses: Apache-2.0
Latest release: 0.0.0 (published 3 months ago)
Last Synced: 2026-05-07T21:02:40.180Z (about 1 month ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 10 Total
Rankings:
- Dependent repos count: 16.069%
- Dependent packages count: 21.227%
- Average: 42.831%
- Downloads: 91.196%
Maintainers (1)
- assafvayner

crates.io: xet-runtime

Async runtime, configuration, logging, and utility infrastructure for the Hugging Face Xet client tools.

Homepage: https://github.com/huggingface/xet-core
Documentation: https://docs.rs/xet-runtime/
Licenses: Apache-2.0
Latest release: 1.5.1 (published 2 months ago)
Last Synced: 2026-05-11T23:04:04.772Z (about 1 month ago)
Versions: 3
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 443 Total
Rankings:
- Dependent repos count: 16.069%
- Dependent packages count: 21.227%
- Average: 42.831%
- Downloads: 91.196%
Maintainers (2)
- assafvayner
- seanses

crates.io: xet-core-structures

Core data structures including MerkleHash, metadata shards, and Xorb objects.

Homepage: https://github.com/huggingface/xet-core
Documentation: https://docs.rs/xet-core-structures/
Licenses: Apache-2.0
Latest release: 1.5.2 (published about 2 months ago)
Last Synced: 2026-05-10T12:13:56.168Z (about 1 month ago)
Versions: 4
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 57,890 Total
Rankings:
- Dependent repos count: 16.069%
- Dependent packages count: 21.227%
- Average: 42.831%
- Downloads: 91.196%
Maintainers (2)
- assafvayner
- seanses

xet-core enables huggingface_hub to utilize xet storage for uploading and downloading to HF Hub. Xet storage provides chunk-based deduplication, efficient storage/retrieval with local disk caching, and backwards compatibility with Git LFS. This library is not meant to be used directly, and is instead intended to be used from huggingface_hub. hf_xet - Python integration with Rust code, uses maturin to build hfxet Python package. Main integration with HF Hub Python package.

Homepage: https://github.com/huggingface/xet-core
Licenses: Apache-2.0
Latest release: 1.2.0 (published 5 months ago)
Last Synced: 2026-03-27T08:14:25.223Z (3 months ago)
Versions: 2
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 1,691 Total
Rankings:
- Dependent packages count: 42.313%
- Average: 44.416%
- Dependent repos count: 46.519%

nixpkgs-unstable: git-xet

Git LFS plugin that uploads and downloads using the Xet protocol

Homepage: https://github.com/huggingface/xet-core/blob/main/git_xet/README.md
Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-unstable/pkgs/by-name/gi/git-xet/package.nix#L51
Licenses: Apache-2.0
Latest release: 0.2.0 (published 5 months ago)
Last Synced: 2026-03-26T11:10:20.300Z (3 months ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%
Maintainers (1)
- cybardev

nixpkgs-unstable: python314Packages.hf-xet

Xet client tech, used in huggingface_hub

Homepage: https://github.com/huggingface/xet-core/tree/main/hf_xet
Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-unstable/pkgs/development/python-modules/hf-xet/default.nix#L52
Licenses: Apache-2.0
Latest release: 1.2.0 (published 5 months ago)
Last Synced: 2026-03-07T12:29:30.559Z (3 months ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%
Maintainers (1)
- GaetanLepage

gentoo-portage: sci-ml/hf_xet

xet client tech, used in huggingface_hub

Homepage: https://github.com/huggingface/xet-core
Documentation: https://packages.gentoo.org/packages/sci-ml/hf_xet
Licenses: Apache-2.0 Apache-2.0 Apache-2.0-with-LLVM-exceptions BSD-2 BSD CDDL CDLA-Permissive-2.0 ISC MIT MPL-2.0 Unicode-3.0
Latest release: 1.2.0 (published about 1 month ago)
Last Synced: 2026-05-27T04:28:47.610Z (20 days ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%

nixpkgs-unstable: python313Packages.hf-xet

Xet client tech, used in huggingface_hub

Homepage: https://github.com/huggingface/xet-core/tree/main/hf_xet
Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-unstable/pkgs/development/python-modules/hf-xet/default.nix#L52
Licenses: Apache-2.0
Latest release: 1.2.0 (published 5 months ago)
Last Synced: 2026-05-13T14:09:00.040Z (about 1 month ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%
Maintainers (1)
- GaetanLepage

ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Summary