awesome-llama: https://github.com/ggml-org/llama.cpp
ggml
Score: 34.73599435190709
Last synced: about 5 hours ago
JSON representation
Repository metadata:
LLM inference in C/C++
- Host: GitHub
- URL: https://github.com/ggml-org/llama.cpp
- Owner: ggml-org
- License: mit
- Created: 2023-03-10T18:58:00.000Z (about 3 years ago)
- Default Branch: master
- Last Pushed: 2026-05-30T21:49:31.000Z (3 days ago)
- Last Synced: 2026-05-30T22:21:29.812Z (3 days ago)
- Topics: ggml
- Language: C++
- Homepage: https://llama.app
- Size: 385 MB
- Stars: 113,848
- Watchers: 739
- Forks: 18,962
- Open Issues: 1,726
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Codeowners: CODEOWNERS
- Security: SECURITY.md
- Authors: AUTHORS
- Agents: AGENTS.md
Owner metadata:
- Name: ggml-org
- Login: ggml-org
- Email:
- Kind: organization
- Description:
- Website:
- Location:
- Twitter:
- Company:
- Icon url: https://avatars.githubusercontent.com/u/134263123?v=4
- Repositories: 1
- Last Synced at: 2023-05-22T12:30:08.047Z
- Profile URL: https://github.com/ggml-org
GitHub Events
Total
- Commit comment event: 24
- Create event: 1069
- Delete event: 269
- Fork event: 1651
- Gollum event: 4
- Issue comment event: 8753
- Issues event: 1768
- Member event: 13
- Pull request event: 2485
- Pull request review comment event: 3039
- Pull request review event: 3846
- Push event: 1754
- Release event: 752
- Watch event: 8945
- Total: 34372
Last Year
- Commit comment event: 24
- Create event: 1069
- Delete event: 269
- Fork event: 1651
- Gollum event: 4
- Issue comment event: 8753
- Issues event: 1768
- Member event: 13
- Pull request event: 2485
- Pull request review comment event: 3039
- Pull request review event: 3846
- Push event: 1754
- Release event: 752
- Watch event: 8945
- Total: 34372
Committers metadata
Last synced: 7 days ago
Total Commits: 9,340
Total Committers: 1,629
Avg Commits per committer: 5.734
Development Distribution Score (DDS): 0.81
Commits in past year: 3,850
Committers in past year: 659
Avg Commits per committer in past year: 5.842
Development Distribution Score (DDS) in past year: 0.861
| Name | Commits | |
|---|---|---|
| Georgi Gerganov | g****v@g****m | 1771 |
| Xuan-Son Nguyen | s****n@h****o | 441 |
| Johannes Gäßler | j****g@5****e | 380 |
| slaren | s****h@g****m | 362 |
| Sigbjørn Skjæret | s****t@s****m | 284 |
| Jeff Bolz | j****z@n****m | 278 |
| Daniel Bevenius | d****s@g****m | 258 |
| Aman Gupta | a****2@g****m | 123 |
| Adrien Gallouët | a****t@h****o | 122 |
| 0cc4m | p****2@l****e | 106 |
| Cebtenzzre | c****e@g****m | 101 |
| Kawrakow | 4****w | 100 |
| Aleksander Grygier | a****r@g****m | 90 |
| Olivier Chafik | o****k | 76 |
| Piotr Wilkin (ilintar) | p****n@s****m | 71 |
| lhez | l****h@q****m | 71 |
| Pascal | a****n@s****m | 64 |
| Radoslav Gerganov | r****v@g****m | 62 |
| compilade | g****t@c****t | 62 |
| Pierrick Hymbert | p****t@g****m | 58 |
| Aldehir Rojas | h****o@a****v | 52 |
| Aaron Teo | a****1@i****m | 51 |
| R0CKSTAR | x****e@m****m | 49 |
| Eve | 1****e | 45 |
| Neo Zhang Jianyu | j****g@i****m | 45 |
| Akarshan Biswas | a****n@m****i | 43 |
| Kerfuffle | 4****2 | 42 |
| Chenguang Li | 7****8@q****m | 40 |
| Neo Zhang | z****u@o****m | 38 |
| Reese Levine | r****1@g****m | 37 |
| and 1599 more... | ||
Issue and Pull Request metadata
Last synced: 5 days ago
Total issues: 1,526
Total pull requests: 3,020
Average time to close issues: about 1 month
Average time to close pull requests: 7 days
Total issue authors: 1,033
Total pull request authors: 573
Average comments per issue: 3.28
Average comments per pull request: 2.62
Merged pull request: 1,680
Bot issues: 0
Bot pull requests: 1
Past year issues: 642
Past year pull requests: 1,321
Past year average time to close issues: 22 days
Past year average time to close pull requests: 3 days
Past year issue authors: 495
Past year pull request authors: 321
Past year average comments per issue: 2.57
Past year average comments per pull request: 2.25
Past year merged pull request: 646
Past year bot issues: 0
Past year bot pull requests: 0
Top Issue Authors
- gnusupport (22)
- ngxson (19)
- ggerganov (18)
- yurivict (16)
- Bobchenyx (14)
- pwilkin (11)
- 0wwafa (9)
- taronaeo (9)
- nickhuang99 (9)
- MaoJianwei (9)
- steampunque (7)
- createthis (6)
- jacekpoplawski (6)
- ExtReMLapin (6)
- domasofan (6)
Top Pull Request Authors
- ggerganov (366)
- ngxson (214)
- CISC (169)
- jeffbolznv (142)
- JohannesGaessler (106)
- slaren (71)
- danbev (69)
- yeahdongcn (55)
- ochafik (48)
- lhez (46)
- qnixsynapse (45)
- am17an (40)
- taronaeo (35)
- noemotiovon (30)
- compilade (28)
Top Issue Labels
- bug-unconfirmed (972)
- stale (466)
- enhancement (249)
- bug (55)
- server/webui (21)
- good first issue (21)
- build (13)
- help wanted (11)
- Vulkan (10)
- model (10)
- research 🔬 (8)
- duplicate (8)
- question (7)
- wontfix (6)
- need more info (5)
- roadmap (5)
- hardware (4)
- Ascend NPU (4)
- performance (4)
- Nvidia GPU (4)
- refactoring (3)
- AMD GPU (3)
- tts (3)
- ggml (2)
- documentation (2)
- server (2)
- 🦙. (2)
- Apple Metal (2)
- testing (2)
- windows (2)
Top Pull Request Labels
- ggml (991)
- examples (638)
- python (338)
- server (283)
- Nvidia GPU (245)
- testing (233)
- Vulkan (224)
- devops (193)
- SYCL (138)
- documentation (113)
- Apple Metal (107)
- script (71)
- Ascend NPU (57)
- build (40)
- OpenCL (29)
- bugfix (13)
- android (12)
- nix (10)
- Review Complexity : Medium (9)
- hot (8)
- breaking change (8)
- enhancement (6)
- help wanted (6)
- Kompute (6)
- model (5)
- demo (5)
- performance (5)
- Review Complexity : Low (5)
- tool calling (5)
- merge ready (4)
Package metadata
- Total packages: 26
-
Total downloads:
- conda: 8,828 total
- pypi: 6,424,148 last-month
- homebrew: 36,393 last-month
- Total docker downloads: 40
- Total dependent packages: 5 (may contain duplicates)
- Total dependent repositories: 56 (may contain duplicates)
- Total versions: 3,209
- Total maintainers: 10
pypi.org: gguf
Read and write ML models in GGUF for GGML
- Homepage: https://ggml.ai
- Documentation: https://gguf.readthedocs.io/
- Licenses: MIT License
- Latest release: 0.19.0 (published 27 days ago)
- Last Synced: 2026-05-26T01:01:55.612Z (8 days ago)
- Versions: 26
- Dependent Packages: 5
- Dependent Repositories: 56
- Downloads: 6,424,011 Last month
- Docker Downloads: 40
-
Rankings:
- Stargazers count: 0.023%
- Forks count: 0.075%
- Downloads: 1.859%
- Dependent repos count: 1.975%
- Average: 2.889%
- Docker downloads count: 3.297%
- Dependent packages count: 10.105%
- Maintainers (1)
proxy.golang.org: github.com/ggml-org/llama.cpp
- Homepage:
- Documentation: https://pkg.go.dev/github.com/ggml-org/llama.cpp#section-documentation
- Licenses: mit
- Latest release: v3.3.0+incompatible (published over 2 years ago)
- Last Synced: 2026-05-26T01:02:06.875Z (8 days ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent packages count: 5.522%
- Average: 5.707%
- Dependent repos count: 5.892%
alpine-edge: llama-server-openrc
llama.cpp server (OpenRC init scripts)
- Homepage: https://github.com/ggml-org/llama.cpp
- Licenses: MIT
- Latest release: 0.0.9006-r0 (published 29 days ago)
- Last Synced: 2026-05-04T05:48:29.682Z (29 days ago)
- Versions: 2
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Average: 6.048%
- Dependent packages count: 12.096%
- Maintainers (1)
alpine-edge: llama-server
llama.cpp server
- Homepage: https://github.com/ggml-org/llama.cpp
- Licenses: MIT
- Latest release: 0.0.9006-r0 (published 29 days ago)
- Last Synced: 2026-05-04T05:48:27.976Z (29 days ago)
- Versions: 2
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Average: 6.048%
- Dependent packages count: 12.096%
- Maintainers (1)
alpine-edge: llama.cpp-libs
LLM inference in C/C++ (with Vulkan GPU acceleration) (shared libraries)
- Homepage: https://github.com/ggml-org/llama.cpp
- Licenses: MIT
- Latest release: 0.0.9006-r0 (published 29 days ago)
- Last Synced: 2026-05-04T05:48:25.781Z (29 days ago)
- Versions: 2
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Average: 6.048%
- Dependent packages count: 12.096%
- Maintainers (1)
alpine-edge: llama.cpp-vulkan
LLM inference in C/C++ (with Vulkan GPU acceleration)
- Homepage: https://github.com/ggml-org/llama.cpp
- Licenses: MIT
- Latest release: 0.0.9006-r0 (published 29 days ago)
- Last Synced: 2026-05-04T05:48:26.945Z (29 days ago)
- Versions: 7
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Average: 6.121%
- Dependent packages count: 12.242%
- Maintainers (1)
alpine-edge: llama.cpp-extras
llama.cpp additional binaries
- Homepage: https://github.com/ggml-org/llama.cpp
- Licenses: MIT
- Latest release: 0.0.9006-r0 (published 29 days ago)
- Last Synced: 2026-05-04T05:48:24.812Z (29 days ago)
- Versions: 7
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Average: 6.121%
- Dependent packages count: 12.242%
- Maintainers (1)
alpine-edge: llama.cpp-dev
LLM inference in C/C++ (with Vulkan GPU acceleration) (development files)
- Homepage: https://github.com/ggml-org/llama.cpp
- Licenses: MIT
- Latest release: 0.0.9006-r0 (published 29 days ago)
- Last Synced: 2026-05-04T05:48:23.958Z (29 days ago)
- Versions: 7
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Average: 6.121%
- Dependent packages count: 12.242%
- Maintainers (1)
alpine-edge: llama.cpp-cpu
LLM inference in C/C++ (with Vulkan GPU acceleration)
- Homepage: https://github.com/ggml-org/llama.cpp
- Licenses: MIT
- Latest release: 0.0.9006-r0 (published 29 days ago)
- Last Synced: 2026-05-04T05:48:23.062Z (29 days ago)
- Versions: 7
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Average: 6.121%
- Dependent packages count: 12.242%
- Maintainers (1)
alpine-edge: llama.cpp
LLM inference in C/C++ (with Vulkan GPU acceleration)
- Homepage: https://github.com/ggml-org/llama.cpp
- Licenses: MIT
- Latest release: 0.0.9006-r0 (published 29 days ago)
- Last Synced: 2026-05-04T05:48:21.882Z (29 days ago)
- Versions: 7
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Average: 6.121%
- Dependent packages count: 12.242%
- Maintainers (1)
alpine-edge: llama.cpp-openrc
LLM inference in C/C++ (with Vulkan GPU acceleration) (OpenRC init scripts)
- Homepage: https://github.com/ggml-org/llama.cpp
- Licenses: MIT
- Latest release: 0.0.8871-r0 (published about 1 month ago)
- Last Synced: 2026-04-21T21:31:24.738Z (about 1 month ago)
- Versions: 5
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Average: 6.121%
- Dependent packages count: 12.242%
- Maintainers (1)
swiftpackageindex.com: github.com/ggml-org/llama.cpp
LLM inference in C/C++
- Homepage:
- Documentation: https://swiftpackageindex.com/ggml-org/llama.cpp/documentation
- Licenses: mit
- Latest release: b9282 (published 12 days ago)
- Last Synced: 2026-05-26T01:09:11.140Z (8 days ago)
- Versions: 2,665
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent packages count: 16.922%
- Average: 20.383%
- Dependent repos count: 23.845%
pypi.org: pyllama-server
Python wrapper for llama.cpp server - OpenAI API compatible backend with auto device detection
- Homepage: https://github.com/ggml-org/llama.cpp
- Documentation: https://github.com/ggml-org/llama.cpp/tree/master/tools/server
- Licenses: MIT
- Latest release: 0.1.0 (published 3 months ago)
- Last Synced: 2026-05-26T01:02:00.935Z (8 days ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 137 Last month
-
Rankings:
- Dependent packages count: 7.609%
- Average: 26.238%
- Downloads: 28.079%
- Dependent repos count: 43.027%
- Maintainers (1)
spack.io: llama-cpp
LLM inference in C/C++
- Homepage: https://github.com/ggml-org/llama.cpp
- Licenses: []
- Latest release: (published 8 days ago)
- Last Synced: 2026-05-26T01:01:48.013Z (8 days ago)
- Versions: 0
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Average: 26.46%
- Dependent packages count: 52.921%
- Maintainers (1)
formulae.brew.sh: llama.cpp
LLM inference in C/C++
- Homepage: https://github.com/ggml-org/llama.cpp
- Licenses: MIT
- Latest release: 9310 (published 8 days ago)
- Last Synced: 2026-05-26T01:02:01.778Z (8 days ago)
- Versions: 404
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 36,393 Last month
-
Rankings:
- Dependent packages count: 19.125%
- Average: 38.226%
- Downloads: 40.191%
- Dependent repos count: 55.362%
anaconda.org: gguf
Read and write ML models in GGUF for GGML
- Homepage: https://ggml.ai
- Licenses: MIT
- Latest release: 0.18.0.8994 (published 29 days ago)
- Last Synced: 2026-05-04T19:07:13.435Z (29 days ago)
- Versions: 11
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 2,217 Total
-
Rankings:
- Dependent packages count: 42.572%
- Average: 44.687%
- Dependent repos count: 46.803%
anaconda.org: llama.cpp
Server example and tools for llama.cpp, using libllama
- Homepage: https://github.com/ggml-org/llama.cpp
- Licenses: MIT
- Latest release: 0.0.8994 (published 29 days ago)
- Last Synced: 2026-05-04T19:07:43.094Z (29 days ago)
- Versions: 11
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 1,335 Total
-
Rankings:
- Dependent packages count: 42.572%
- Average: 44.687%
- Dependent repos count: 46.803%
anaconda.org: llama.cpp-tests
Test executables for llama.cpp
- Homepage: https://github.com/ggml-org/llama.cpp
- Licenses: MIT
- Latest release: 0.0.8994 (published 29 days ago)
- Last Synced: 2026-05-04T19:07:45.205Z (29 days ago)
- Versions: 10
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 1,222 Total
-
Rankings:
- Dependent packages count: 42.572%
- Average: 44.687%
- Dependent repos count: 46.803%
anaconda.org: llama.cpp-tools
Scripts and conversion tools that ship with llama.cpp, including model vocabulary files and templates
- Homepage: https://github.com/ggml-org/llama.cpp
- Licenses: MIT
- Latest release: 0.0.8994 (published 29 days ago)
- Last Synced: 2026-05-04T19:07:50.490Z (29 days ago)
- Versions: 11
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 2,937 Total
-
Rankings:
- Dependent packages count: 42.572%
- Average: 44.687%
- Dependent repos count: 46.803%
anaconda.org: libllama
Inference of Meta's LLaMA model (and others) in pure C/C++
- Homepage: https://github.com/ggml-org/llama.cpp
- Licenses: MIT
- Latest release: 0.0.8994 (published 29 days ago)
- Last Synced: 2026-05-04T19:07:39.714Z (29 days ago)
- Versions: 10
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 1,117 Total
-
Rankings:
- Dependent packages count: 42.572%
- Average: 44.687%
- Dependent repos count: 46.803%
nixpkgs-unstable: llama-cpp-rocm
Inference of Meta's LLaMA model (and others) in pure C/C++
- Homepage: https://github.com/ggml-org/llama.cpp
- Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-unstable/pkgs/by-name/ll/llama-cpp/package.nix#L211
- Licenses: MIT
- Latest release: 8124 (published 3 months ago)
- Last Synced: 2026-04-07T19:01:39.490Z (about 2 months ago)
- Versions: 3
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%
- Maintainers (5)
guix: llama-cpp
Port of Facebook's LLaMA model in C/C++
- Homepage: https://github.com/ggml-org/llama.cpp
- Documentation: https://git.savannah.gnu.org/cgit/guix.git/tree/gnu/packages/machine-learning.scm#n840
- Licenses:
- Latest release: 0.0.0-b8445 (published 2 months ago)
- Last Synced: 2026-04-27T17:04:24.199Z (about 1 month ago)
- Versions: 2
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%
guix: llama-cpp-scripts
Scripts that ship with @code{llama.cpp}
- Homepage: https://github.com/ggml-org/llama.cpp
- Documentation: https://git.savannah.gnu.org/cgit/guix.git/tree/gnu/packages/machine-learning.scm#n935
- Licenses: expat
- Latest release: 0.0.0 (published 10 days ago)
- Last Synced: 2026-05-23T11:31:18.066Z (10 days ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%
nixpkgs-unstable: llama-cpp-vulkan
Inference of Meta's LLaMA model (and others) in pure C/C++
- Homepage: https://github.com/ggml-org/llama.cpp
- Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-unstable/pkgs/by-name/ll/llama-cpp/package.nix#L211
- Licenses: MIT
- Latest release: 8124 (published 3 months ago)
- Last Synced: 2026-04-08T01:06:30.882Z (about 2 months ago)
- Versions: 3
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%
- Maintainers (5)
nixpkgs-unstable: llama-cpp
Inference of Meta's LLaMA model (and others) in pure C/C++
- Homepage: https://github.com/ggml-org/llama.cpp
- Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-unstable/pkgs/by-name/ll/llama-cpp/package.nix#L211
- Licenses: MIT
- Latest release: 8124 (published 3 months ago)
- Last Synced: 2026-04-08T01:06:30.833Z (about 2 months ago)
- Versions: 3
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%
- Maintainers (5)
openbsd-7.9-amd64: misc/llama.cpp
LLM inference system
- Homepage: https://github.com/ggml-org/llama.cpp
- Licenses:
- Latest release: 0.0.8631 (published about 1 month ago)
- Last Synced: 2026-05-28T02:16:34.193Z (6 days ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%
- Maintainers (1)
Dependencies
.github/workflows/build.yml
actions
- actions/checkout v1 composite
- actions/download-artifact v3 composite
- actions/github-script v3 composite
- actions/upload-artifact v3 composite
- anzz1/action-create-release v1 composite
- pr-mpt/actions-commit-hash v2 composite
.github/workflows/docker.yml
actions
- actions/checkout v3 composite
- docker/build-push-action v4 composite
- docker/login-action v2 composite
- docker/setup-buildx-action v2 composite
- docker/setup-qemu-action v2 composite
.github/workflows/editorconfig.yml
actions
- actions/checkout v3 composite
- editorconfig-checker/action-editorconfig-checker main composite
.github/workflows/gguf-publish.yml
actions
- actions/checkout v3 composite
- actions/setup-python v2 composite
- pypa/gh-action-pypi-publish release/v1 composite
gguf-py/pyproject.toml
pypi
- pytest ^5.2 develop
- numpy >=1.17
- python >=3.8
requirements.txt
pypi
- gguf >=0.1.0
- numpy ==1.24
- sentencepiece ==0.1.98
.github/workflows/build-linux-cross.yml
actions
- ./.github/actions/linux-setup-spacemit * composite
- actions/cache v4 composite
- actions/checkout v4 composite
examples/batched.swift/Package.swift
swiftpm
.github/actions/linux-setup-vulkan/action.yml
actions
- ./.github/actions/unarchive-tar * composite
.github/workflows/build-cache.yml
actions
- ./.github/actions/linux-setup-spacemit * composite
- ./.github/actions/linux-setup-vulkan * composite
- ./.github/actions/windows-setup-rocm * composite
- actions/cache v4 composite
- actions/checkout v4 composite
.github/workflows/python-lint.yml
actions
- actions/checkout v4 composite
- actions/setup-python v5 composite
- py-actions/flake8 v2 composite
.github/actions/install-exe/action.yml
actions
.github/actions/windows-setup-rocm/action.yml
actions
- ./.github/actions/install-exe * composite
.github/workflows/winget.yml
actions
- actions/github-script v6 composite
- cargo-bins/cargo-binstall 268643a6b5ea099f5718ee5cd3ff7dc89a5eb49b composite
examples/llama.android/app/build.gradle.kts
maven
examples/llama.android/lib/build.gradle.kts
maven
poetry.lock
pypi
- atomicwrites 1.4.1
- attrs 23.2.0
- certifi 2024.2.2
- charset-normalizer 3.3.2
- colorama 0.4.6
- filelock 3.13.1
- fsspec 2024.2.0
- gguf 0.7.0
- huggingface-hub 0.20.3
- idna 3.6
- jinja2 3.1.3
- markupsafe 2.1.5
- more-itertools 10.2.0
- mpmath 1.3.0
- networkx 3.2.1
- numpy 1.26.4
- packaging 23.2
- pluggy 0.13.1
- protobuf 4.25.3
- py 1.11.0
- pytest 5.4.3
- pyyaml 6.0.1
- regex 2023.12.25
- requests 2.31.0
- safetensors 0.4.2
- sentencepiece 0.1.99
- sympy 1.12
- tokenizers 0.15.2
- torch 2.2.1+cpu
- tqdm 4.66.2
- transformers 4.38.1
- typing-extensions 4.9.0
- urllib3 2.2.1
- wcwidth 0.2.13
pyproject.toml
pypi
- pytest ^5.2 develop
- gguf *
- numpy ^1.25.0
- protobuf >=4.21.0,<5.0.0
- python >=3.9
- sentencepiece >=0.1.98,<=0.2.0
- torch ^2.2.0
- transformers >=4.35.2,<5.0.0
requirements/requirements-convert_hf_to_gguf.txt
pypi
- torch *
- torch >=0.0.0.dev0
.github/actions/windows-setup-curl/action.yml
actions
.github/workflows/bench.yml.disabled
actions
- Sibz/github-status-action v1 composite
- actions/checkout v4 composite
- actions/setup-go v5 composite
- actions/upload-artifact v4 composite
- devicons/public-upload-to-imgur v2.2.2 composite
- mshick/add-pr-comment v2 composite
.github/workflows/check-vendor.yml
actions
- actions/checkout v4 composite
- actions/setup-python v4 composite
requirements/requirements-convert_lora_to_gguf.txt
pypi
.github/actions/get-tag-name/action.yml
actions
.github/actions/linux-setup-spacemit/action.yml
actions
- ./.github/actions/unarchive-tar * composite
.github/actions/unarchive-tar/action.yml
actions
.github/workflows/close-issue.yml
actions
- actions/stale v5 composite
requirements/requirements-compare-llama-bench.txt
pypi
- GitPython *
- matplotlib *
- tabulate *
requirements/requirements-convert_llama_ggml_to_gguf.txt
pypi
tools/mtmd/requirements.txt
pypi
- pillow *
- torch *
- torchvision *
.github/workflows/build-cmake-pkg.yml
actions
- actions/checkout v4 composite
.github/workflows/labeler.yml
actions
- actions/checkout v4 composite
- actions/labeler v5 composite
.github/workflows/server.yml
actions
- actions/checkout v4 composite
- actions/setup-python v5 composite
examples/gguf-hash/deps/sha1/package.json
npm
examples/gguf-hash/deps/sha256/package.json
npm
- jb55/rotate-bits.h 0.1.1
.github/workflows/copilot-setup-steps.yml
actions
- actions/checkout v4 composite
- actions/setup-python v5 composite
- ggml-org/ccache-action v1.2.16 composite
.github/workflows/release.yml
actions
- ./.github/actions/get-tag-name * composite
- ./.github/actions/windows-setup-cuda * composite
- ./.github/actions/windows-setup-curl * composite
- actions/cache v4 composite
- actions/checkout v4 composite
- actions/download-artifact v4 composite
- actions/github-script v3 composite
- actions/upload-artifact v4 composite
- ggml-org/action-create-release v1 composite
- ggml-org/ccache-action v1.2.16 composite
- ggml-org/free-disk-space v1.3.1 composite
requirements/requirements-all.txt
pypi
scripts/jinja/requirements.txt
pypi
- PySide6 *
- jinja2 *
requirements/requirements-convert_legacy_llama.txt
pypi
- gguf >=0.1.0
- numpy *
- protobuf >=4.21.0,<5.0.0
- sentencepiece *
- transformers >=4.57.1,<5.0.0
.github/workflows/update-ops-docs.yml
actions
- actions/checkout v4 composite
- actions/setup-python v5 composite
requirements/requirements-test-tokenizer-random.txt
pypi
- cffi * test
requirements/requirements-tool_bench.txt
pypi
- aiohttp *
- huggingface_hub >=0.34.0,<1.0
- matplotlib *
- numpy *
- openai *
- pandas *
- prometheus-client *
- pytest *
- requests *
- seaborn *
- typer *
- wget *
tools/server/tests/requirements.txt
pypi
- aiohttp * test
- huggingface_hub >=0.34.0,<1.0 test
- numpy * test
- openai * test
- prometheus-client * test
- pytest * test
- requests * test
- wget * test
scripts/snapdragon/qdc/requirements.txt
pypi
- Appium-Python-Client ==5.2.4
- PySocks ==1.7.1
- Pygments ==2.19.2
- attrs ==25.4.0
- certifi ==2025.10.5
- exceptiongroup ==1.3.0
- h11 ==0.16.0
- idna ==3.11
- iniconfig ==2.1.0
- outcome ==1.3.0.post0
- packaging ==25.0
- pluggy ==1.6.0
- pytest ==8.4.2
- pytest-dependency ==0.6.0
- selenium ==4.36.0
- setuptools ==80.9.0
- sniffio ==1.3.1
- sortedcontainers ==2.4.0
- tomli ==2.3.0
- trio ==0.31.0
- trio-websocket ==0.12.2
- typing_extensions ==4.15.0
- urllib3 ==2.5.0
- websocket-client ==1.9.0
- wsproto ==1.2.0
.github/workflows/python-check-requirements.yml
actions
- actions/checkout v4 composite
- actions/setup-python v5 composite
tools/server/webui/package-lock.json
npm
- 621 dependencies
tools/server/bench/requirements.txt
pypi
- matplotlib *
- requests *
.github/actions/windows-setup-cuda/action.yml
actions
.github/workflows/server-webui.yml
actions
- actions/checkout v4 composite
- actions/setup-node v4 composite
- actions/setup-python v5 composite
requirements/requirements-convert_hf_to_gguf_update.txt
pypi
requirements/requirements-pydantic.txt
pypi
- docstring_parser *
- pydantic *
- requests *
requirements/requirements-server-bench.txt
pypi
- datasets *
- matplotlib *
- numpy *
- requests *
- tqdm *
tools/server/webui/package.json
npm
- @chromatic-com/storybook ^4.1.2 development
- @eslint/compat ^1.2.5 development
- @eslint/js ^9.18.0 development
- @internationalized/date ^3.10.1 development
- @lucide/svelte ^0.515.0 development
- @playwright/test ^1.49.1 development
- @storybook/addon-a11y ^10.0.7 development
- @storybook/addon-docs ^10.0.7 development
- @storybook/addon-svelte-csf ^5.0.10 development
- @storybook/addon-vitest ^10.0.7 development
- @storybook/sveltekit ^10.0.7 development
- @sveltejs/adapter-static ^3.0.10 development
- @sveltejs/kit ^2.48.4 development
- @sveltejs/vite-plugin-svelte ^6.2.1 development
- @tailwindcss/forms ^0.5.9 development
- @tailwindcss/typography ^0.5.15 development
- @tailwindcss/vite ^4.0.0 development
- @types/node ^22 development
- @vitest/browser ^3.2.3 development
- bits-ui ^2.14.4 development
- clsx ^2.1.1 development
- dexie ^4.0.11 development
- eslint ^9.18.0 development
- eslint-config-prettier ^10.0.1 development
- eslint-plugin-storybook ^10.0.7 development
- eslint-plugin-svelte ^3.0.0 development
- fflate ^0.8.2 development
- globals ^16.0.0 development
- http-server ^14.1.1 development
- mdast ^3.0.0 development
- mdsvex ^0.12.3 development
- playwright ^1.56.1 development
- prettier ^3.4.2 development
- prettier-plugin-svelte ^3.3.3 development
- prettier-plugin-tailwindcss ^0.6.11 development
- rehype-katex ^7.0.1 development
- remark-math ^6.0.0 development
- sass ^1.93.3 development
- storybook ^10.0.7 development
- svelte ^5.0.0 development
- svelte-check ^4.0.0 development
- tailwind-merge ^3.3.1 development
- tailwind-variants ^3.2.2 development
- tailwindcss ^4.0.0 development
- tw-animate-css ^1.3.5 development
- typescript ^5.0.0 development
- typescript-eslint ^8.20.0 development
- unified ^11.0.5 development
- uuid ^13.0.0 development
- vite ^7.2.2 development
- vite-plugin-devtools-json ^0.2.0 development
- vitest ^3.2.3 development
- vitest-browser-svelte ^0.1.0 development
- highlight.js ^11.11.1
- mode-watcher ^1.1.0
- pdfjs-dist ^5.4.54
- rehype-highlight ^7.0.2
- rehype-stringify ^10.0.1
- remark ^15.0.1
- remark-breaks ^4.0.0
- remark-gfm ^4.0.1
- remark-html ^16.0.1
- remark-rehype ^11.1.2
- svelte-sonner ^1.0.5
- unist-util-visit ^5.0.0
examples/model-conversion/requirements.txt
pypi
- accelerate *
- huggingface-hub *
- sentence-transformers *
- torch *
- torchvision *
- transformers *
.github/workflows/pre-tokenizer-hashes.yml
actions
- actions/checkout v4 composite
- actions/setup-python v5 composite
.github/workflows/python-type-check.yml
actions
- actions/checkout v4 composite
- actions/setup-python v5 composite
- jakebailey/pyright-action v2 composite
examples/llama.android/build.gradle.kts
maven
examples/gguf-hash/deps/rotate-bits/package.json
npm
requirements/requirements-gguf_editor_gui.txt
pypi
- PySide6 *
- gguf >=0.17.0
- numpy *