llama.cpp

ggml

Score: 34.196062564599856

Last synced: about 11 hours ago
JSON representation

Repository metadata:

LLM inference in C/C++

Host: GitHub
URL: https://github.com/ggml-org/llama.cpp
Owner: ggml-org
License: mit
Created: 2023-03-10T18:58:00.000Z (about 3 years ago)
Default Branch: master
Last Pushed: 2026-03-07T17:09:24.000Z (26 days ago)
Last Synced: 2026-03-07T17:20:40.947Z (26 days ago)
Topics: ggml
Language: C++
Homepage:
Size: 305 MB
Stars: 97,067
Watchers: 641
Forks: 15,300
Open Issues: 1,210
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Codeowners: CODEOWNERS
- Security: SECURITY.md
- Authors: AUTHORS
- Agents: AGENTS.md

Owner metadata:

Name: ggml-org
Login: ggml-org
Email:
Kind: organization
Description:
Website:
Location:
Twitter:
Company:
Icon url: https://avatars.githubusercontent.com/u/134263123?v=4
Repositories: 1
Last Synced at: 2023-05-22T12:30:08.047Z
Profile URL: https://github.com/ggml-org

GitHub Events

Total

Commit comment event: 24
Create event: 1069
Delete event: 269
Fork event: 1651
Gollum event: 4
Issue comment event: 8753
Issues event: 1768
Member event: 13
Pull request event: 2485
Pull request review comment event: 3039
Pull request review event: 3846
Push event: 1754
Release event: 752
Watch event: 8945
Total: 34372

Last Year

Commit comment event: 24
Create event: 1069
Delete event: 269
Fork event: 1651
Gollum event: 4
Issue comment event: 8753
Issues event: 1768
Member event: 13
Pull request event: 2485
Pull request review comment event: 3039
Pull request review event: 3846
Push event: 1754
Release event: 752
Watch event: 8945
Total: 34372

Committers metadata

Last synced: about 1 month ago

Total Commits: 8,189
Total Committers: 1,433
Avg Commits per committer: 5.715
Development Distribution Score (DDS): 0.8

Commits in past year: 3,390
Committers in past year: 551
Avg Commits per committer in past year: 6.152
Development Distribution Score (DDS) in past year: 0.853

Name	Email	Commits
Georgi Gerganov	g**v@g**m	1636
Xuan-Son Nguyen	s**n@h**o	389
slaren	s**h@g**m	362
Johannes Gäßler	j**g@5**e	349
Jeff Bolz	j**z@n**m	261
Daniel Bevenius	d**s@g**m	244
Sigbjørn Skjæret	s**t@s**m	225
Cebtenzzre	c**e@g**m	101
Kawrakow	4****w	100
Aman Gupta	a**2@g**m	91
0cc4m	p**2@l**e	89
Olivier Chafik	o****k	76
Adrien Gallouët	a**t@h**o	75
compilade	g**t@c**t	62
lhez	l**h@q**m	58
Pierrick Hymbert	p**t@g**m	58
Radoslav Gerganov	r**v@g**m	56
R0CKSTAR	x**e@m**m	49
Aleksander Grygier	a**r@g**m	47
Aaron Teo	a**1@i**m	45
Neo Zhang Jianyu	j**g@i**m	44
Eve	1****e	42
Kerfuffle	4****2	42
Akarshan Biswas	a**n@m**i	40
Chenguang Li	7**8@q**m	37
Eric Curtin	e**n@r**m	34
Pascal	a**n@s**m	34
Piotr Wilkin (ilintar)	p**n@s**m	33
Stephan Walter	s**n@w**e	32
Brian	m**e@g**m	31
and 1403 more...

Issue and Pull Request metadata

Last synced: 3 months ago

Total issues: 1,526
Total pull requests: 3,020
Average time to close issues: about 1 month
Average time to close pull requests: 7 days
Total issue authors: 1,033
Total pull request authors: 571
Average comments per issue: 3.28
Average comments per pull request: 2.66
Merged pull request: 1,678
Bot issues: 0
Bot pull requests: 1

Past year issues: 1,447
Past year pull requests: 2,946
Past year average time to close issues: 29 days
Past year average time to close pull requests: 5 days
Past year issue authors: 975
Past year pull request authors: 539
Past year average comments per issue: 2.71
Past year average comments per pull request: 2.55
Past year merged pull request: 1,637
Past year bot issues: 0
Past year bot pull requests: 1

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/ggml-org/llama.cpp

Top Issue Authors

gnusupport (22)
ngxson (19)
ggerganov (18)
yurivict (16)
Bobchenyx (14)
pwilkin (11)
0wwafa (9)
taronaeo (9)
nickhuang99 (9)
MaoJianwei (9)
steampunque (7)
createthis (6)
jacekpoplawski (6)
ExtReMLapin (6)
domasofan (6)

Top Pull Request Authors

ggerganov (367)
ngxson (214)
CISC (169)
jeffbolznv (142)
JohannesGaessler (106)
slaren (71)
danbev (69)
yeahdongcn (55)
ochafik (48)
lhez (46)
qnixsynapse (45)
am17an (40)
taronaeo (35)
noemotiovon (30)
compilade (28)

Top Issue Labels

bug-unconfirmed (972)
stale (466)
enhancement (249)
bug (55)
server/webui (21)
good first issue (21)
build (13)
help wanted (11)
Vulkan (10)
model (10)
research 🔬 (8)
duplicate (8)
question (7)
wontfix (6)
roadmap (5)
need more info (5)
Ascend NPU (4)
Nvidia GPU (4)
performance (4)
hardware (4)
AMD GPU (3)
refactoring (3)
tts (3)
windows (2)
Apple Metal (2)
testing (2)
🦙. (2)
documentation (2)
server (2)
ggml (2)

Top Pull Request Labels

ggml (991)
examples (638)
python (339)
server (283)
Nvidia GPU (245)
testing (233)
Vulkan (224)
devops (193)
SYCL (138)
documentation (113)
Apple Metal (107)
script (71)
Ascend NPU (57)
build (40)
OpenCL (29)
bugfix (13)
android (12)
nix (10)
Review Complexity : Medium (9)
breaking change (8)
hot (8)
enhancement (6)
Kompute (6)
help wanted (6)
model (5)
demo (5)
Review Complexity : Low (5)
tool calling (5)
performance (5)
server/webui (4)

Package metadata

Total packages: 14
Total downloads:
- homebrew: 23,154 last-month
- pypi: 5,017,116 last-month
Total docker downloads: 40
Total dependent packages: 5 (may contain duplicates)
Total dependent repositories: 56 (may contain duplicates)
Total versions: 2,670
Total maintainers: 7

pypi.org: gguf

Read and write ML models in GGUF for GGML

Homepage: https://ggml.ai
Documentation: https://gguf.readthedocs.io/
Licenses: MIT License
Latest release: 0.18.0 (published about 1 month ago)
Last Synced: 2026-03-07T11:16:44.565Z (26 days ago)
Versions: 25
Dependent Packages: 5
Dependent Repositories: 56
Downloads: 5,017,116 Last month
Docker Downloads: 40
Rankings:
- Stargazers count: 0.023%
- Forks count: 0.075%
- Downloads: 1.859%
- Dependent repos count: 1.975%
- Average: 2.889%
- Docker downloads count: 3.297%
- Dependent packages count: 10.105%
Maintainers (1)
- monatis

proxy.golang.org: github.com/ggml-org/llama.cpp

Homepage:
Documentation: https://pkg.go.dev/github.com/ggml-org/llama.cpp#section-documentation
Licenses: mit
Latest release: v3.3.0+incompatible (published about 2 years ago)
Last Synced: 2026-03-07T11:16:44.762Z (26 days ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent packages count: 5.522%
- Average: 5.707%
- Dependent repos count: 5.892%

swiftpackageindex.com: github.com/ggml-org/llama.cpp

Homepage:
Documentation: https://swiftpackageindex.com/ggml-org/llama.cpp/documentation
Licenses: mit
Latest release: b8182 (published about 1 month ago)
Last Synced: 2026-03-07T11:16:56.782Z (26 days ago)
Versions: 2,220
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent packages count: 16.922%
- Average: 20.383%
- Dependent repos count: 23.845%

spack.io: llama-cpp

LLM inference in C/C++

Homepage: https://github.com/ggml-org/llama.cpp
Licenses: []
Latest release: (published 26 days ago)
Last Synced: 2026-03-07T11:16:43.975Z (26 days ago)
Versions: 0
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent repos count: 0.0%
- Average: 26.46%
- Dependent packages count: 52.921%
Maintainers (1)
- rbberger

formulae.brew.sh: llama.cpp

LLM inference in C/C++

Homepage: https://github.com/ggml-org/llama.cpp
Licenses: MIT
Latest release: 8210 (published 26 days ago)
Last Synced: 2026-03-07T06:49:52.498Z (26 days ago)
Versions: 381
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 23,154 Last month
Rankings:
- Dependent packages count: 19.125%
- Average: 38.226%
- Downloads: 40.191%
- Dependent repos count: 55.362%

anaconda.org: gguf

Read and write ML models in GGUF for GGML

Homepage: https://ggml.ai
Licenses: MIT
Latest release: 0.17.1.7984 (published about 1 month ago)
Last Synced: 2026-02-20T16:03:20.505Z (about 1 month ago)
Versions: 7
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent packages count: 42.572%
- Average: 44.687%
- Dependent repos count: 46.803%

anaconda.org: libllama

Inference of Meta's LLaMA model (and others) in pure C/C++

Homepage: https://github.com/ggml-org/llama.cpp
Licenses: MIT
Latest release: 0.0.7984 (published about 1 month ago)
Last Synced: 2026-02-20T16:03:25.504Z (about 1 month ago)
Versions: 6
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent packages count: 42.572%
- Average: 44.687%
- Dependent repos count: 46.803%

anaconda.org: llama.cpp

Server example and tools for llama.cpp, using libllama

Homepage: https://github.com/ggml-org/llama.cpp
Licenses: MIT
Latest release: 0.0.7984 (published about 1 month ago)
Last Synced: 2026-02-20T16:03:30.249Z (about 1 month ago)
Versions: 7
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent packages count: 42.572%
- Average: 44.687%
- Dependent repos count: 46.803%

anaconda.org: llama.cpp-tools

Scripts and conversion tools that ship with llama.cpp, including model vocabulary files and templates

Homepage: https://github.com/ggml-org/llama.cpp
Licenses: MIT
Latest release: 0.0.7984 (published about 1 month ago)
Last Synced: 2026-02-20T16:03:33.101Z (about 1 month ago)
Versions: 7
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent packages count: 42.572%
- Average: 44.687%
- Dependent repos count: 46.803%

anaconda.org: llama.cpp-tests

Test executables for llama.cpp

Homepage: https://github.com/ggml-org/llama.cpp
Licenses: MIT
Latest release: 0.0.7984 (published about 1 month ago)
Last Synced: 2026-02-20T16:03:32.259Z (about 1 month ago)
Versions: 6
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent packages count: 42.572%
- Average: 44.687%
- Dependent repos count: 46.803%

guix: llama-cpp

Port of Facebook's LLaMA model in C/C++

Homepage: https://github.com/ggml-org/llama.cpp
Documentation: https://git.savannah.gnu.org/cgit/guix.git/tree/gnu/packages/machine-learning.scm#n837
Licenses:
Latest release: 0.0.0-b8054 (published about 1 month ago)
Last Synced: 2026-03-02T20:41:15.384Z (about 1 month ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent repos count: 0.0%
- Dependent packages count: 0.0%
- Average: 100%

nixpkgs-unstable: llama-cpp

Inference of Meta's LLaMA model (and others) in pure C/C++

Homepage: https://github.com/ggml-org/llama.cpp
Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-unstable/pkgs/by-name/ll/llama-cpp/package.nix#L211
Licenses: MIT
Latest release: 8124 (published about 1 month ago)
Last Synced: 2026-03-03T12:08:50.065Z (about 1 month ago)
Versions: 3
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
Maintainers (5)
- philiptaron
- dit7ya
- xddxdd
- yuannan
- booxter

nixpkgs-unstable: llama-cpp-vulkan

Inference of Meta's LLaMA model (and others) in pure C/C++

Homepage: https://github.com/ggml-org/llama.cpp
Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-unstable/pkgs/by-name/ll/llama-cpp/package.nix#L211
Licenses: MIT
Latest release: 8124 (published about 1 month ago)
Last Synced: 2026-03-03T12:08:54.673Z (about 1 month ago)
Versions: 3
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
Maintainers (5)
- philiptaron
- dit7ya
- xddxdd
- yuannan
- booxter

nixpkgs-unstable: llama-cpp-rocm

Inference of Meta's LLaMA model (and others) in pure C/C++

Homepage: https://github.com/ggml-org/llama.cpp
Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-unstable/pkgs/by-name/ll/llama-cpp/package.nix#L211
Licenses: MIT
Latest release: 8124 (published about 1 month ago)
Last Synced: 2026-03-03T10:14:54.453Z (about 1 month ago)
Versions: 3
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
Maintainers (5)
- philiptaron
- dit7ya
- xddxdd
- yuannan
- booxter

Dependencies

.github/workflows/build.yml actions

actions/checkout v1 composite
actions/download-artifact v3 composite
actions/github-script v3 composite
actions/upload-artifact v3 composite
anzz1/action-create-release v1 composite
pr-mpt/actions-commit-hash v2 composite

.github/workflows/docker.yml actions

actions/checkout v3 composite
docker/build-push-action v4 composite
docker/login-action v2 composite
docker/setup-buildx-action v2 composite
docker/setup-qemu-action v2 composite

.github/workflows/editorconfig.yml actions

actions/checkout v3 composite
editorconfig-checker/action-editorconfig-checker main composite

.github/workflows/gguf-publish.yml actions

actions/checkout v3 composite
actions/setup-python v2 composite
pypa/gh-action-pypi-publish release/v1 composite

gguf-py/pyproject.toml pypi

pytest ^5.2 develop
numpy >=1.17
python >=3.8

requirements.txt pypi

gguf >=0.1.0
numpy ==1.24
sentencepiece ==0.1.98

.github/workflows/build-linux-cross.yml actions

./.github/actions/linux-setup-spacemit * composite
actions/cache v4 composite
actions/checkout v4 composite

examples/batched.swift/Package.swift swiftpm

.github/actions/linux-setup-vulkan/action.yml actions

./.github/actions/unarchive-tar * composite

.github/workflows/build-cache.yml actions

./.github/actions/linux-setup-spacemit * composite
./.github/actions/linux-setup-vulkan * composite
./.github/actions/windows-setup-rocm * composite
actions/cache v4 composite
actions/checkout v4 composite

.github/workflows/python-lint.yml actions

actions/checkout v4 composite
actions/setup-python v5 composite
py-actions/flake8 v2 composite

.github/actions/install-exe/action.yml actions

.github/actions/windows-setup-rocm/action.yml actions

./.github/actions/install-exe * composite

.github/workflows/winget.yml actions

actions/github-script v6 composite
cargo-bins/cargo-binstall 268643a6b5ea099f5718ee5cd3ff7dc89a5eb49b composite

examples/llama.android/app/build.gradle.kts maven

examples/llama.android/lib/build.gradle.kts maven

poetry.lock pypi

atomicwrites 1.4.1
attrs 23.2.0
certifi 2024.2.2
charset-normalizer 3.3.2
colorama 0.4.6
filelock 3.13.1
fsspec 2024.2.0
gguf 0.7.0
huggingface-hub 0.20.3
idna 3.6
jinja2 3.1.3
markupsafe 2.1.5
more-itertools 10.2.0
mpmath 1.3.0
networkx 3.2.1
numpy 1.26.4
packaging 23.2
pluggy 0.13.1
protobuf 4.25.3
py 1.11.0
pytest 5.4.3
pyyaml 6.0.1
regex 2023.12.25
requests 2.31.0
safetensors 0.4.2
sentencepiece 0.1.99
sympy 1.12
tokenizers 0.15.2
torch 2.2.1+cpu
tqdm 4.66.2
transformers 4.38.1
typing-extensions 4.9.0
urllib3 2.2.1
wcwidth 0.2.13

pyproject.toml pypi

pytest ^5.2 develop
gguf *
numpy ^1.25.0
protobuf >=4.21.0,<5.0.0
python >=3.9
sentencepiece >=0.1.98,<=0.2.0
torch ^2.2.0
transformers >=4.35.2,<5.0.0

requirements/requirements-convert_hf_to_gguf.txt pypi

torch *
torch >=0.0.0.dev0

.github/actions/windows-setup-curl/action.yml actions

.github/workflows/bench.yml.disabled actions

Sibz/github-status-action v1 composite
actions/checkout v4 composite
actions/setup-go v5 composite
actions/upload-artifact v4 composite
devicons/public-upload-to-imgur v2.2.2 composite
mshick/add-pr-comment v2 composite

.github/workflows/check-vendor.yml actions

actions/checkout v4 composite
actions/setup-python v4 composite

requirements/requirements-convert_lora_to_gguf.txt pypi

.github/actions/get-tag-name/action.yml actions

.github/actions/linux-setup-spacemit/action.yml actions

./.github/actions/unarchive-tar * composite

.github/actions/unarchive-tar/action.yml actions

.github/workflows/close-issue.yml actions

actions/stale v5 composite

requirements/requirements-compare-llama-bench.txt pypi

GitPython *
matplotlib *
tabulate *

requirements/requirements-convert_llama_ggml_to_gguf.txt pypi

tools/mtmd/requirements.txt pypi

pillow *
torch *
torchvision *

.github/workflows/build-cmake-pkg.yml actions

actions/checkout v4 composite

.github/workflows/labeler.yml actions

actions/checkout v4 composite
actions/labeler v5 composite

.github/workflows/server.yml actions

actions/checkout v4 composite
actions/setup-python v5 composite

examples/gguf-hash/deps/sha1/package.json npm

examples/gguf-hash/deps/sha256/package.json npm

jb55/rotate-bits.h 0.1.1

.github/workflows/copilot-setup-steps.yml actions

actions/checkout v4 composite
actions/setup-python v5 composite
ggml-org/ccache-action v1.2.16 composite

.github/workflows/release.yml actions

./.github/actions/get-tag-name * composite
./.github/actions/windows-setup-cuda * composite
./.github/actions/windows-setup-curl * composite
actions/cache v4 composite
actions/checkout v4 composite
actions/download-artifact v4 composite
actions/github-script v3 composite
actions/upload-artifact v4 composite
ggml-org/action-create-release v1 composite
ggml-org/ccache-action v1.2.16 composite
ggml-org/free-disk-space v1.3.1 composite

requirements/requirements-all.txt pypi

scripts/jinja/requirements.txt pypi

PySide6 *
jinja2 *

requirements/requirements-convert_legacy_llama.txt pypi

gguf >=0.1.0
numpy *
protobuf >=4.21.0,<5.0.0
sentencepiece *
transformers >=4.57.1,<5.0.0

.github/workflows/update-ops-docs.yml actions

actions/checkout v4 composite
actions/setup-python v5 composite

requirements/requirements-test-tokenizer-random.txt pypi

cffi * test

requirements/requirements-tool_bench.txt pypi

aiohttp *
huggingface_hub >=0.34.0,<1.0
matplotlib *
numpy *
openai *
pandas *
prometheus-client *
pytest *
requests *
seaborn *
typer *
wget *

tools/server/tests/requirements.txt pypi

aiohttp * test
huggingface_hub >=0.34.0,<1.0 test
numpy * test
openai * test
prometheus-client * test
pytest * test
requests * test
wget * test

scripts/snapdragon/qdc/requirements.txt pypi

Appium-Python-Client ==5.2.4
PySocks ==1.7.1
Pygments ==2.19.2
attrs ==25.4.0
certifi ==2025.10.5
exceptiongroup ==1.3.0
h11 ==0.16.0
idna ==3.11
iniconfig ==2.1.0
outcome ==1.3.0.post0
packaging ==25.0
pluggy ==1.6.0
pytest ==8.4.2
pytest-dependency ==0.6.0
selenium ==4.36.0
setuptools ==80.9.0
sniffio ==1.3.1
sortedcontainers ==2.4.0
tomli ==2.3.0
trio ==0.31.0
trio-websocket ==0.12.2
typing_extensions ==4.15.0
urllib3 ==2.5.0
websocket-client ==1.9.0
wsproto ==1.2.0

.github/workflows/python-check-requirements.yml actions

actions/checkout v4 composite
actions/setup-python v5 composite

tools/server/webui/package-lock.json npm

621 dependencies

tools/server/bench/requirements.txt pypi

matplotlib *
requests *

.github/actions/windows-setup-cuda/action.yml actions

.github/workflows/server-webui.yml actions

actions/checkout v4 composite
actions/setup-node v4 composite
actions/setup-python v5 composite

requirements/requirements-convert_hf_to_gguf_update.txt pypi

requirements/requirements-pydantic.txt pypi

docstring_parser *
pydantic *
requests *

requirements/requirements-server-bench.txt pypi

datasets *
matplotlib *
numpy *
requests *
tqdm *

tools/server/webui/package.json npm

@chromatic-com/storybook ^4.1.2 development
@eslint/compat ^1.2.5 development
@eslint/js ^9.18.0 development
@internationalized/date ^3.10.1 development
@lucide/svelte ^0.515.0 development
@playwright/test ^1.49.1 development
@storybook/addon-a11y ^10.0.7 development
@storybook/addon-docs ^10.0.7 development
@storybook/addon-svelte-csf ^5.0.10 development
@storybook/addon-vitest ^10.0.7 development
@storybook/sveltekit ^10.0.7 development
@sveltejs/adapter-static ^3.0.10 development
@sveltejs/kit ^2.48.4 development
@sveltejs/vite-plugin-svelte ^6.2.1 development
@tailwindcss/forms ^0.5.9 development
@tailwindcss/typography ^0.5.15 development
@tailwindcss/vite ^4.0.0 development
@types/node ^22 development
@vitest/browser ^3.2.3 development
bits-ui ^2.14.4 development
clsx ^2.1.1 development
dexie ^4.0.11 development
eslint ^9.18.0 development
eslint-config-prettier ^10.0.1 development
eslint-plugin-storybook ^10.0.7 development
eslint-plugin-svelte ^3.0.0 development
fflate ^0.8.2 development
globals ^16.0.0 development
http-server ^14.1.1 development
mdast ^3.0.0 development
mdsvex ^0.12.3 development
playwright ^1.56.1 development
prettier ^3.4.2 development
prettier-plugin-svelte ^3.3.3 development
prettier-plugin-tailwindcss ^0.6.11 development
rehype-katex ^7.0.1 development
remark-math ^6.0.0 development
sass ^1.93.3 development
storybook ^10.0.7 development
svelte ^5.0.0 development
svelte-check ^4.0.0 development
tailwind-merge ^3.3.1 development
tailwind-variants ^3.2.2 development
tailwindcss ^4.0.0 development
tw-animate-css ^1.3.5 development
typescript ^5.0.0 development
typescript-eslint ^8.20.0 development
unified ^11.0.5 development
uuid ^13.0.0 development
vite ^7.2.2 development
vite-plugin-devtools-json ^0.2.0 development
vitest ^3.2.3 development
vitest-browser-svelte ^0.1.0 development
highlight.js ^11.11.1
mode-watcher ^1.1.0
pdfjs-dist ^5.4.54
rehype-highlight ^7.0.2
rehype-stringify ^10.0.1
remark ^15.0.1
remark-breaks ^4.0.0
remark-gfm ^4.0.1
remark-html ^16.0.1
remark-rehype ^11.1.2
svelte-sonner ^1.0.5
unist-util-visit ^5.0.0

examples/model-conversion/requirements.txt pypi

accelerate *
huggingface-hub *
sentence-transformers *
torch *
torchvision *
transformers *

.github/workflows/pre-tokenizer-hashes.yml actions

actions/checkout v4 composite
actions/setup-python v5 composite

.github/workflows/python-type-check.yml actions

actions/checkout v4 composite
actions/setup-python v5 composite
jakebailey/pyright-action v2 composite

examples/llama.android/build.gradle.kts maven

examples/gguf-hash/deps/rotate-bits/package.json npm

requirements/requirements-gguf_editor_gui.txt pypi

PySide6 *
gguf >=0.17.0
numpy *

ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Summary

awesome-llama: https://github.com/ggml-org/llama.cpp

Repository metadata:

Owner metadata:

GitHub Events

Total

Last Year

Committers metadata

Issue and Pull Request metadata

Top Issue Authors

Top Pull Request Authors

Top Issue Labels

Top Pull Request Labels

Package metadata

pypi.org: gguf

proxy.golang.org: github.com/ggml-org/llama.cpp

swiftpackageindex.com: github.com/ggml-org/llama.cpp

spack.io: llama-cpp

formulae.brew.sh: llama.cpp

anaconda.org: gguf

anaconda.org: libllama

anaconda.org: llama.cpp

anaconda.org: llama.cpp-tools

anaconda.org: llama.cpp-tests

guix: llama-cpp

nixpkgs-unstable: llama-cpp

nixpkgs-unstable: llama-cpp-vulkan

nixpkgs-unstable: llama-cpp-rocm

Dependencies