node-llama-cpp

ai bindings catai cmake cmake-js cuda embedding function-calling gguf gpu grammar json-schema llama llama-cpp llm metal nodejs prebuilt-binaries self-hosted vulkan

Score: 27.27949039137549

Last synced: about 7 hours ago
JSON representation

Repository metadata:

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

Host: GitHub
URL: https://github.com/withcatai/node-llama-cpp
Owner: withcatai
License: mit
Created: 2023-08-12T20:53:16.000Z (about 3 years ago)
Default Branch: master
Last Pushed: 2026-08-04T06:05:09.000Z (9 days ago)
Last Synced: 2026-08-05T17:35:11.154Z (8 days ago)
Topics: ai, bindings, catai, cmake, cmake-js, cuda, embedding, function-calling, gguf, gpu, grammar, json-schema, llama, llama-cpp, llm, metal, nodejs, prebuilt-binaries, self-hosted, vulkan
Language: TypeScript
Homepage: https://node-llama-cpp.withcat.ai
Size: 23.4 MB
Stars: 2,148
Watchers: 20
Forks: 210
Open Issues: 29
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- Funding: .github/FUNDING.yml
- License: LICENSE
Funding:
- Github: giladgd

Owner metadata:

Name: CatAI
Login: withcatai
Email:
Kind: organization
Description: AI models run with nodejs locally on your machine
Website:
Location:
Twitter:
Company:
Icon url: https://avatars.githubusercontent.com/u/142035548?v=4
Repositories: 1
Last Synced at: 2023-08-12T22:29:40.676Z
Profile URL: https://github.com/withcatai

GitHub Events

Total

Create event: 65
Delete event: 47
Discussion event: 5
Fork event: 62
Issue comment event: 207
Issues event: 109
Pull request event: 106
Pull request review comment event: 1
Pull request review event: 17
Push event: 278
Release event: 18
Watch event: 755
Total: 1670

Last Year

Create event: 18
Delete event: 17
Discussion event: 5
Fork event: 16
Issue comment event: 52
Issues event: 43
Pull request event: 38
Pull request review comment event: 1
Pull request review event: 4
Push event: 100
Release event: 5
Watch event: 136
Total: 435

Committers metadata

Last synced: 1 day ago

Total Commits: 247
Total Committers: 14
Avg Commits per committer: 17.643
Development Distribution Score (DDS): 0.077

Commits in past year: 46
Committers in past year: 8
Avg Commits per committer in past year: 5.75
Development Distribution Score (DDS) in past year: 0.152

Name	Email	Commits
Gilad S	g****d	228
Ido S	i**o@g**m	7
정석호	n**r@k**m	1
o-u-p	y**4@g**m	1
mcwindy	4****y	1
itsuka	1****v	1
WayOfTheMap	g**f@g**m	1
Vamshi krishna	v**6@r**t	1
Joshua Harding	j**h@s**m	1
Jon Holman	9****n	1
Hyeonggeun Yun	y**3@g**m	1
Gracie Gould	6****d	1
David	s**r@g**m	1
Bruno Verachten	g**r@g**m	1

Issue and Pull Request metadata

Last synced: 1 day ago

Total issues: 160
Total pull requests: 371
Average time to close issues: 20 days
Average time to close pull requests: 2 days
Total issue authors: 115
Total pull request authors: 30
Average comments per issue: 2.5
Average comments per pull request: 0.99
Merged pull request: 321
Bot issues: 0
Bot pull requests: 0

Past year issues: 37
Past year pull requests: 43
Past year average time to close issues: 29 days
Past year average time to close pull requests: 6 days
Past year issue authors: 29
Past year pull request authors: 14
Past year average comments per issue: 2.76
Past year average comments per pull request: 1.05
Past year merged pull request: 29
Past year bot issues: 0
Past year bot pull requests: 0

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/withcatai/node-llama-cpp

Top Issue Authors

giladgd (10)
sooraj007 (8)
snowyu (4)
therealtimex (3)
nigel-daniels (3)
ittaboba (3)
loretoparisi (3)
vlamanna (3)
onzag (2)
stduhpf (2)
aschulman42-cell (2)
yurivict (2)
nathanlesage (2)
StrangeBytesDev (2)
Zighy (2)

Top Pull Request Authors

giladgd (319)
ido-pluto (7)
anonyein (4)
andreinknv (3)
Thomas101 (3)
eugeniosegala (2)
vlamanna (2)
B3none (2)
jhstatewide (2)
yhg8423 (2)
JonHolman (2)
derek-wangpch (2)
o-u-p (2)
stewartoallen (2)
cmeka (2)

Top Issue Labels

bug (73)
requires triage (72)
new feature (49)
released (22)
released on @beta (21)
roadmap (12)
help wanted (4)
documentation (4)
invalid (1)
unrelated (1)
good first issue (1)
question (1)

Top Pull Request Labels

released (177)
released on @beta (88)

Package metadata

Total packages: 46
Total downloads:
- npm: 23,085,830 last-month
Total dependent packages: 3 (may contain duplicates)
Total dependent repositories: 1 (may contain duplicates)
Total versions: 1,082
Total maintainers: 6

proxy.golang.org: github.com/withcatai/node-llama-cpp

Homepage:
Documentation: https://pkg.go.dev/github.com/withcatai/node-llama-cpp#section-documentation
Licenses: mit
Latest release:
Last Synced: 2026-04-25T12:07:03.271Z (4 months ago)
Versions: 99
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent packages count: 6.528%
- Average: 6.747%
- Dependent repos count: 6.966%

npmjs.org: node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.19.1 (published 23 days ago)
Last Synced: 2026-08-11T22:03:51.955Z (1 day ago)
Versions: 138
Dependent Packages: 3
Dependent Repositories: 1
Downloads: 4,674,969 Last month
Rankings:
- Downloads: 3.202%
- Stargazers count: 7.628%
- Forks count: 10.14%
- Dependent repos count: 10.79%
- Average: 17.108%
- Dependent packages count: 53.778%
Maintainers (1)
- giladgd
Funding:
- type: github
- url: https://github.com/sponsors/giladgd

npmjs.org: @llama-cpp-node/mac-x64

Prebuilt binary for llama-cpp-node for macOS x64

Homepage: https://llama-cpp-node.withcat.ai
Licenses: MIT
Latest release: 0.1.0 (published 5 months ago)
Last Synced: 2026-08-11T22:03:53.453Z (1 day ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 11 Last month
Rankings:
- Downloads: 12.441%
- Average: 22.517%
- Dependent repos count: 22.573%
- Dependent packages count: 32.536%
Maintainers (1)
- andyye

npmjs.org: @node-llama-cpp/mac-arm64-metal

Prebuilt binary for node-llama-cpp for macOS arm64 with Metal support

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.19.1 (published 23 days ago)
Last Synced: 2026-08-11T22:03:52.695Z (1 day ago)
Versions: 48
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 153,612 Last month
Rankings:
- Downloads: 14.582%
- Dependent repos count: 25.769%
- Average: 25.925%
- Dependent packages count: 37.423%
Maintainers (1)
- giladgd

npmjs.org: @node-llama-cpp/linux-riscv64

Prebuilt binary for node-llama-cpp for Linux riscv64

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.19.1 (published 23 days ago)
Last Synced: 2026-08-11T23:20:43.030Z (1 day ago)
Versions: 3
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent repos count: 21.262%
- Average: 25.952%
- Dependent packages count: 30.642%
Maintainers (1)
- giladgd

npmjs.org: @node-llama-cpp/linux-x64-vulkan

Prebuilt binary for node-llama-cpp for Linux x64 with Vulkan support

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.19.1 (published 23 days ago)
Last Synced: 2026-08-11T22:03:45.320Z (1 day ago)
Versions: 48
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 3,957,688 Last month
Rankings:
- Downloads: 14.72%
- Dependent repos count: 25.769%
- Average: 25.971%
- Dependent packages count: 37.423%
Maintainers (1)
- giladgd

npmjs.org: @node-llama-cpp/mac-x64

Prebuilt binary for node-llama-cpp for macOS x64

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.19.1 (published 23 days ago)
Last Synced: 2026-08-11T22:03:51.060Z (1 day ago)
Versions: 48
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 78,965 Last month
Rankings:
- Downloads: 14.868%
- Dependent repos count: 25.769%
- Average: 26.02%
- Dependent packages count: 37.423%
Maintainers (1)
- giladgd

npmjs.org: @node-llama-cpp/linux-armv7l

Prebuilt binary for node-llama-cpp for Linux armv7l

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.19.1 (published 23 days ago)
Last Synced: 2026-08-11T22:03:53.033Z (1 day ago)
Versions: 49
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 1,314,202 Last month
Rankings:
- Downloads: 15.154%
- Dependent repos count: 25.769%
- Average: 26.115%
- Dependent packages count: 37.423%
Maintainers (1)
- giladgd

npmjs.org: @node-llama-cpp/linux-x64

Prebuilt binary for node-llama-cpp for Linux x64

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.19.1 (published 23 days ago)
Last Synced: 2026-08-11T22:03:51.442Z (1 day ago)
Versions: 49
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 4,103,193 Last month
Rankings:
- Downloads: 15.154%
- Dependent repos count: 25.769%
- Average: 26.115%
- Dependent packages count: 37.423%
Maintainers (1)
- giladgd

npmjs.org: custom-koya-node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level

Homepage: https://withcatai.github.io/node-llama-cpp/
Licenses: MIT
Latest release: 0.1.0 (published about 2 years ago)
Last Synced: 2026-08-11T22:03:50.642Z (1 day ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 18 Last month
Rankings:
- Downloads: 14.714%
- Dependent repos count: 26.038%
- Average: 26.193%
- Dependent packages count: 37.827%
Maintainers (1)
- shakeebaftab-koya

npmjs.org: @llama-cpp-node/linux-x64-cuda

Prebuilt binary for llama-cpp-node for Linux x64 with CUDA support

Homepage: https://llama-cpp-node.withcat.ai
Licenses: MIT
Latest release: 0.1.0 (published 5 months ago)
Last Synced: 2026-08-11T22:03:53.644Z (1 day ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 17 Last month
Rankings:
- Dependent repos count: 22.573%
- Average: 27.554%
- Dependent packages count: 32.536%
Maintainers (1)
- andyye

npmjs.org: @llama-cpp-node/win-arm64

Prebuilt binary for llama-cpp-node for Windows arm64

Homepage: https://llama-cpp-node.withcat.ai
Licenses: MIT
Latest release: 0.1.0 (published 5 months ago)
Last Synced: 2026-08-11T22:03:53.742Z (1 day ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 13 Last month
Rankings:
- Dependent repos count: 22.573%
- Average: 27.554%
- Dependent packages count: 32.536%
Maintainers (1)
- andyye

npmjs.org: @llama-cpp-node/linux-arm64

Prebuilt binary for llama-cpp-node for Linux arm64

Homepage: https://llama-cpp-node.withcat.ai
Licenses: MIT
Latest release: 0.1.0 (published 5 months ago)
Last Synced: 2026-08-11T22:03:53.713Z (1 day ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 15 Last month
Rankings:
- Dependent repos count: 22.573%
- Average: 27.554%
- Dependent packages count: 32.536%
Maintainers (1)
- andyye

npmjs.org: @llama-cpp-node/win-x64-cuda

Prebuilt binary for llama-cpp-node for Windows x64 with CUDA support

Homepage: https://llama-cpp-node.withcat.ai
Licenses: MIT
Latest release: 0.1.0 (published 5 months ago)
Last Synced: 2026-08-11T22:03:54.034Z (1 day ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 15 Last month
Rankings:
- Dependent repos count: 22.573%
- Average: 27.554%
- Dependent packages count: 32.536%
Maintainers (1)
- andyye

npmjs.org: @llama-cpp-node/linux-x64-cuda-ext

Extension of @llama-cpp-node/linux-x64-cuda - prebuilt binary for llama-cpp-node for Linux x64 with CUDA support

Homepage: https://llama-cpp-node.withcat.ai
Licenses: MIT
Latest release: 0.1.0 (published 5 months ago)
Last Synced: 2026-08-11T22:03:46.924Z (1 day ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 15 Last month
Rankings:
- Dependent repos count: 22.573%
- Average: 27.554%
- Dependent packages count: 32.536%
Maintainers (1)
- andyye

npmjs.org: @llama-cpp-node/mac-arm64-metal

Prebuilt binary for llama-cpp-node for macOS arm64 with Metal support

Homepage: https://llama-cpp-node.withcat.ai
Licenses: MIT
Latest release: 0.1.0 (published 5 months ago)
Last Synced: 2026-08-11T22:03:50.501Z (1 day ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 14 Last month
Rankings:
- Dependent repos count: 22.573%
- Average: 27.554%
- Dependent packages count: 32.536%
Maintainers (1)
- andyye

npmjs.org: @llama-cpp-node/linux-x64-vulkan

Prebuilt binary for llama-cpp-node for Linux x64 with Vulkan support

Homepage: https://llama-cpp-node.withcat.ai
Licenses: MIT
Latest release: 0.1.0 (published 5 months ago)
Last Synced: 2026-08-11T22:03:50.813Z (1 day ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 13 Last month
Rankings:
- Dependent repos count: 22.573%
- Average: 27.554%
- Dependent packages count: 32.536%
Maintainers (1)
- andyye

npmjs.org: @llama-cpp-node/linux-armv7l

Prebuilt binary for llama-cpp-node for Linux armv7l

Homepage: https://llama-cpp-node.withcat.ai
Licenses: MIT
Latest release: 0.1.0 (published 5 months ago)
Last Synced: 2026-08-11T22:03:53.595Z (1 day ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 10 Last month
Rankings:
- Dependent repos count: 22.573%
- Average: 27.554%
- Dependent packages count: 32.536%
Maintainers (1)
- andyye

npmjs.org: @llama-cpp-node/linux-x64

Prebuilt binary for llama-cpp-node for Linux x64

Homepage: https://llama-cpp-node.withcat.ai
Licenses: MIT
Latest release: 0.1.0 (published 5 months ago)
Last Synced: 2026-08-11T22:03:53.616Z (1 day ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 15 Last month
Rankings:
- Dependent repos count: 22.573%
- Average: 27.554%
- Dependent packages count: 32.536%
Maintainers (1)
- andyye

npmjs.org: @llama-cpp-node/win-x64

Prebuilt binary for llama-cpp-node for Windows x64

Homepage: https://llama-cpp-node.withcat.ai
Licenses: MIT
Latest release: 0.1.0 (published 5 months ago)
Last Synced: 2026-08-11T22:03:54.107Z (1 day ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 11 Last month
Rankings:
- Dependent repos count: 22.573%
- Average: 27.554%
- Dependent packages count: 32.536%
Maintainers (1)
- andyye

npmjs.org: @llama-cpp-node/win-x64-cuda-ext

Extension of @llama-cpp-node/win-x64-cuda - prebuilt binary for llama-cpp-node for Windows x64 with CUDA support

Homepage: https://llama-cpp-node.withcat.ai
Licenses: MIT
Latest release: 0.1.0 (published 5 months ago)
Last Synced: 2026-08-11T22:03:54.713Z (1 day ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 13 Last month
Rankings:
- Dependent repos count: 22.607%
- Average: 27.596%
- Dependent packages count: 32.586%
Maintainers (1)
- andyye

npmjs.org: create-llama-cpp-node

Scaffold a new llama-cpp-node project from a template

Homepage: https://llama-cpp-node.withcat.ai
Licenses: MIT
Latest release: 0.1.0 (published 5 months ago)
Last Synced: 2026-08-11T22:03:50.427Z (1 day ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 9 Last month
Rankings:
- Dependent repos count: 22.607%
- Average: 27.596%
- Dependent packages count: 32.586%
Maintainers (1)
- andyye
Funding:
- type: github
- url: https://github.com/sponsors/giladgd

npmjs.org: @llama-cpp-node/win-x64-vulkan

Prebuilt binary for llama-cpp-node for Windows x64 with Vulkan support

Homepage: https://llama-cpp-node.withcat.ai
Licenses: MIT
Latest release: 0.1.0 (published 5 months ago)
Last Synced: 2026-08-11T22:03:44.642Z (1 day ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 12 Last month
Rankings:
- Dependent repos count: 22.607%
- Average: 27.596%
- Dependent packages count: 32.586%
Maintainers (1)
- andyye

npmjs.org: @plugos-org/node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.15.1 (published 6 months ago)
Last Synced: 2026-08-11T22:03:53.122Z (1 day ago)
Versions: 3
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 98 Last month
Rankings:
- Dependent repos count: 22.945%
- Average: 28.013%
- Dependent packages count: 33.081%
Maintainers (1)
- plugos_lzn
Funding:
- type: github
- url: https://github.com/sponsors/giladgd

npmjs.org: @plugos-org/node-llama-cpp-android-arm64

Prebuilt binary for node-llama-cpp for Android arm64

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.15.1-0 (published 6 months ago)
Last Synced: 2026-08-11T22:03:52.847Z (1 day ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent repos count: 22.945%
- Average: 28.013%
- Dependent packages count: 33.081%
Maintainers (1)
- plugos_lzn

npmjs.org: @node-llama-cpp/win-x64-cuda-ext

Extension of @node-llama-cpp/win-x64-cuda - prebuilt binary for node-llama-cpp for Windows x64 with CUDA support

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.19.1 (published 23 days ago)
Last Synced: 2026-08-11T22:03:54.124Z (1 day ago)
Versions: 21
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 135,589 Last month
Rankings:
- Dependent repos count: 23.968%
- Average: 29.272%
- Dependent packages count: 34.577%
Maintainers (1)
- giladgd

npmjs.org: @node-llama-cpp/linux-x64-cuda-ext

Extension of @node-llama-cpp/linux-x64-cuda - prebuilt binary for node-llama-cpp for Linux x64 with CUDA support

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.19.1 (published 23 days ago)
Last Synced: 2026-08-11T22:03:53.472Z (1 day ago)
Versions: 21
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 4,171,055 Last month
Rankings:
- Dependent repos count: 23.968%
- Average: 29.272%
- Dependent packages count: 34.577%
Maintainers (1)
- giladgd

npmjs.org: @aibrow/create-node-llama-cpp

Scaffold a new node-llama-cpp project from a template

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 1.3.3 (published about 1 year ago)
Last Synced: 2026-08-11T22:03:53.715Z (1 day ago)
Versions: 5
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 27 Last month
Rankings:
- Dependent repos count: 24.675%
- Average: 30.146%
- Dependent packages count: 35.617%
Maintainers (2)
- thomas101
- rhys101
Funding:
- type: github
- url: https://github.com/sponsors/giladgd

npmjs.org: @aibrow/node-llama-cpp-linux-arm64

Prebuilt binary for node-llama-cpp for Linux arm64

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 1.7.0 (published about 1 year ago)
Last Synced: 2026-08-11T22:03:53.941Z (1 day ago)
Versions: 14
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 63 Last month
Rankings:
- Dependent repos count: 24.682%
- Average: 30.154%
- Dependent packages count: 35.626%
Maintainers (2)
- thomas101
- rhys101

npmjs.org: @aibrow/node-llama-cpp-win-x64

Prebuilt binary for node-llama-cpp for Windows x64

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 1.7.0 (published about 1 year ago)
Last Synced: 2026-08-11T22:03:54.318Z (1 day ago)
Versions: 14
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 62 Last month
Rankings:
- Dependent repos count: 24.682%
- Average: 30.154%
- Dependent packages count: 35.626%
Maintainers (2)
- thomas101
- rhys101

npmjs.org: @aibrow/node-llama-cpp-linux-armv7l

Prebuilt binary for node-llama-cpp for Linux armv7l

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 1.7.0 (published about 1 year ago)
Last Synced: 2026-08-11T22:03:47.668Z (1 day ago)
Versions: 14
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 95 Last month
Rankings:
- Dependent repos count: 24.682%
- Average: 30.154%
- Dependent packages count: 35.626%
Maintainers (2)
- thomas101
- rhys101

npmjs.org: @aibrow/node-llama-cpp-linux-x64-cuda

Prebuilt binary for node-llama-cpp for Linux x64 with CUDA support

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 1.7.0 (published about 1 year ago)
Last Synced: 2026-08-11T22:03:53.623Z (1 day ago)
Versions: 14
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 120 Last month
Rankings:
- Dependent repos count: 24.682%
- Average: 30.154%
- Dependent packages count: 35.626%
Maintainers (2)
- thomas101
- rhys101

npmjs.org: @aibrow/node-llama-cpp-win-x64-cuda

Prebuilt binary for node-llama-cpp for Windows x64 with CUDA support

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 1.7.0 (published about 1 year ago)
Last Synced: 2026-08-11T22:03:54.242Z (1 day ago)
Versions: 14
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 106 Last month
Rankings:
- Dependent repos count: 24.682%
- Average: 30.154%
- Dependent packages count: 35.626%
Maintainers (2)
- thomas101
- rhys101

npmjs.org: @aibrow/node-llama-cpp-win-x64-vulkan

Prebuilt binary for node-llama-cpp for Windows x64 with Vulkan support

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 1.7.0 (published about 1 year ago)
Last Synced: 2026-08-11T22:03:54.371Z (1 day ago)
Versions: 14
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 70 Last month
Rankings:
- Dependent repos count: 24.682%
- Average: 30.154%
- Dependent packages count: 35.626%
Maintainers (2)
- thomas101
- rhys101

npmjs.org: @aibrow/node-llama-cpp-mac-arm64-metal

Prebuilt binary for node-llama-cpp for macOS arm64 with Metal support

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 1.7.0 (published about 1 year ago)
Last Synced: 2026-08-11T22:03:53.645Z (1 day ago)
Versions: 14
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 86 Last month
Rankings:
- Dependent repos count: 24.682%
- Average: 30.154%
- Dependent packages count: 35.626%
Maintainers (2)
- thomas101
- rhys101

npmjs.org: @aibrow/node-llama-cpp-linux-x64

Prebuilt binary for node-llama-cpp for Linux x64

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 1.7.0 (published about 1 year ago)
Last Synced: 2026-08-11T22:03:49.644Z (1 day ago)
Versions: 14
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 71 Last month
Rankings:
- Dependent repos count: 24.682%
- Average: 30.154%
- Dependent packages count: 35.626%
Maintainers (2)
- thomas101
- rhys101

npmjs.org: @aibrow/node-llama-cpp-linux-x64-vulkan

Prebuilt binary for node-llama-cpp for Linux x64 with Vulkan support

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 1.7.0 (published about 1 year ago)
Last Synced: 2026-08-11T22:03:53.528Z (1 day ago)
Versions: 14
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 84 Last month
Rankings:
- Dependent repos count: 24.682%
- Average: 30.154%
- Dependent packages count: 35.626%
Maintainers (2)
- thomas101
- rhys101

npmjs.org: @aibrow/node-llama-cpp-mac-x64

Prebuilt binary for node-llama-cpp for macOS x64

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 1.7.0 (published about 1 year ago)
Last Synced: 2026-08-11T22:03:50.354Z (1 day ago)
Versions: 14
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 29 Last month
Rankings:
- Dependent repos count: 24.682%
- Average: 30.154%
- Dependent packages count: 35.626%
Maintainers (2)
- thomas101
- rhys101

npmjs.org: @aibrow/node-llama-cpp-win-arm64

Prebuilt binary for node-llama-cpp for Windows arm64

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 1.7.0 (published about 1 year ago)
Last Synced: 2026-08-11T22:03:49.909Z (1 day ago)
Versions: 14
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 138 Last month
Rankings:
- Dependent repos count: 24.682%
- Average: 30.154%
- Dependent packages count: 35.626%
Maintainers (2)
- thomas101
- rhys101

npmjs.org: @node-llama-cpp/win-x64-vulkan

Prebuilt binary for node-llama-cpp for Windows x64 with Vulkan support

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.19.1 (published 23 days ago)
Last Synced: 2026-08-11T22:03:53.291Z (1 day ago)
Versions: 48
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 116,950 Last month
Rankings:
- Dependent repos count: 25.779%
- Average: 31.609%
- Dependent packages count: 37.439%
Maintainers (1)
- giladgd

npmjs.org: @node-llama-cpp/win-arm64

Prebuilt binary for node-llama-cpp for Windows arm64

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.19.1 (published 23 days ago)
Last Synced: 2026-08-11T22:03:53.362Z (1 day ago)
Versions: 48
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 114,010 Last month
Rankings:
- Dependent repos count: 25.779%
- Average: 31.609%
- Dependent packages count: 37.439%
Maintainers (1)
- giladgd

npmjs.org: @node-llama-cpp/linux-arm64

Prebuilt binary for node-llama-cpp for Linux arm64

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.19.1 (published 23 days ago)
Last Synced: 2026-08-11T22:03:50.639Z (1 day ago)
Versions: 49
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 22,266 Last month
Rankings:
- Dependent repos count: 25.779%
- Average: 31.609%
- Dependent packages count: 37.439%
Maintainers (1)
- giladgd

npmjs.org: @node-llama-cpp/win-x64

Prebuilt binary for node-llama-cpp for Windows x64

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.19.1 (published 23 days ago)
Last Synced: 2026-08-11T22:03:50.345Z (1 day ago)
Versions: 48
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 118,033 Last month
Rankings:
- Dependent repos count: 25.779%
- Average: 31.609%
- Dependent packages count: 37.439%
Maintainers (1)
- giladgd

npmjs.org: @node-llama-cpp/linux-x64-cuda

Prebuilt binary for node-llama-cpp for Linux x64 with CUDA support

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.19.1 (published 23 days ago)
Last Synced: 2026-08-11T22:03:51.644Z (1 day ago)
Versions: 60
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 3,987,831 Last month
Rankings:
- Dependent repos count: 27.635%
- Average: 33.896%
- Dependent packages count: 40.158%
Maintainers (1)
- giladgd

npmjs.org: @node-llama-cpp/win-x64-cuda

Prebuilt binary for node-llama-cpp for Windows x64 with CUDA support

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.19.1 (published 23 days ago)
Last Synced: 2026-08-11T22:03:53.873Z (1 day ago)
Versions: 60
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 135,984 Last month
Rankings:
- Dependent repos count: 27.635%
- Average: 33.896%
- Dependent packages count: 40.158%
Maintainers (1)
- giladgd

npmjs.org: create-node-llama-cpp

Scaffold a new node-llama-cpp project from a template

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.19.1 (published 23 days ago)
Last Synced: 2026-08-11T22:03:45.678Z (1 day ago)
Versions: 67
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 233 Last month
Rankings:
- Dependent repos count: 29.297%
- Average: 35.609%
- Dependent packages count: 41.922%
Maintainers (1)
- giladgd
Funding:
- type: github
- url: https://github.com/sponsors/giladgd

Dependencies

.github/workflows/build.yml actions

actions/checkout v3 composite
actions/deploy-pages v2 composite
actions/download-artifact v3 composite
actions/setup-node v3 composite
actions/setup-python v4 composite
actions/upload-artifact v3 composite
actions/upload-pages-artifact v2 composite

.github/workflows/prLint.yml actions

amannn/action-semantic-pull-request v5 composite

.github/workflows/test.yml actions

actions/checkout v3 composite
actions/setup-node v3 composite

package-lock.json npm

895 dependencies

package.json npm

@commitlint/cli ^17.7.1 development
@commitlint/config-conventional ^17.7.0 development
@semantic-release/exec ^6.0.3 development
@types/bytes ^3.1.1 development
@types/cli-progress ^3.11.0 development
@types/cross-spawn ^6.0.2 development
@types/fs-extra ^11.0.1 development
@types/node ^20.4.9 development
@types/uuid ^9.0.2 development
@types/yargs ^17.0.24 development
@typescript-eslint/eslint-plugin ^6.3.0 development
@typescript-eslint/parser ^6.3.0 development
eslint ^8.46.0 development
eslint-plugin-import ^2.28.0 development
eslint-plugin-node github:giladgd/eslint-plugin-node#dev/giladgd/fixImportExtentionFixingInTypeScript development
husky ^8.0.3 development
semantic-release ^21.0.7 development
ts-node ^10.9.1 development
tslib ^2.6.1 development
typedoc ^0.24.8 development
typescript ^5.1.6 development
zx ^7.2.3 development
chalk ^5.3.0
cli-progress ^3.12.0
cross-env ^7.0.3
cross-spawn ^7.0.3
env-var ^7.3.1
fs-extra ^11.1.1
node-addon-api ^7.0.0
node-gyp ^9.4.0
octokit ^3.1.0
ora ^7.0.1
simple-git ^3.19.1
uuid ^9.0.0
yargs ^17.7.2

llama/xpack/package.json npm

packages/@node-llama-cpp/linux-arm64/package-lock.json npm

typescript 5.5.2 development

packages/@node-llama-cpp/linux-x64-cuda/package.json npm

typescript ^5.2.2 development

packages/@node-llama-cpp/win-arm64/package.json npm

typescript ^5.2.2 development

templates/package.json npm

eslint-plugin-react-hooks ^4.6.0 development
eslint-plugin-react-refresh ^0.4.5 development

packages/@node-llama-cpp/mac-x64/package-lock.json npm

typescript 5.5.2 development

packages/@node-llama-cpp/linux-x64-cuda/package-lock.json npm

typescript 5.5.2 development

packages/@node-llama-cpp/win-x64-vulkan/package.json npm

typescript ^5.2.2 development

packages/@node-llama-cpp/linux-x64-cuda-ext/package.json npm

typescript ^5.2.2 development

packages/@node-llama-cpp/win-x64-cuda/package.json npm

typescript ^5.2.2 development

llama/package.json npm

packages/@node-llama-cpp/linux-x64/package.json npm

typescript ^5.2.2 development

packages/@node-llama-cpp/linux-x64-vulkan/package-lock.json npm

typescript 5.5.2 development

packages/@node-llama-cpp/linux-x64/package-lock.json npm

typescript 5.5.2 development

packages/@node-llama-cpp/win-arm64/package-lock.json npm

typescript 5.5.2 development

packages/@node-llama-cpp/win-x64/package-lock.json npm

typescript 5.5.2 development

templates/package-lock.json npm

101 dependencies

packages/@node-llama-cpp/win-x64-cuda/package-lock.json npm

typescript 5.5.2 development

packages/@node-llama-cpp/linux-x64-vulkan/package.json npm

typescript ^5.2.2 development

packages/@node-llama-cpp/mac-x64/package.json npm

typescript ^5.2.2 development

templates/node-typescript/package.json npm

@stylistic/eslint-plugin ^4.2.0 development
@types/node ^22.15.17 development
eslint ^9.26.0 development
eslint-import-resolver-typescript ^4.3.4 development
eslint-plugin-import ^2.31.0 development
eslint-plugin-jsdoc ^50.6.11 development
eslint-plugin-n ^17.17.0 development
rimraf ^6.0.1 development
tslib ^2.8.1 development
typescript ^5.8.3 development
typescript-eslint ^8.32.0 development
vite-node ^3.1.3 development
chalk ^5.4.1
node-llama-cpp file:../..

packages/@node-llama-cpp/linux-arm64/package.json npm

typescript ^5.2.2 development

packages/@node-llama-cpp/win-x64/package.json npm

typescript ^5.2.2 development

packages/@node-llama-cpp/win-x64-cuda-ext/package-lock.json npm

typescript 5.5.2 development

packages/@node-llama-cpp/linux-armv7l/package-lock.json npm

typescript 5.5.2 development

packages/@node-llama-cpp/linux-armv7l/package.json npm

typescript ^5.2.2 development

packages/@node-llama-cpp/mac-arm64-metal/package-lock.json npm

typescript 5.5.2 development

packages/@node-llama-cpp/win-x64-vulkan/package-lock.json npm

typescript 5.5.2 development

packages/create-node-llama-cpp/package.json npm

typescript ^5.2.2 development
node-llama-cpp file:../..

packages/@node-llama-cpp/linux-x64-cuda-ext/package-lock.json npm

typescript 5.5.2 development

packages/@node-llama-cpp/mac-arm64-metal/package.json npm

typescript ^5.2.2 development

packages/@node-llama-cpp/win-x64-cuda-ext/package.json npm

typescript ^5.2.2 development

packages/create-node-llama-cpp/package-lock.json npm

typescript 5.4.5 development
node-llama-cpp *

templates/electron-typescript-react/package.json npm

@stylistic/eslint-plugin ^4.2.0 development
@types/markdown-it ^14.1.2 development
@types/react ^19.1.3 development
@types/react-dom ^19.1.3 development
@types/semver ^7.7.0 development
@vitejs/plugin-react ^4.4.1 development
cross-env ^10.0.0 development
electron ^36.2.0 development
electron-builder ^26.0.12 development
eslint ^9.26.0 development
eslint-import-resolver-typescript ^4.3.4 development
eslint-plugin-import ^2.31.0 development
eslint-plugin-jsdoc ^50.6.11 development
eslint-plugin-react-hooks ^5.2.0 development
eslint-plugin-react-refresh ^0.4.20 development
rimraf ^6.0.1 development
typescript ^5.8.3 development
typescript-eslint ^8.32.0 development
vite ^6.3.5 development
vite-plugin-electron ^0.29.0 development
vite-plugin-electron-renderer ^0.14.6 development
zx ^8.5.3 development
@fontsource-variable/inter ^5.2.5
birpc ^2.3.0
classnames ^2.5.1
highlight.js ^11.11.1
lifecycle-utils ^3.0.1
markdown-it ^14.1.0
node-llama-cpp file:../..
pretty-ms ^9.2.0
react ^19.1.0
react-dom ^19.1.0
semver ^7.7.1