node-llama-cpp

ai bindings catai cmake cmake-js cuda embedding function-calling gguf gpu grammar json-schema llama llama-cpp llm metal nodejs prebuilt-binaries self-hosted vulkan

Score: 26.512156363292835

Last synced: about 21 hours ago
JSON representation

Repository metadata:

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

Host: GitHub
URL: https://github.com/withcatai/node-llama-cpp
Owner: withcatai
License: mit
Created: 2023-08-12T20:53:16.000Z (almost 3 years ago)
Default Branch: master
Last Pushed: 2026-05-24T00:33:44.000Z (9 days ago)
Last Synced: 2026-05-24T02:24:43.056Z (9 days ago)
Topics: ai, bindings, catai, cmake, cmake-js, cuda, embedding, function-calling, gguf, gpu, grammar, json-schema, llama, llama-cpp, llm, metal, nodejs, prebuilt-binaries, self-hosted, vulkan
Language: TypeScript
Homepage: https://node-llama-cpp.withcat.ai
Size: 23.6 MB
Stars: 2,068
Watchers: 21
Forks: 192
Open Issues: 34
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- Funding: .github/FUNDING.yml
- License: LICENSE
Funding:
- Github: giladgd

Owner metadata:

Name: CatAI
Login: withcatai
Email:
Kind: organization
Description: AI models run with nodejs locally on your machine
Website:
Location:
Twitter:
Company:
Icon url: https://avatars.githubusercontent.com/u/142035548?v=4
Repositories: 1
Last Synced at: 2023-08-12T22:29:40.676Z
Profile URL: https://github.com/withcatai

GitHub Events

Total

Create event: 64
Delete event: 45
Discussion event: 5
Fork event: 61
Issue comment event: 207
Issues event: 109
Pull request event: 105
Pull request review event: 15
Push event: 249
Release event: 18
Watch event: 752
Total: 1630

Last Year

Create event: 30
Delete event: 22
Discussion event: 5
Fork event: 25
Issue comment event: 79
Issues event: 55
Pull request event: 54
Pull request review event: 4
Push event: 94
Release event: 8
Watch event: 206
Total: 582

Committers metadata

Last synced: 9 days ago

Total Commits: 239
Total Committers: 13
Avg Commits per committer: 18.385
Development Distribution Score (DDS): 0.075

Commits in past year: 47
Committers in past year: 7
Avg Commits per committer in past year: 6.714
Development Distribution Score (DDS) in past year: 0.128

Name	Email	Commits
Gilad S	g****d	221
Ido S	i**o@g**m	7
정석호	n**r@k**m	1
o-u-p	y**4@g**m	1
mcwindy	4****y	1
itsuka	1****v	1
WayOfTheMap	g**f@g**m	1
Vamshi krishna	v**6@r**t	1
Joshua Harding	j**h@s**m	1
Jon Holman	9****n	1
Hyeonggeun Yun	y**3@g**m	1
Gracie Gould	6****d	1
David	s**r@g**m	1

Issue and Pull Request metadata

Last synced: 9 days ago

Total issues: 142
Total pull requests: 356
Average time to close issues: 17 days
Average time to close pull requests: 2 days
Total issue authors: 103
Total pull request authors: 23
Average comments per issue: 2.54
Average comments per pull request: 0.94
Merged pull request: 311
Bot issues: 0
Bot pull requests: 0

Past year issues: 28
Past year pull requests: 38
Past year average time to close issues: 2 days
Past year average time to close pull requests: 1 day
Past year issue authors: 26
Past year pull request authors: 7
Past year average comments per issue: 2.39
Past year average comments per pull request: 0.39
Past year merged pull request: 25
Past year bot issues: 0
Past year bot pull requests: 0

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/withcatai/node-llama-cpp

Top Issue Authors

giladgd (10)
sooraj007 (8)
snowyu (4)
vlamanna (3)
loretoparisi (3)
ittaboba (3)
nigel-daniels (3)
StrangeBytesDev (2)
pankaj-kumar34 (2)
ExposedCat (2)
sroussey (2)
AliAzlanAziz (2)
ckvv (2)
stduhpf (2)
nathanlesage (2)

Top Pull Request Authors

giladgd (313)
ido-pluto (7)
anonyein (4)
Thomas101 (3)
yhg8423 (2)
jhstatewide (2)
eugeniosegala (2)
vlamanna (2)
B3none (2)
derek-wangpch (2)
JonHolman (2)
cmeka (2)
o-u-p (2)
stewartoallen (2)
wzgrx (1)

Top Issue Labels

bug (66)
requires triage (65)
new feature (49)
released on @beta (21)
released (13)
roadmap (12)
help wanted (4)
documentation (4)
unrelated (1)
question (1)
good first issue (1)
invalid (1)

Top Pull Request Labels

released (169)
released on @beta (88)

Package metadata

Total packages: 45
Total downloads:
- npm: 11,953,822 last-month
Total dependent packages: 3 (may contain duplicates)
Total dependent repositories: 1 (may contain duplicates)
Total versions: 1,049
Total maintainers: 6

proxy.golang.org: github.com/withcatai/node-llama-cpp

Homepage:
Documentation: https://pkg.go.dev/github.com/withcatai/node-llama-cpp#section-documentation
Licenses: mit
Latest release:
Last Synced: 2026-04-25T12:07:03.271Z (about 1 month ago)
Versions: 99
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent packages count: 6.528%
- Average: 6.747%
- Dependent repos count: 6.966%

npmjs.org: node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.18.1 (published 3 months ago)
Last Synced: 2026-05-03T21:05:22.194Z (29 days ago)
Versions: 136
Dependent Packages: 3
Dependent Repositories: 1
Downloads: 3,436,450 Last month
Rankings:
- Downloads: 3.202%
- Stargazers count: 7.628%
- Forks count: 10.14%
- Dependent repos count: 10.79%
- Average: 17.108%
- Dependent packages count: 53.778%
Maintainers (1)
- giladgd
Funding:
- type: github
- url: https://github.com/sponsors/giladgd

npmjs.org: @llama-cpp-node/mac-x64

Prebuilt binary for llama-cpp-node for macOS x64

Homepage: https://llama-cpp-node.withcat.ai
Licenses: MIT
Latest release: 0.1.0 (published 3 months ago)
Last Synced: 2026-05-18T02:46:34.076Z (15 days ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 15 Last month
Rankings:
- Downloads: 12.441%
- Average: 22.517%
- Dependent repos count: 22.573%
- Dependent packages count: 32.536%
Maintainers (1)
- andyye

npmjs.org: @node-llama-cpp/mac-arm64-metal

Prebuilt binary for node-llama-cpp for macOS arm64 with Metal support

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.18.1 (published 3 months ago)
Last Synced: 2026-04-27T18:04:07.582Z (about 1 month ago)
Versions: 46
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 854,221 Last month
Rankings:
- Downloads: 14.582%
- Dependent repos count: 25.769%
- Average: 25.925%
- Dependent packages count: 37.423%
Maintainers (1)
- giladgd

npmjs.org: @node-llama-cpp/linux-x64-vulkan

Prebuilt binary for node-llama-cpp for Linux x64 with Vulkan support

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.18.1 (published 3 months ago)
Last Synced: 2026-05-13T04:32:30.272Z (20 days ago)
Versions: 46
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 1,672,070 Last month
Rankings:
- Downloads: 14.72%
- Dependent repos count: 25.769%
- Average: 25.971%
- Dependent packages count: 37.423%
Maintainers (1)
- giladgd

npmjs.org: @node-llama-cpp/mac-x64

Prebuilt binary for node-llama-cpp for macOS x64

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.18.1 (published 3 months ago)
Last Synced: 2026-05-24T07:04:59.867Z (9 days ago)
Versions: 46
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 112,118 Last month
Rankings:
- Downloads: 14.868%
- Dependent repos count: 25.769%
- Average: 26.02%
- Dependent packages count: 37.423%
Maintainers (1)
- giladgd

npmjs.org: @node-llama-cpp/linux-armv7l

Prebuilt binary for node-llama-cpp for Linux armv7l

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.18.1 (published 3 months ago)
Last Synced: 2026-05-24T07:05:35.778Z (9 days ago)
Versions: 47
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 1,314,202 Last month
Rankings:
- Downloads: 15.154%
- Dependent repos count: 25.769%
- Average: 26.115%
- Dependent packages count: 37.423%
Maintainers (1)
- giladgd

npmjs.org: @node-llama-cpp/linux-x64

Prebuilt binary for node-llama-cpp for Linux x64

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.18.1 (published 3 months ago)
Last Synced: 2026-05-10T16:16:20.950Z (23 days ago)
Versions: 47
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 2,222,590 Last month
Rankings:
- Downloads: 15.154%
- Dependent repos count: 25.769%
- Average: 26.115%
- Dependent packages count: 37.423%
Maintainers (1)
- giladgd

npmjs.org: custom-koya-node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level

Homepage: https://withcatai.github.io/node-llama-cpp/
Licenses: MIT
Latest release: 0.1.0 (published almost 2 years ago)
Last Synced: 2026-05-17T15:40:31.977Z (16 days ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 7 Last month
Rankings:
- Downloads: 14.714%
- Dependent repos count: 26.038%
- Average: 26.193%
- Dependent packages count: 37.827%
Maintainers (1)
- shakeebaftab-koya

npmjs.org: @llama-cpp-node/linux-armv7l

Prebuilt binary for llama-cpp-node for Linux armv7l

Homepage: https://llama-cpp-node.withcat.ai
Licenses: MIT
Latest release: 0.1.0 (published 3 months ago)
Last Synced: 2026-05-03T21:05:49.069Z (29 days ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 11 Last month
Rankings:
- Dependent repos count: 22.573%
- Average: 27.554%
- Dependent packages count: 32.536%
Maintainers (1)
- andyye

npmjs.org: @llama-cpp-node/win-x64-cuda

Prebuilt binary for llama-cpp-node for Windows x64 with CUDA support

Homepage: https://llama-cpp-node.withcat.ai
Licenses: MIT
Latest release: 0.1.0 (published 3 months ago)
Last Synced: 2026-05-08T14:02:33.192Z (25 days ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent repos count: 22.573%
- Average: 27.554%
- Dependent packages count: 32.536%
Maintainers (1)
- andyye

npmjs.org: @llama-cpp-node/linux-arm64

Prebuilt binary for llama-cpp-node for Linux arm64

Homepage: https://llama-cpp-node.withcat.ai
Licenses: MIT
Latest release: 0.1.0 (published 3 months ago)
Last Synced: 2026-05-03T21:04:16.108Z (29 days ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 13 Last month
Rankings:
- Dependent repos count: 22.573%
- Average: 27.554%
- Dependent packages count: 32.536%
Maintainers (1)
- andyye

npmjs.org: @llama-cpp-node/linux-x64-cuda-ext

Extension of @llama-cpp-node/linux-x64-cuda - prebuilt binary for llama-cpp-node for Linux x64 with CUDA support

Homepage: https://llama-cpp-node.withcat.ai
Licenses: MIT
Latest release: 0.1.0 (published 3 months ago)
Last Synced: 2026-05-03T21:05:23.143Z (29 days ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent repos count: 22.573%
- Average: 27.554%
- Dependent packages count: 32.536%
Maintainers (1)
- andyye

npmjs.org: @llama-cpp-node/linux-x64

Prebuilt binary for llama-cpp-node for Linux x64

Homepage: https://llama-cpp-node.withcat.ai
Licenses: MIT
Latest release: 0.1.0 (published 3 months ago)
Last Synced: 2026-05-03T21:04:33.895Z (29 days ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 9 Last month
Rankings:
- Dependent repos count: 22.573%
- Average: 27.554%
- Dependent packages count: 32.536%
Maintainers (1)
- andyye

npmjs.org: @llama-cpp-node/linux-x64-vulkan

Prebuilt binary for llama-cpp-node for Linux x64 with Vulkan support

Homepage: https://llama-cpp-node.withcat.ai
Licenses: MIT
Latest release: 0.1.0 (published 3 months ago)
Last Synced: 2026-05-03T21:05:50.375Z (29 days ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 13 Last month
Rankings:
- Dependent repos count: 22.573%
- Average: 27.554%
- Dependent packages count: 32.536%
Maintainers (1)
- andyye

npmjs.org: @llama-cpp-node/linux-x64-cuda

Prebuilt binary for llama-cpp-node for Linux x64 with CUDA support

Homepage: https://llama-cpp-node.withcat.ai
Licenses: MIT
Latest release: 0.1.0 (published 3 months ago)
Last Synced: 2026-05-03T21:05:47.922Z (29 days ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent repos count: 22.573%
- Average: 27.554%
- Dependent packages count: 32.536%
Maintainers (1)
- andyye

npmjs.org: @llama-cpp-node/mac-arm64-metal

Prebuilt binary for llama-cpp-node for macOS arm64 with Metal support

Homepage: https://llama-cpp-node.withcat.ai
Licenses: MIT
Latest release: 0.1.0 (published 3 months ago)
Last Synced: 2026-05-21T09:17:04.515Z (12 days ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent repos count: 22.573%
- Average: 27.554%
- Dependent packages count: 32.536%
Maintainers (1)
- andyye

npmjs.org: @llama-cpp-node/win-x64

Prebuilt binary for llama-cpp-node for Windows x64

Homepage: https://llama-cpp-node.withcat.ai
Licenses: MIT
Latest release: 0.1.0 (published 3 months ago)
Last Synced: 2026-05-18T04:05:04.824Z (15 days ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent repos count: 22.573%
- Average: 27.554%
- Dependent packages count: 32.536%
Maintainers (1)
- andyye

npmjs.org: @llama-cpp-node/win-arm64

Prebuilt binary for llama-cpp-node for Windows arm64

Homepage: https://llama-cpp-node.withcat.ai
Licenses: MIT
Latest release: 0.1.0 (published 3 months ago)
Last Synced: 2026-05-24T07:05:00.567Z (9 days ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 12 Last month
Rankings:
- Dependent repos count: 22.573%
- Average: 27.554%
- Dependent packages count: 32.536%
Maintainers (1)
- andyye

npmjs.org: @llama-cpp-node/win-x64-cuda-ext

Extension of @llama-cpp-node/win-x64-cuda - prebuilt binary for llama-cpp-node for Windows x64 with CUDA support

Homepage: https://llama-cpp-node.withcat.ai
Licenses: MIT
Latest release: 0.1.0 (published 3 months ago)
Last Synced: 2026-05-07T09:06:13.314Z (26 days ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent repos count: 22.607%
- Average: 27.596%
- Dependent packages count: 32.586%
Maintainers (1)
- andyye

npmjs.org: @llama-cpp-node/win-x64-vulkan

Prebuilt binary for llama-cpp-node for Windows x64 with Vulkan support

Homepage: https://llama-cpp-node.withcat.ai
Licenses: MIT
Latest release: 0.1.0 (published 3 months ago)
Last Synced: 2026-05-24T07:04:56.554Z (9 days ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 10 Last month
Rankings:
- Dependent repos count: 22.607%
- Average: 27.596%
- Dependent packages count: 32.586%
Maintainers (1)
- andyye

npmjs.org: create-llama-cpp-node

Scaffold a new llama-cpp-node project from a template

Homepage: https://llama-cpp-node.withcat.ai
Licenses: MIT
Latest release: 0.1.0 (published 3 months ago)
Last Synced: 2026-05-07T01:18:25.890Z (26 days ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent repos count: 22.607%
- Average: 27.596%
- Dependent packages count: 32.586%
Maintainers (1)
- andyye
Funding:
- type: github
- url: https://github.com/sponsors/giladgd

npmjs.org: @plugos-org/node-llama-cpp-android-arm64

Prebuilt binary for node-llama-cpp for Android arm64

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.15.1-0 (published 4 months ago)
Last Synced: 2026-05-14T02:05:23.186Z (19 days ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent repos count: 22.945%
- Average: 28.013%
- Dependent packages count: 33.081%
Maintainers (1)
- plugos_lzn

npmjs.org: @plugos-org/node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.15.1 (published 4 months ago)
Last Synced: 2026-05-03T21:05:49.619Z (29 days ago)
Versions: 3
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent repos count: 22.945%
- Average: 28.013%
- Dependent packages count: 33.081%
Maintainers (1)
- plugos_lzn
Funding:
- type: github
- url: https://github.com/sponsors/giladgd

npmjs.org: @node-llama-cpp/linux-x64-cuda-ext

Extension of @node-llama-cpp/linux-x64-cuda - prebuilt binary for node-llama-cpp for Linux x64 with CUDA support

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.18.1 (published 3 months ago)
Last Synced: 2026-05-03T21:05:23.080Z (29 days ago)
Versions: 19
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 685,716 Last month
Rankings:
- Dependent repos count: 23.968%
- Average: 29.272%
- Dependent packages count: 34.577%
Maintainers (1)
- giladgd

npmjs.org: @node-llama-cpp/win-x64-cuda-ext

Extension of @node-llama-cpp/win-x64-cuda - prebuilt binary for node-llama-cpp for Windows x64 with CUDA support

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.18.1 (published 3 months ago)
Last Synced: 2026-05-03T21:04:59.268Z (29 days ago)
Versions: 19
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 318,576 Last month
Rankings:
- Dependent repos count: 23.968%
- Average: 29.272%
- Dependent packages count: 34.577%
Maintainers (1)
- giladgd

npmjs.org: @aibrow/create-node-llama-cpp

Scaffold a new node-llama-cpp project from a template

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 1.3.3 (published about 1 year ago)
Last Synced: 2026-05-22T13:01:34.784Z (11 days ago)
Versions: 5
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 13 Last month
Rankings:
- Dependent repos count: 24.675%
- Average: 30.146%
- Dependent packages count: 35.617%
Maintainers (2)
- thomas101
- rhys101
Funding:
- type: github
- url: https://github.com/sponsors/giladgd

npmjs.org: @aibrow/node-llama-cpp-win-x64

Prebuilt binary for node-llama-cpp for Windows x64

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 1.7.0 (published 11 months ago)
Last Synced: 2026-05-18T12:22:47.973Z (15 days ago)
Versions: 14
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 161 Last month
Rankings:
- Dependent repos count: 24.682%
- Average: 30.154%
- Dependent packages count: 35.626%
Maintainers (2)
- thomas101
- rhys101

npmjs.org: @aibrow/node-llama-cpp-mac-x64

Prebuilt binary for node-llama-cpp for macOS x64

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 1.7.0 (published 11 months ago)
Last Synced: 2026-05-14T02:05:11.455Z (19 days ago)
Versions: 14
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 637 Last month
Rankings:
- Dependent repos count: 24.682%
- Average: 30.154%
- Dependent packages count: 35.626%
Maintainers (2)
- thomas101
- rhys101

npmjs.org: @aibrow/node-llama-cpp-linux-armv7l

Prebuilt binary for node-llama-cpp for Linux armv7l

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 1.7.0 (published 11 months ago)
Last Synced: 2026-05-14T02:05:16.899Z (19 days ago)
Versions: 14
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 13 Last month
Rankings:
- Dependent repos count: 24.682%
- Average: 30.154%
- Dependent packages count: 35.626%
Maintainers (2)
- thomas101
- rhys101

npmjs.org: @aibrow/node-llama-cpp-linux-x64

Prebuilt binary for node-llama-cpp for Linux x64

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 1.7.0 (published 11 months ago)
Last Synced: 2026-05-04T02:33:13.822Z (29 days ago)
Versions: 14
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 19 Last month
Rankings:
- Dependent repos count: 24.682%
- Average: 30.154%
- Dependent packages count: 35.626%
Maintainers (2)
- thomas101
- rhys101

npmjs.org: @aibrow/node-llama-cpp-win-x64-cuda

Prebuilt binary for node-llama-cpp for Windows x64 with CUDA support

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 1.7.0 (published 11 months ago)
Last Synced: 2026-05-24T07:05:41.196Z (9 days ago)
Versions: 14
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 157 Last month
Rankings:
- Dependent repos count: 24.682%
- Average: 30.154%
- Dependent packages count: 35.626%
Maintainers (2)
- thomas101
- rhys101

npmjs.org: @aibrow/node-llama-cpp-linux-arm64

Prebuilt binary for node-llama-cpp for Linux arm64

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 1.7.0 (published 11 months ago)
Last Synced: 2026-05-06T23:46:43.317Z (26 days ago)
Versions: 14
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 9 Last month
Rankings:
- Dependent repos count: 24.682%
- Average: 30.154%
- Dependent packages count: 35.626%
Maintainers (2)
- thomas101
- rhys101

npmjs.org: @aibrow/node-llama-cpp-win-x64-vulkan

Prebuilt binary for node-llama-cpp for Windows x64 with Vulkan support

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 1.7.0 (published 11 months ago)
Last Synced: 2026-04-03T12:30:58.048Z (about 2 months ago)
Versions: 14
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 14 Last month
Rankings:
- Dependent repos count: 24.682%
- Average: 30.154%
- Dependent packages count: 35.626%
Maintainers (2)
- thomas101
- rhys101

npmjs.org: @aibrow/node-llama-cpp-linux-x64-cuda

Prebuilt binary for node-llama-cpp for Linux x64 with CUDA support

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 1.7.0 (published 11 months ago)
Last Synced: 2026-05-13T10:54:39.944Z (20 days ago)
Versions: 14
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 14 Last month
Rankings:
- Dependent repos count: 24.682%
- Average: 30.154%
- Dependent packages count: 35.626%
Maintainers (2)
- thomas101
- rhys101

npmjs.org: @aibrow/node-llama-cpp-mac-arm64-metal

Prebuilt binary for node-llama-cpp for macOS arm64 with Metal support

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 1.7.0 (published 11 months ago)
Last Synced: 2026-05-13T14:45:35.112Z (20 days ago)
Versions: 14
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 31 Last month
Rankings:
- Dependent repos count: 24.682%
- Average: 30.154%
- Dependent packages count: 35.626%
Maintainers (2)
- thomas101
- rhys101

npmjs.org: @aibrow/node-llama-cpp-linux-x64-vulkan

Prebuilt binary for node-llama-cpp for Linux x64 with Vulkan support

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 1.7.0 (published 11 months ago)
Last Synced: 2026-05-24T07:04:51.633Z (9 days ago)
Versions: 14
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 27 Last month
Rankings:
- Dependent repos count: 24.682%
- Average: 30.154%
- Dependent packages count: 35.626%
Maintainers (2)
- thomas101
- rhys101

npmjs.org: @aibrow/node-llama-cpp-win-arm64

Prebuilt binary for node-llama-cpp for Windows arm64

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 1.7.0 (published 11 months ago)
Last Synced: 2026-05-24T07:05:35.645Z (9 days ago)
Versions: 14
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 138 Last month
Rankings:
- Dependent repos count: 24.682%
- Average: 30.154%
- Dependent packages count: 35.626%
Maintainers (2)
- thomas101
- rhys101

npmjs.org: @node-llama-cpp/win-x64-vulkan

Prebuilt binary for node-llama-cpp for Windows x64 with Vulkan support

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.18.1 (published 3 months ago)
Last Synced: 2026-04-24T01:02:06.247Z (about 1 month ago)
Versions: 46
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 3,383 Last month
Rankings:
- Dependent repos count: 25.779%
- Average: 31.609%
- Dependent packages count: 37.439%
Maintainers (1)
- giladgd

npmjs.org: @node-llama-cpp/linux-arm64

Prebuilt binary for node-llama-cpp for Linux arm64

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.18.1 (published 3 months ago)
Last Synced: 2026-05-06T15:11:06.956Z (27 days ago)
Versions: 47
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 22,266 Last month
Rankings:
- Dependent repos count: 25.779%
- Average: 31.609%
- Dependent packages count: 37.439%
Maintainers (1)
- giladgd

npmjs.org: @node-llama-cpp/win-x64

Prebuilt binary for node-llama-cpp for Windows x64

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.18.1 (published 3 months ago)
Last Synced: 2026-05-14T02:05:17.209Z (19 days ago)
Versions: 46
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 240,077 Last month
Rankings:
- Dependent repos count: 25.779%
- Average: 31.609%
- Dependent packages count: 37.439%
Maintainers (1)
- giladgd

npmjs.org: @node-llama-cpp/win-arm64

Prebuilt binary for node-llama-cpp for Windows arm64

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.18.1 (published 3 months ago)
Last Synced: 2026-05-24T07:05:36.077Z (9 days ago)
Versions: 46
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 153,487 Last month
Rankings:
- Dependent repos count: 25.779%
- Average: 31.609%
- Dependent packages count: 37.439%
Maintainers (1)
- giladgd

npmjs.org: @node-llama-cpp/linux-x64-cuda

Prebuilt binary for node-llama-cpp for Linux x64 with CUDA support

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.18.1 (published 3 months ago)
Last Synced: 2026-04-03T13:01:44.391Z (about 2 months ago)
Versions: 58
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 21,667 Last month
Rankings:
- Dependent repos count: 27.635%
- Average: 33.896%
- Dependent packages count: 40.158%
Maintainers (1)
- giladgd

npmjs.org: @node-llama-cpp/win-x64-cuda

Prebuilt binary for node-llama-cpp for Windows x64 with CUDA support

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.18.1 (published 3 months ago)
Last Synced: 2026-04-27T18:05:08.598Z (about 1 month ago)
Versions: 58
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 895,443 Last month
Rankings:
- Dependent repos count: 27.635%
- Average: 33.896%
- Dependent packages count: 40.158%
Maintainers (1)
- giladgd

npmjs.org: create-node-llama-cpp

Scaffold a new node-llama-cpp project from a template

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.18.1 (published 3 months ago)
Last Synced: 2026-04-21T05:42:28.349Z (about 1 month ago)
Versions: 65
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 233 Last month
Rankings:
- Dependent repos count: 29.297%
- Average: 35.609%
- Dependent packages count: 41.922%
Maintainers (1)
- giladgd
Funding:
- type: github
- url: https://github.com/sponsors/giladgd

Dependencies

.github/workflows/build.yml actions

actions/checkout v3 composite
actions/deploy-pages v2 composite
actions/download-artifact v3 composite
actions/setup-node v3 composite
actions/setup-python v4 composite
actions/upload-artifact v3 composite
actions/upload-pages-artifact v2 composite

.github/workflows/prLint.yml actions

amannn/action-semantic-pull-request v5 composite

.github/workflows/test.yml actions

actions/checkout v3 composite
actions/setup-node v3 composite

package-lock.json npm

895 dependencies

package.json npm

@commitlint/cli ^17.7.1 development
@commitlint/config-conventional ^17.7.0 development
@semantic-release/exec ^6.0.3 development
@types/bytes ^3.1.1 development
@types/cli-progress ^3.11.0 development
@types/cross-spawn ^6.0.2 development
@types/fs-extra ^11.0.1 development
@types/node ^20.4.9 development
@types/uuid ^9.0.2 development
@types/yargs ^17.0.24 development
@typescript-eslint/eslint-plugin ^6.3.0 development
@typescript-eslint/parser ^6.3.0 development
eslint ^8.46.0 development
eslint-plugin-import ^2.28.0 development
eslint-plugin-node github:giladgd/eslint-plugin-node#dev/giladgd/fixImportExtentionFixingInTypeScript development
husky ^8.0.3 development
semantic-release ^21.0.7 development
ts-node ^10.9.1 development
tslib ^2.6.1 development
typedoc ^0.24.8 development
typescript ^5.1.6 development
zx ^7.2.3 development
chalk ^5.3.0
cli-progress ^3.12.0
cross-env ^7.0.3
cross-spawn ^7.0.3
env-var ^7.3.1
fs-extra ^11.1.1
node-addon-api ^7.0.0
node-gyp ^9.4.0
octokit ^3.1.0
ora ^7.0.1
simple-git ^3.19.1
uuid ^9.0.0
yargs ^17.7.2

llama/xpack/package.json npm

packages/@node-llama-cpp/linux-arm64/package-lock.json npm

typescript 5.5.2 development

packages/@node-llama-cpp/linux-x64-cuda/package.json npm

typescript ^5.2.2 development

packages/@node-llama-cpp/win-arm64/package.json npm

typescript ^5.2.2 development

templates/package.json npm

eslint-plugin-react-hooks ^4.6.0 development
eslint-plugin-react-refresh ^0.4.5 development

packages/@node-llama-cpp/mac-x64/package-lock.json npm

typescript 5.5.2 development

packages/@node-llama-cpp/linux-x64-cuda/package-lock.json npm

typescript 5.5.2 development

packages/@node-llama-cpp/win-x64-vulkan/package.json npm

typescript ^5.2.2 development

packages/@node-llama-cpp/linux-x64-cuda-ext/package.json npm

typescript ^5.2.2 development

packages/@node-llama-cpp/win-x64-cuda/package.json npm

typescript ^5.2.2 development

llama/package.json npm

packages/@node-llama-cpp/linux-x64/package.json npm

typescript ^5.2.2 development

packages/@node-llama-cpp/linux-x64-vulkan/package-lock.json npm

typescript 5.5.2 development

packages/@node-llama-cpp/linux-x64/package-lock.json npm

typescript 5.5.2 development

packages/@node-llama-cpp/win-arm64/package-lock.json npm

typescript 5.5.2 development

packages/@node-llama-cpp/win-x64/package-lock.json npm

typescript 5.5.2 development

templates/package-lock.json npm

101 dependencies

packages/@node-llama-cpp/win-x64-cuda/package-lock.json npm

typescript 5.5.2 development

packages/@node-llama-cpp/linux-x64-vulkan/package.json npm

typescript ^5.2.2 development

packages/@node-llama-cpp/mac-x64/package.json npm

typescript ^5.2.2 development

templates/node-typescript/package.json npm

@stylistic/eslint-plugin ^4.2.0 development
@types/node ^22.15.17 development
eslint ^9.26.0 development
eslint-import-resolver-typescript ^4.3.4 development
eslint-plugin-import ^2.31.0 development
eslint-plugin-jsdoc ^50.6.11 development
eslint-plugin-n ^17.17.0 development
rimraf ^6.0.1 development
tslib ^2.8.1 development
typescript ^5.8.3 development
typescript-eslint ^8.32.0 development
vite-node ^3.1.3 development
chalk ^5.4.1
node-llama-cpp file:../..

packages/@node-llama-cpp/linux-arm64/package.json npm

typescript ^5.2.2 development

packages/@node-llama-cpp/win-x64/package.json npm

typescript ^5.2.2 development

packages/@node-llama-cpp/win-x64-cuda-ext/package-lock.json npm

typescript 5.5.2 development

packages/@node-llama-cpp/linux-armv7l/package-lock.json npm

typescript 5.5.2 development

packages/@node-llama-cpp/linux-armv7l/package.json npm

typescript ^5.2.2 development

packages/@node-llama-cpp/mac-arm64-metal/package-lock.json npm

typescript 5.5.2 development

packages/@node-llama-cpp/win-x64-vulkan/package-lock.json npm

typescript 5.5.2 development

packages/create-node-llama-cpp/package.json npm

typescript ^5.2.2 development
node-llama-cpp file:../..

packages/@node-llama-cpp/linux-x64-cuda-ext/package-lock.json npm

typescript 5.5.2 development

packages/@node-llama-cpp/mac-arm64-metal/package.json npm

typescript ^5.2.2 development

packages/@node-llama-cpp/win-x64-cuda-ext/package.json npm

typescript ^5.2.2 development

packages/create-node-llama-cpp/package-lock.json npm

typescript 5.4.5 development
node-llama-cpp *

templates/electron-typescript-react/package.json npm

@stylistic/eslint-plugin ^4.2.0 development
@types/markdown-it ^14.1.2 development
@types/react ^19.1.3 development
@types/react-dom ^19.1.3 development
@types/semver ^7.7.0 development
@vitejs/plugin-react ^4.4.1 development
cross-env ^10.0.0 development
electron ^36.2.0 development
electron-builder ^26.0.12 development
eslint ^9.26.0 development
eslint-import-resolver-typescript ^4.3.4 development
eslint-plugin-import ^2.31.0 development
eslint-plugin-jsdoc ^50.6.11 development
eslint-plugin-react-hooks ^5.2.0 development
eslint-plugin-react-refresh ^0.4.20 development
rimraf ^6.0.1 development
typescript ^5.8.3 development
typescript-eslint ^8.32.0 development
vite ^6.3.5 development
vite-plugin-electron ^0.29.0 development
vite-plugin-electron-renderer ^0.14.6 development
zx ^8.5.3 development
@fontsource-variable/inter ^5.2.5
birpc ^2.3.0
classnames ^2.5.1
highlight.js ^11.11.1
lifecycle-utils ^3.0.1
markdown-it ^14.1.0
node-llama-cpp file:../..
pretty-ms ^9.2.0
react ^19.1.0
react-dom ^19.1.0
semver ^7.7.1