node-llama-cpp

ai bindings catai cmake cmake-js cuda embedding function-calling gguf gpu grammar json-schema llama llama-cpp llm metal nodejs prebuilt-binaries self-hosted vulkan

Score: 21.942972791764575

Last synced: about 9 hours ago
JSON representation

Repository metadata:

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

Host: GitHub
URL: https://github.com/withcatai/node-llama-cpp
Owner: withcatai
License: mit
Created: 2023-08-12T20:53:16.000Z (over 2 years ago)
Default Branch: master
Last Pushed: 2025-10-26T19:43:19.000Z (3 months ago)
Last Synced: 2025-11-13T09:03:22.801Z (3 months ago)
Topics: ai, bindings, catai, cmake, cmake-js, cuda, embedding, function-calling, gguf, gpu, grammar, json-schema, llama, llama-cpp, llm, metal, nodejs, prebuilt-binaries, self-hosted, vulkan
Language: TypeScript
Homepage: https://node-llama-cpp.withcat.ai
Size: 22.7 MB
Stars: 1,745
Watchers: 21
Forks: 155
Open Issues: 10
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- Funding: .github/FUNDING.yml
- License: LICENSE
Funding:
- Github: giladgd

Owner metadata:

Name: CatAI
Login: withcatai
Email:
Kind: organization
Description: AI models run with nodejs locally on your machine
Website:
Location:
Twitter:
Company:
Icon url: https://avatars.githubusercontent.com/u/142035548?v=4
Repositories: 1
Last Synced at: 2023-08-12T22:29:40.676Z
Profile URL: https://github.com/withcatai

GitHub Events

Total

Create event: 58
Delete event: 38
Discussion event: 2
Fork event: 52
Issue comment event: 171
Issues event: 71
Pull request event: 87
Pull request review event: 15
Push event: 211
Release event: 16
Watch event: 675
Total: 1396

Last Year

Create event: 53
Delete event: 34
Discussion event: 2
Fork event: 49
Issue comment event: 148
Issues event: 63
Pull request event: 82
Pull request review event: 14
Push event: 200
Release event: 15
Watch event: 603
Total: 1263

Committers metadata

Last synced: 3 months ago

Total Commits: 216
Total Committers: 8
Avg Commits per committer: 27.0
Development Distribution Score (DDS): 0.06

Commits in past year: 45
Committers in past year: 3
Avg Commits per committer in past year: 15.0
Development Distribution Score (DDS) in past year: 0.044

Name	Email	Commits
Gilad S	g****d	203
Ido S	i**o@g**m	7
o-u-p	y**4@g**m	1
itsuka	1****v	1
Joshua Harding	j**h@s**m	1
Jon Holman	9****n	1
Hyeonggeun Yun	y**3@g**m	1
David	s**r@g**m	1

Issue and Pull Request metadata

Last synced: 3 months ago

Total issues: 127
Total pull requests: 350
Average time to close issues: 17 days
Average time to close pull requests: 2 days
Total issue authors: 91
Total pull request authors: 18
Average comments per issue: 2.44
Average comments per pull request: 0.95
Merged pull request: 310
Bot issues: 0
Bot pull requests: 0

Past year issues: 32
Past year pull requests: 82
Past year average time to close issues: 8 days
Past year average time to close pull requests: 2 days
Past year issue authors: 30
Past year pull request authors: 6
Past year average comments per issue: 1.72
Past year average comments per pull request: 0.5
Past year merged pull request: 64
Past year bot issues: 0
Past year bot pull requests: 0

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/withcatai/node-llama-cpp

Top Issue Authors

giladgd (10)
sooraj007 (8)
snowyu (4)
vlamanna (3)
loretoparisi (3)
nigel-daniels (3)
StrangeBytesDev (2)
pankaj-kumar34 (2)
arthurwolf (2)
ckvv (2)
AliAzlanAziz (2)
bitterspeed (2)
ExposedCat (2)
saul-jb (2)
stduhpf (2)

Top Pull Request Authors

giladgd (312)
ido-pluto (7)
anonyein (4)
Thomas101 (3)
vlamanna (2)
B3none (2)
derek-wangpch (2)
cmeka (2)
stewartoallen (2)
o-u-p (2)
JonHolman (2)
jhstatewide (2)
yhg8423 (2)
eugeniosegala (2)
nigel-daniels (1)

Top Issue Labels

bug (62)
requires triage (57)
new feature (43)
released on @beta (21)
released (13)
roadmap (12)
help wanted (4)
documentation (4)
question (1)
unrelated (1)
invalid (1)
good first issue (1)

Top Pull Request Labels

released (169)
released on @beta (88)

Package metadata

Total packages: 29
Total downloads:
- npm: 241,174 last-month
Total dependent packages: 3 (may contain duplicates)
Total dependent repositories: 1 (may contain duplicates)
Total versions: 853
Total maintainers: 4

proxy.golang.org: github.com/withcatai/node-llama-cpp

Homepage:
Documentation: https://pkg.go.dev/github.com/withcatai/node-llama-cpp#section-documentation
Licenses: mit
Latest release:
Last Synced: 2024-10-29T10:09:35.047Z (over 1 year ago)
Versions: 99
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent packages count: 6.528%
- Average: 6.747%
- Dependent repos count: 6.966%

npmjs.org: node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.14.2 (published 3 months ago)
Last Synced: 2025-11-15T10:03:11.211Z (3 months ago)
Versions: 124
Dependent Packages: 3
Dependent Repositories: 1
Downloads: 48,924 Last month
Rankings:
- Downloads: 3.202%
- Stargazers count: 7.628%
- Forks count: 10.14%
- Dependent repos count: 10.79%
- Average: 17.108%
- Dependent packages count: 53.778%
Maintainers (1)
- giladgd
Funding:
- type: github
- url: https://github.com/sponsors/giladgd

npmjs.org: @node-llama-cpp/mac-arm64-metal

Prebuilt binary for node-llama-cpp for macOS arm64 with Metal support

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.14.2 (published 3 months ago)
Last Synced: 2025-11-09T07:04:02.314Z (3 months ago)
Versions: 34
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 4,281 Last month
Rankings:
- Downloads: 14.582%
- Dependent repos count: 25.769%
- Average: 25.925%
- Dependent packages count: 37.423%
Maintainers (1)
- giladgd

npmjs.org: @node-llama-cpp/linux-x64-vulkan

Prebuilt binary for node-llama-cpp for Linux x64 with Vulkan support

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.14.2 (published 3 months ago)
Last Synced: 2025-11-01T03:04:03.418Z (3 months ago)
Versions: 34
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 31,502 Last month
Rankings:
- Downloads: 14.72%
- Dependent repos count: 25.769%
- Average: 25.971%
- Dependent packages count: 37.423%
Maintainers (1)
- giladgd

npmjs.org: @node-llama-cpp/mac-x64

Prebuilt binary for node-llama-cpp for macOS x64

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.14.2 (published 3 months ago)
Last Synced: 2025-11-01T03:04:01.132Z (3 months ago)
Versions: 34
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 2,423 Last month
Rankings:
- Downloads: 14.868%
- Dependent repos count: 25.769%
- Average: 26.02%
- Dependent packages count: 37.423%
Maintainers (1)
- giladgd

npmjs.org: @node-llama-cpp/linux-x64

Prebuilt binary for node-llama-cpp for Linux x64

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.14.2 (published 3 months ago)
Last Synced: 2025-11-13T09:07:34.172Z (3 months ago)
Versions: 35
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 29,456 Last month
Rankings:
- Downloads: 15.154%
- Dependent repos count: 25.769%
- Average: 26.115%
- Dependent packages count: 37.423%
Maintainers (1)
- giladgd

npmjs.org: @node-llama-cpp/linux-armv7l

Prebuilt binary for node-llama-cpp for Linux armv7l

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.14.2 (published 3 months ago)
Last Synced: 2025-11-13T09:07:28.425Z (3 months ago)
Versions: 35
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 30,415 Last month
Rankings:
- Downloads: 15.154%
- Dependent repos count: 25.769%
- Average: 26.115%
- Dependent packages count: 37.423%
Maintainers (1)
- giladgd

npmjs.org: custom-koya-node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level

Homepage: https://withcatai.github.io/node-llama-cpp/
Licenses: MIT
Latest release: 0.1.0 (published over 1 year ago)
Last Synced: 2025-11-01T03:04:02.566Z (3 months ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 40 Last month
Rankings:
- Downloads: 14.714%
- Dependent repos count: 26.038%
- Average: 26.193%
- Dependent packages count: 37.827%
Maintainers (1)
- shakeebaftab-koya

npmjs.org: @node-llama-cpp/win-x64-cuda-ext

Extension of @node-llama-cpp/win-x64-cuda - prebuilt binary for node-llama-cpp for Windows x64 with CUDA support

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.14.2 (published 3 months ago)
Last Synced: 2025-11-09T07:04:20.171Z (3 months ago)
Versions: 7
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 2,234 Last month
Rankings:
- Dependent repos count: 23.968%
- Average: 29.272%
- Dependent packages count: 34.577%
Maintainers (1)
- giladgd

npmjs.org: @node-llama-cpp/linux-x64-cuda-ext

Extension of @node-llama-cpp/linux-x64-cuda - prebuilt binary for node-llama-cpp for Linux x64 with CUDA support

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.14.2 (published 3 months ago)
Last Synced: 2025-11-15T10:03:09.619Z (3 months ago)
Versions: 7
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 10,192 Last month
Rankings:
- Dependent repos count: 23.968%
- Average: 29.272%
- Dependent packages count: 34.577%
Maintainers (1)
- giladgd

npmjs.org: @aibrow/create-node-llama-cpp

Scaffold a new node-llama-cpp project from a template

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 1.3.3 (published 9 months ago)
Last Synced: 2025-11-09T07:04:00.808Z (3 months ago)
Versions: 5
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 53 Last month
Rankings:
- Dependent repos count: 24.675%
- Average: 30.146%
- Dependent packages count: 35.617%
Maintainers (2)
- thomas101
- rhys101
Funding:
- type: github
- url: https://github.com/sponsors/giladgd

npmjs.org: @aibrow/node-llama-cpp-linux-x64

Prebuilt binary for node-llama-cpp for Linux x64

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 1.7.0 (published 7 months ago)
Last Synced: 2025-11-15T10:03:10.226Z (3 months ago)
Versions: 14
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 207 Last month
Rankings:
- Dependent repos count: 24.682%
- Average: 30.154%
- Dependent packages count: 35.626%
Maintainers (2)
- thomas101
- rhys101

npmjs.org: @aibrow/node-llama-cpp-win-arm64

Prebuilt binary for node-llama-cpp for Windows arm64

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 1.7.0 (published 7 months ago)
Last Synced: 2025-11-13T09:08:04.700Z (3 months ago)
Versions: 14
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 90 Last month
Rankings:
- Dependent repos count: 24.682%
- Average: 30.154%
- Dependent packages count: 35.626%
Maintainers (2)
- thomas101
- rhys101

npmjs.org: @aibrow/node-llama-cpp-linux-arm64

Prebuilt binary for node-llama-cpp for Linux arm64

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 1.7.0 (published 7 months ago)
Last Synced: 2025-11-13T09:08:03.881Z (3 months ago)
Versions: 14
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 579 Last month
Rankings:
- Dependent repos count: 24.682%
- Average: 30.154%
- Dependent packages count: 35.626%
Maintainers (2)
- thomas101
- rhys101

npmjs.org: @aibrow/node-llama-cpp-win-x64

Prebuilt binary for node-llama-cpp for Windows x64

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 1.7.0 (published 7 months ago)
Last Synced: 2025-11-13T09:07:51.460Z (3 months ago)
Versions: 14
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 540 Last month
Rankings:
- Dependent repos count: 24.682%
- Average: 30.154%
- Dependent packages count: 35.626%
Maintainers (2)
- thomas101
- rhys101

npmjs.org: @aibrow/node-llama-cpp-win-x64-vulkan

Prebuilt binary for node-llama-cpp for Windows x64 with Vulkan support

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 1.7.0 (published 7 months ago)
Last Synced: 2025-11-13T09:07:40.406Z (3 months ago)
Versions: 14
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 629 Last month
Rankings:
- Dependent repos count: 24.682%
- Average: 30.154%
- Dependent packages count: 35.626%
Maintainers (2)
- thomas101
- rhys101

npmjs.org: @aibrow/node-llama-cpp-win-x64-cuda

Prebuilt binary for node-llama-cpp for Windows x64 with CUDA support

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 1.7.0 (published 7 months ago)
Last Synced: 2025-11-13T09:07:40.188Z (3 months ago)
Versions: 14
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 555 Last month
Rankings:
- Dependent repos count: 24.682%
- Average: 30.154%
- Dependent packages count: 35.626%
Maintainers (2)
- thomas101
- rhys101

npmjs.org: @aibrow/node-llama-cpp-linux-x64-cuda

Prebuilt binary for node-llama-cpp for Linux x64 with CUDA support

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 1.7.0 (published 7 months ago)
Last Synced: 2025-11-01T03:03:21.517Z (3 months ago)
Versions: 14
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 610 Last month
Rankings:
- Dependent repos count: 24.682%
- Average: 30.154%
- Dependent packages count: 35.626%
Maintainers (2)
- thomas101
- rhys101

npmjs.org: @aibrow/node-llama-cpp-mac-x64

Prebuilt binary for node-llama-cpp for macOS x64

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 1.7.0 (published 7 months ago)
Last Synced: 2025-11-13T09:08:03.880Z (3 months ago)
Versions: 14
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 637 Last month
Rankings:
- Dependent repos count: 24.682%
- Average: 30.154%
- Dependent packages count: 35.626%
Maintainers (2)
- thomas101
- rhys101

npmjs.org: @aibrow/node-llama-cpp-linux-x64-vulkan

Prebuilt binary for node-llama-cpp for Linux x64 with Vulkan support

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 1.7.0 (published 7 months ago)
Last Synced: 2025-11-01T03:03:41.195Z (3 months ago)
Versions: 14
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 438 Last month
Rankings:
- Dependent repos count: 24.682%
- Average: 30.154%
- Dependent packages count: 35.626%
Maintainers (2)
- thomas101
- rhys101

npmjs.org: @aibrow/node-llama-cpp-linux-armv7l

Prebuilt binary for node-llama-cpp for Linux armv7l

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 1.7.0 (published 7 months ago)
Last Synced: 2025-11-01T03:03:59.466Z (3 months ago)
Versions: 14
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 701 Last month
Rankings:
- Dependent repos count: 24.682%
- Average: 30.154%
- Dependent packages count: 35.626%
Maintainers (2)
- thomas101
- rhys101

npmjs.org: @aibrow/node-llama-cpp-mac-arm64-metal

Prebuilt binary for node-llama-cpp for macOS arm64 with Metal support

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 1.7.0 (published 7 months ago)
Last Synced: 2025-10-31T02:38:55.567Z (3 months ago)
Versions: 14
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 779 Last month
Rankings:
- Dependent repos count: 24.682%
- Average: 30.154%
- Dependent packages count: 35.626%
Maintainers (2)
- thomas101
- rhys101

npmjs.org: @node-llama-cpp/win-arm64

Prebuilt binary for node-llama-cpp for Windows arm64

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.14.2 (published 3 months ago)
Last Synced: 2025-11-13T09:07:39.961Z (3 months ago)
Versions: 34
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 3,049 Last month
Rankings:
- Dependent repos count: 25.779%
- Average: 31.609%
- Dependent packages count: 37.439%
Maintainers (1)
- giladgd

npmjs.org: @node-llama-cpp/win-x64-vulkan

Prebuilt binary for node-llama-cpp for Windows x64 with Vulkan support

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.14.2 (published 3 months ago)
Last Synced: 2025-11-09T07:04:18.600Z (3 months ago)
Versions: 34
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 3,093 Last month
Rankings:
- Dependent repos count: 25.779%
- Average: 31.609%
- Dependent packages count: 37.439%
Maintainers (1)
- giladgd

npmjs.org: @node-llama-cpp/linux-arm64

Prebuilt binary for node-llama-cpp for Linux arm64

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.14.2 (published 3 months ago)
Last Synced: 2025-11-09T07:04:17.854Z (3 months ago)
Versions: 35
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 30,965 Last month
Rankings:
- Dependent repos count: 25.779%
- Average: 31.609%
- Dependent packages count: 37.439%
Maintainers (1)
- giladgd

npmjs.org: @node-llama-cpp/win-x64

Prebuilt binary for node-llama-cpp for Windows x64

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.14.2 (published 3 months ago)
Last Synced: 2025-11-13T09:07:14.648Z (3 months ago)
Versions: 34
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 3,410 Last month
Rankings:
- Dependent repos count: 25.779%
- Average: 31.609%
- Dependent packages count: 37.439%
Maintainers (1)
- giladgd

npmjs.org: @node-llama-cpp/linux-x64-cuda

Prebuilt binary for node-llama-cpp for Linux x64 with CUDA support

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.14.2 (published 3 months ago)
Last Synced: 2025-11-09T07:04:06.077Z (3 months ago)
Versions: 46
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 31,102 Last month
Rankings:
- Dependent repos count: 27.635%
- Average: 33.896%
- Dependent packages count: 40.158%
Maintainers (1)
- giladgd

npmjs.org: @node-llama-cpp/win-x64-cuda

Prebuilt binary for node-llama-cpp for Windows x64 with CUDA support

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.14.2 (published 3 months ago)
Last Synced: 2025-11-13T09:07:00.975Z (3 months ago)
Versions: 46
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 3,510 Last month
Rankings:
- Dependent repos count: 27.635%
- Average: 33.896%
- Dependent packages count: 40.158%
Maintainers (1)
- giladgd

npmjs.org: create-node-llama-cpp

Scaffold a new node-llama-cpp project from a template

Homepage: https://node-llama-cpp.withcat.ai
Licenses: MIT
Latest release: 3.14.2 (published 3 months ago)
Last Synced: 2025-10-31T02:39:19.988Z (3 months ago)
Versions: 55
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 760 Last month
Rankings:
- Dependent repos count: 29.297%
- Average: 35.609%
- Dependent packages count: 41.922%
Maintainers (1)
- giladgd
Funding:
- type: github
- url: https://github.com/sponsors/giladgd

Dependencies

.github/workflows/build.yml actions

actions/checkout v3 composite
actions/deploy-pages v2 composite
actions/download-artifact v3 composite
actions/setup-node v3 composite
actions/setup-python v4 composite
actions/upload-artifact v3 composite
actions/upload-pages-artifact v2 composite

.github/workflows/prLint.yml actions

amannn/action-semantic-pull-request v5 composite

.github/workflows/test.yml actions

actions/checkout v3 composite
actions/setup-node v3 composite

package-lock.json npm

895 dependencies

package.json npm

@commitlint/cli ^17.7.1 development
@commitlint/config-conventional ^17.7.0 development
@semantic-release/exec ^6.0.3 development
@types/bytes ^3.1.1 development
@types/cli-progress ^3.11.0 development
@types/cross-spawn ^6.0.2 development
@types/fs-extra ^11.0.1 development
@types/node ^20.4.9 development
@types/uuid ^9.0.2 development
@types/yargs ^17.0.24 development
@typescript-eslint/eslint-plugin ^6.3.0 development
@typescript-eslint/parser ^6.3.0 development
eslint ^8.46.0 development
eslint-plugin-import ^2.28.0 development
eslint-plugin-node github:giladgd/eslint-plugin-node#dev/giladgd/fixImportExtentionFixingInTypeScript development
husky ^8.0.3 development
semantic-release ^21.0.7 development
ts-node ^10.9.1 development
tslib ^2.6.1 development
typedoc ^0.24.8 development
typescript ^5.1.6 development
zx ^7.2.3 development
chalk ^5.3.0
cli-progress ^3.12.0
cross-env ^7.0.3
cross-spawn ^7.0.3
env-var ^7.3.1
fs-extra ^11.1.1
node-addon-api ^7.0.0
node-gyp ^9.4.0
octokit ^3.1.0
ora ^7.0.1
simple-git ^3.19.1
uuid ^9.0.0
yargs ^17.7.2

llama/xpack/package.json npm