awesome-llama: https://github.com/scisharp/llamasharp
chatbot gpt llama llama-cpp llama2 llama3 llamacpp llava llm multi-modal semantic-kernel
Score: 27.750179067629198
Last synced: about 8 hours ago
JSON representation
Repository metadata:
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
- Host: GitHub
- URL: https://github.com/scisharp/llamasharp
- Owner: SciSharp
- License: mit
- Created: 2023-05-09T18:03:21.000Z (over 3 years ago)
- Default Branch: master
- Last Pushed: 2026-08-01T14:31:13.000Z (12 days ago)
- Last Synced: 2026-08-09T22:24:05.163Z (3 days ago)
- Topics: chatbot, gpt, llama, llama-cpp, llama2, llama3, llamacpp, llava, llm, multi-modal, semantic-kernel
- Language: C#
- Homepage: https://scisharp.github.io/LLamaSharp
- Size: 393 MB
- Stars: 3,773
- Watchers: 66
- Forks: 500
- Open Issues: 19
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
Owner metadata:
- Name: SciSharp STACK
- Login: SciSharp
- Email: scisharpstack@gmail.com
- Kind: organization
- Description: A .NET based Open Source Ecosystem for Data Science, Machine Learning and AI.
- Website: http://scisharpstack.org
- Location: Chicago, US
- Twitter: ScisharpStack
- Company:
- Icon url: https://avatars.githubusercontent.com/u/44989469?v=4
- Repositories: 30
- Last Synced at: 2023-03-02T06:15:25.008Z
- Profile URL: https://github.com/SciSharp
GitHub Events
Total
- Commit comment event: 1
- Create event: 71
- Delete event: 64
- Discussion event: 1
- Fork event: 119
- Issue comment event: 824
- Issues event: 286
- Pull request event: 408
- Pull request review comment event: 120
- Pull request review event: 148
- Push event: 209
- Release event: 7
- Watch event: 814
- Total: 3072
Last Year
- Create event: 28
- Delete event: 27
- Discussion event: 1
- Fork event: 19
- Issue comment event: 118
- Issues event: 47
- Pull request event: 106
- Pull request review comment event: 35
- Pull request review event: 29
- Push event: 50
- Release event: 1
- Watch event: 118
- Total: 579
Committers metadata
Last synced: 1 day ago
Total Commits: 1,647
Total Committers: 94
Avg Commits per committer: 17.521
Development Distribution Score (DDS): 0.592
Commits in past year: 197
Committers in past year: 22
Avg Commits per committer in past year: 8.955
Development Distribution Score (DDS) in past year: 0.721
| Name | Commits | |
|---|---|---|
| Martin Evans | m****s@g****m | 672 |
| Yaohui Liu | A****e@g****m | 244 |
| dependabot[bot] | 4****] | 141 |
| SignalRT | a****n@s****m | 128 |
| m0nsky | r****s@l****k | 51 |
| Zoli Somogyi | z****e@g****m | 45 |
| sa_ddam213 | s****3@l****m | 30 |
| xbotter | x****r@l****n | 29 |
| Lyrcaxis | l****s@g****m | 26 |
| Jason Couture | j****c@a****o | 19 |
| nipeone | x****y@l****m | 16 |
| Tim Miller | i****1@g****m | 15 |
| eublefar | e****1@g****m | 13 |
| Philipp Bauer | h****o@p****g | 12 |
| DeProgrammer | m****9@h****m | 10 |
| Mihai | m****u@y****m | 10 |
| Krisbiradar | k****r@h****m | 10 |
| Aleksei Smirnov | t****k@i****u | 9 |
| Emmanuel Adebiyi | s****3@g****m | 9 |
| Stephen Toub | s****b@m****m | 9 |
| Ares Lazarus | c****v@m****m | 8 |
| Michael Lamothe | m****e@g****m | 8 |
| Luca Maccarini | l****2@g****m | 7 |
| Phil Scott | p****t@g****m | 6 |
| 桑榆肖物 | s****3@q****m | 6 |
| Scott W Harden | s****n@g****m | 5 |
| copilot-swe-agent[bot] | 1****t | 4 |
| Haiping | h****8@g****m | 4 |
| David Cantu | d****u@m****m | 4 |
| Marcel | m****f@g****m | 3 |
| and 64 more... | ||
Issue and Pull Request metadata
Last synced: 4 days ago
Total issues: 440
Total pull requests: 1,202
Average time to close issues: 3 months
Average time to close pull requests: 6 days
Total issue authors: 254
Total pull request authors: 91
Average comments per issue: 3.93
Average comments per pull request: 1.57
Merged pull request: 963
Bot issues: 0
Bot pull requests: 258
Past year issues: 42
Past year pull requests: 78
Past year average time to close issues: about 2 months
Past year average time to close pull requests: 4 days
Past year issue authors: 34
Past year pull request authors: 16
Past year average comments per issue: 2.14
Past year average comments per pull request: 1.13
Past year merged pull request: 49
Past year bot issues: 0
Past year bot pull requests: 47
Top Issue Authors
- AsakusaRinne (25)
- aropb (22)
- martindevans (16)
- hswlab (8)
- zsogitbe (8)
- ChezzPlaya (7)
- LSXAxeller (7)
- darcome (5)
- lmxin123 (5)
- xuzeyu91 (5)
- JohnGalt1717 (5)
- nipeone (4)
- sangyuxiaowu (4)
- vvdb-architecture (4)
- phil-scott-78 (4)
Top Pull Request Authors
- martindevans (481)
- dependabot[bot] (258)
- AsakusaRinne (82)
- SignalRT (35)
- m0nsky (31)
- zsogitbe (27)
- jasoncouture (22)
- Lyrcaxis (19)
- stephentoub (15)
- xbotter (13)
- phil-scott-78 (11)
- saddam213 (11)
- Lamothe (10)
- sangyuxiaowu (10)
- swharden (10)
Top Issue Labels
- stale (54)
- bug (43)
- enhancement (26)
- question (22)
- good first issue (16)
- feature request (12)
- help wanted (11)
- Upstream (10)
- do not close (8)
- backend (6)
- discussion (6)
- documentation (4)
- llava (3)
- duplicate (3)
- wontfix (2)
- FAQ (1)
- break change (1)
- dependencies (1)
- ci/cd (1)
- integrations (1)
Top Pull Request Labels
- dependencies (258)
- .NET (67)
- minor-release (53)
- enhancement (38)
- break change (22)
- ci/cd (20)
- backend (20)
- documentation (18)
- native lib (15)
- benchmark (12)
- bug (11)
- stale (10)
- patch-release (9)
- llava (8)
- distribution (6)
- experimental (3)
- Upstream (2)
- help wanted (2)
- do not close (1)
Package metadata
- Total packages: 21
-
Total downloads:
- nuget: 3,160,472 total
- Total dependent packages: 9 (may contain duplicates)
- Total dependent repositories: 0 (may contain duplicates)
- Total versions: 316
- Total maintainers: 2
proxy.golang.org: github.com/scisharp/llamasharp
- Homepage:
- Documentation: https://pkg.go.dev/github.com/scisharp/llamasharp#section-documentation
- Licenses: mit
- Latest release: v0.27.0 (published 4 months ago)
- Last Synced: 2026-08-11T23:03:32.330Z (1 day ago)
- Versions: 28
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent packages count: 6.528%
- Average: 6.747%
- Dependent repos count: 6.966%
proxy.golang.org: github.com/SciSharp/LLamaSharp
- Homepage:
- Documentation: https://pkg.go.dev/github.com/SciSharp/LLamaSharp#section-documentation
- Licenses: mit
- Latest release: v0.27.0 (published 4 months ago)
- Last Synced: 2026-08-11T23:03:28.854Z (1 day ago)
- Versions: 28
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent packages count: 6.528%
- Average: 6.747%
- Dependent repos count: 6.966%
nuget.org: llamasharp
LLamaSharp is a cross-platform library to run 🦙LLaMA/Mtmd model (and others) in your local device. Based on [llama.cpp](https://github.com/ggerganov/llama.cpp), inference with LLamaSharp is efficient on both CPU and GPU. With the higher-level APIs and RAG support, it's convenient to deploy LLM (Large Language Model) in your application with LLamaSharp.
- Homepage:
- Licenses: MIT
- Latest release: 0.27.0 (published 4 months ago)
- Last Synced: 2026-08-11T23:03:24.483Z (1 day ago)
- Versions: 37
- Dependent Packages: 7
- Dependent Repositories: 0
- Downloads: 1,255,707 Total
-
Rankings:
- Downloads: 7.556%
- Average: 14.29%
- Dependent repos count: 14.978%
- Dependent packages count: 20.338%
- Maintainers (1)
nuget.org: llamasharp.backend.cpu
LLamaSharp.Backend.Cpu is a backend for LLamaSharp to use with Cpu only.
- Homepage: https://github.com/SciSharp/LLamaSharp
- Licenses: MIT
- Latest release: 0.27.0 (published 4 months ago)
- Last Synced: 2026-08-11T23:03:34.015Z (1 day ago)
- Versions: 32
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 582,463 Total
-
Rankings:
- Downloads: 10.778%
- Dependent repos count: 14.978%
- Average: 15.365%
- Dependent packages count: 20.338%
- Maintainers (1)
nuget.org: llamasharp.backend.cuda11
LLamaSharp.Backend.Cuda11 is a backend for LLamaSharp to use with Cuda11.
- Homepage: https://github.com/SciSharp/LLamaSharp
- Licenses: MIT
- Latest release: 0.24.0 (published about 1 year ago)
- Last Synced: 2026-08-11T23:03:26.288Z (1 day ago)
- Versions: 26
- Dependent Packages: 1
- Dependent Repositories: 0
- Downloads: 56,400 Total
-
Rankings:
- Downloads: 12.911%
- Dependent repos count: 14.978%
- Average: 16.075%
- Dependent packages count: 20.338%
- Maintainers (1)
nuget.org: llamasharp.cpu.unoffical
The .NET binding of LLama.cpp, providing APIs to run the model and deploy it on Web. For model weights to run, please go to https://github.com/SciSharp/LLamaSharp for more information.
nuget.org: llamasharp.backend.cuda12
LLamaSharp.Backend.Cuda12 is a backend for LLamaSharp to use with Cuda12.
- Homepage: https://github.com/SciSharp/LLamaSharp
- Licenses: MIT
- Latest release: 0.27.0 (published 4 months ago)
- Last Synced: 2026-08-11T23:03:12.698Z (1 day ago)
- Versions: 29
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 313,970 Total
-
Rankings:
- Downloads: 14.427%
- Dependent repos count: 14.978%
- Average: 16.581%
- Dependent packages count: 20.338%
- Maintainers (1)
nuget.org: llamasharp.semantic-kernel
The integration of LLamaSharp and Microsoft semantic-kernel.
- Homepage:
- Licenses: MIT
- Latest release: 0.27.0 (published 4 months ago)
- Last Synced: 2026-08-11T23:03:11.775Z (1 day ago)
- Versions: 26
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 119,055 Total
-
Rankings:
- Dependent repos count: 14.978%
- Dependent packages count: 20.338%
- Average: 21.733%
- Downloads: 29.884%
- Maintainers (1)
nuget.org: llamasharp.backend.macmetal
LLamaSharp.Backend.MacMetal is a backend for LLamaSharp to use MAC with GPU support.
- Homepage: https://github.com/SciSharp/LLamaSharp
- Licenses: MIT
- Latest release: 0.7.0 (published almost 3 years ago)
- Last Synced: 2026-08-11T23:03:39.551Z (1 day ago)
- Versions: 5
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 6,342 Total
-
Rankings:
- Dependent repos count: 13.819%
- Dependent packages count: 18.835%
- Average: 23.264%
- Downloads: 37.136%
- Maintainers (1)
nuget.org: llamasharp.kernel-memory
The integration of LLamaSharp and Microsoft kernel-memory. It could make it easy to support document search for LLamaSharp model inference.
- Homepage:
- Licenses: MIT
- Latest release: 0.27.0 (published 4 months ago)
- Last Synced: 2026-08-11T23:03:13.720Z (1 day ago)
- Versions: 23
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 114,838 Total
-
Rankings:
- Dependent repos count: 14.978%
- Dependent packages count: 20.338%
- Average: 23.946%
- Downloads: 36.521%
- Maintainers (1)
nuget.org: llamasharp.cpu
The .NET binding of llama.cpp, providing APIs to run the model and deploy it on Web.
- Homepage:
- Licenses: MIT
- Latest release: 0.2.1 (published over 3 years ago)
- Last Synced: 2026-08-11T23:03:32.378Z (1 day ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 1,453 Total
-
Rankings:
- Dependent repos count: 13.819%
- Dependent packages count: 18.835%
- Average: 26.023%
- Downloads: 45.415%
- Maintainers (1)
nuget.org: llamasharp.unofficial
The .NET binding of LLama.cpp, providing APIs to run the model and deploy it on Web. For model weights to run, please go to https://github.com/SciSharp/LLamaSharp for more information.
- Homepage:
- Licenses: MIT
- Latest release: 0.4.1 (published about 3 years ago)
- Last Synced: 2026-08-11T23:03:14.608Z (1 day ago)
- Versions: 3
- Dependent Packages: 1
- Dependent Repositories: 0
- Downloads: 1,432 Total
-
Rankings:
- Dependent repos count: 13.819%
- Dependent packages count: 18.835%
- Average: 26.198%
- Downloads: 45.938%
- Maintainers (1)
nuget.org: llamasharp.backend.cpu.android
LLamaSharp.Backend.Cpu.Android is a backend for LLamaSharp to use with Android Cpu only.
- Homepage: https://github.com/SciSharp/LLamaSharp
- Licenses: MIT
- Latest release: 0.27.0 (published 4 months ago)
- Last Synced: 2026-08-11T23:03:26.546Z (1 day ago)
- Versions: 4
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 2,461 Total
-
Rankings:
- Dependent repos count: 6.823%
- Dependent packages count: 18.306%
- Average: 27.208%
- Downloads: 56.496%
- Maintainers (1)
nuget.org: llamasharp.backend.cuda11.linux
LLamaSharp.Backend.Cuda11.Linux contains the Linux binaries for LLamaSharp with Cuda11 support.
- Homepage: https://github.com/SciSharp/LLamaSharp
- Licenses: MIT
- Latest release: 0.24.0 (published about 1 year ago)
- Last Synced: 2026-08-11T23:03:34.301Z (1 day ago)
- Versions: 7
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 21,042 Total
-
Rankings:
- Dependent repos count: 7.441%
- Dependent packages count: 19.962%
- Average: 28.297%
- Downloads: 57.487%
- Maintainers (1)
nuget.org: llamasharp.backend.vulkan.linux
LLamaSharp.Backend.Vulkan.Linux contains the Linux binaries for LLamaSharp with Vulkan support.
- Homepage: https://github.com/SciSharp/LLamaSharp
- Licenses: MIT
- Latest release: 0.27.0 (published 4 months ago)
- Last Synced: 2026-08-11T23:03:29.634Z (1 day ago)
- Versions: 10
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 52,146 Total
-
Rankings:
- Dependent repos count: 7.441%
- Dependent packages count: 19.962%
- Average: 28.297%
- Downloads: 57.487%
- Maintainers (1)
nuget.org: llamasharp.backend.cuda12.windows
LLamaSharp.Backend.Cuda12.Windows contains the Windows binaries for LLamaSharp with Cuda12 support.
- Homepage: https://github.com/SciSharp/LLamaSharp
- Licenses: MIT
- Latest release: 0.27.0 (published 4 months ago)
- Last Synced: 2026-08-11T23:03:26.066Z (1 day ago)
- Versions: 10
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 267,799 Total
-
Rankings:
- Dependent repos count: 7.441%
- Dependent packages count: 19.962%
- Average: 28.297%
- Downloads: 57.487%
- Maintainers (1)
nuget.org: llamasharp.backend.cuda11.windows
LLamaSharp.Backend.Cuda11.Windows contains the Windows binaries for LLamaSharp with Cuda11 support.
- Homepage: https://github.com/SciSharp/LLamaSharp
- Licenses: MIT
- Latest release: 0.24.0 (published about 1 year ago)
- Last Synced: 2026-08-11T23:03:33.085Z (1 day ago)
- Versions: 7
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 19,505 Total
-
Rankings:
- Dependent repos count: 7.441%
- Dependent packages count: 19.962%
- Average: 28.297%
- Downloads: 57.487%
- Maintainers (1)
nuget.org: llamasharp.backend.cuda12.linux
LLamaSharp.Backend.Cuda12.Linux contains the Linux binaries for LLamaSharp with Cuda12 support.
- Homepage: https://github.com/SciSharp/LLamaSharp
- Licenses: MIT
- Latest release: 0.27.0 (published 4 months ago)
- Last Synced: 2026-08-11T23:03:19.318Z (1 day ago)
- Versions: 10
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 249,398 Total
-
Rankings:
- Dependent repos count: 7.441%
- Dependent packages count: 19.962%
- Average: 28.297%
- Downloads: 57.487%
- Maintainers (1)
nuget.org: llamasharp.backend.vulkan.windows
LLamaSharp.Backend.Vulkan.Windows contains the Windows binaries for LLamaSharp with Vulkan support.
- Homepage: https://github.com/SciSharp/LLamaSharp
- Licenses: MIT
- Latest release: 0.27.0 (published 4 months ago)
- Last Synced: 2026-08-11T23:03:37.226Z (1 day ago)
- Versions: 10
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 51,435 Total
-
Rankings:
- Dependent repos count: 7.441%
- Dependent packages count: 19.962%
- Average: 28.297%
- Downloads: 57.487%
- Maintainers (1)
nuget.org: llamasharp.backend.vulkan
LLamaSharp.Backend.Vulkan is a backend for LLamaSharp to use with Vulkan.
- Homepage: https://github.com/SciSharp/LLamaSharp
- Licenses: MIT
- Latest release: 0.27.0 (published 4 months ago)
- Last Synced: 2026-08-11T23:03:25.026Z (1 day ago)
- Versions: 13
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 39,662 Total
-
Rankings:
- Dependent repos count: 7.61%
- Dependent packages count: 20.416%
- Average: 28.415%
- Downloads: 57.219%
- Maintainers (1)
nuget.org: llamasharp.backend.opencl
LLamaSharp.Backend.OpenCL is a backend for LLamaSharp to use with OpenCL.
- Homepage: https://github.com/SciSharp/LLamaSharp
- Licenses: MIT
- Latest release: 0.13.0 (published about 2 years ago)
- Last Synced: 2026-08-11T23:03:23.122Z (1 day ago)
- Versions: 6
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 5,364 Total
-
Rankings:
- Dependent repos count: 14.978%
- Dependent packages count: 20.338%
- Average: 30.344%
- Downloads: 55.717%
- Maintainers (1)
Dependencies
- actions/checkout v3 composite
- crate-ci/typos master composite
- actions/checkout v4 composite
- actions/upload-artifact v3 composite
- actions/cache v4 composite
- actions/checkout v4 composite
- actions/setup-python v5 composite
- actions/upload-artifact v4 composite
- nuget/setup-nuget v1 composite
- LLamaSharp.Backend.Vulkan.Linux $version$
- LLamaSharp.Backend.Vulkan.Windows $version$
- Microsoft.AspNetCore.Mvc.Razor.RuntimeCompilation 8.0.21
- System.Linq.Async 6.0.3
- actions/checkout v4 composite
- actions/setup-dotnet v4 composite
- Microsoft.SemanticKernel.Abstractions 1.64.0
- System.Memory 4.6.3
- actions/cache v4 composite
- actions/checkout v4 composite
- actions/setup-python v5 composite
- actions/upload-artifact v4 composite
- nuget/setup-nuget v1 composite
- LLamaSharp.Backend.Cpu $version$
- Microsoft.Extensions.Logging.Debug 8.0.1
- Microsoft.Maui.Controls $(MauiVersion)
- Microsoft.Maui.Controls.Compatibility $(MauiVersion)
- BenchmarkDotNet 0.15.5
- BenchmarkDotNet.Diagnostics.Windows 0.15.5
- Microsoft.Extensions.Logging.Console 9.0.9
- Microsoft.KernelMemory.Core 0.98.250508.3
- Microsoft.SemanticKernel 1.65.0
- Microsoft.SemanticKernel.Plugins.Memory 1.44.0-alpha
- NAudio 2.2.1
- SixLabors.ImageSharp 3.1.11
- Spectre.Console 0.50.0
- Spectre.Console.ImageSharp 0.50.0
- Whisper.net 1.8.1
- Whisper.net.Runtime 1.8.1
- Whisper.net.Runtime.Clblast 1.5.0
- Whisper.net.Runtime.CoreML 1.8.1
- Whisper.net.Runtime.Cublas 1.5.0
- HuggingfaceHub 0.1.3
- actions/checkout v3 composite
- actions/setup-dotnet v3 composite
- Microsoft.KernelMemory.Abstractions 0.98.250508.3
- LLamaSharp.Backend.Cuda12.Linux $version$
- LLamaSharp.Backend.Cuda12.Windows $version$
- Microsoft.NET.Test.Sdk 17.14.1
- Moq 4.20.72
- System.Linq.Async 6.0.3
- Xunit.SkippableFact 1.5.23
- coverlet.collector 6.0.4
- xunit 2.9.3
- xunit.runner.visualstudio 3.1.3
- actions/checkout v3 composite
- actions/setup-dotnet v3 composite
- Jimver/cuda-toolkit v0.2.15 composite
- actions/checkout v4 composite
- actions/download-artifact v4 composite
- actions/upload-artifact v4 composite
- geekyeggo/delete-artifact v5 composite
- nttld/setup-ndk v1 composite
- actions/cache v4 composite
- actions/checkout v4 composite
- actions/setup-dotnet v4 composite
- actions/upload-artifact v4 composite
- jlumbroso/free-disk-space v1.3.1 composite
- actions/checkout v3 composite
- actions/setup-dotnet v3 composite
- actions/stale v9 composite
- CommunityToolkit.HighPerformance 8.4.0
- IsExternalInit 1.0.3
- Microsoft.Bcl.AsyncInterfaces 9.0.10
- Microsoft.Extensions.AI.Abstractions 9.10.1
- Microsoft.Extensions.Logging.Abstractions 9.0.9
- System.Linq.Async 6.0.3
- System.Memory 4.6.3
- System.Numerics.Tensors 9.0.9
- System.Text.Json 9.0.9
- LLamaSharp.Backend.Cpu $version$
- LLamaSharp.Backend.Cpu $version$
- LLamaSharp.Backend.Cpu $version$
- Microsoft.AspNetCore.OpenApi 8.0.21
- Microsoft.VisualStudio.Validation 17.8.8
- Swashbuckle.AspNetCore 7.3.1