awesome-llama: https://github.com/SciSharp/LLamaSharp
chatbot gpt llama llama-cpp llama2 llama3 llamacpp llava llm multi-modal semantic-kernel
Score: 26.853138077047664
Last synced: about 19 hours ago
JSON representation
Repository metadata:
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
- Host: GitHub
- URL: https://github.com/SciSharp/LLamaSharp
- Owner: SciSharp
- License: mit
- Created: 2023-05-09T18:03:21.000Z (over 2 years ago)
- Default Branch: master
- Last Pushed: 2026-01-12T16:24:23.000Z (23 days ago)
- Last Synced: 2026-01-13T02:51:46.737Z (23 days ago)
- Topics: chatbot, gpt, llama, llama-cpp, llama2, llama3, llamacpp, llava, llm, multi-modal, semantic-kernel
- Language: C#
- Homepage: https://scisharp.github.io/LLamaSharp
- Size: 392 MB
- Stars: 3,492
- Watchers: 60
- Forks: 480
- Open Issues: 27
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
Owner metadata:
- Name: SciSharp STACK
- Login: SciSharp
- Email: scisharpstack@gmail.com
- Kind: organization
- Description: A .NET based Open Source Ecosystem for Data Science, Machine Learning and AI.
- Website: http://scisharpstack.org
- Location: Chicago, US
- Twitter: ScisharpStack
- Company:
- Icon url: https://avatars.githubusercontent.com/u/44989469?v=4
- Repositories: 30
- Last Synced at: 2023-03-02T06:15:25.008Z
- Profile URL: https://github.com/SciSharp
GitHub Events
Total
- Commit comment event: 1
- Create event: 56
- Delete event: 48
- Fork event: 112
- Issue comment event: 797
- Issues event: 267
- Pull request event: 344
- Pull request review comment event: 108
- Pull request review event: 142
- Push event: 175
- Release event: 7
- Watch event: 771
- Total: 2828
Last Year
- Commit comment event: 1
- Create event: 41
- Delete event: 35
- Fork event: 92
- Issue comment event: 690
- Issues event: 231
- Pull request event: 260
- Pull request review comment event: 86
- Pull request review event: 114
- Push event: 129
- Release event: 5
- Watch event: 572
- Total: 2256
Committers metadata
Last synced: 24 days ago
Total Commits: 1,510
Total Committers: 84
Avg Commits per committer: 17.976
Development Distribution Score (DDS): 0.57
Commits in past year: 262
Committers in past year: 32
Avg Commits per committer in past year: 8.188
Development Distribution Score (DDS) in past year: 0.695
| Name | Commits | |
|---|---|---|
| Martin Evans | m****s@g****m | 650 |
| Yaohui Liu | A****e@g****m | 244 |
| dependabot[bot] | 4****] | 105 |
| SignalRT | a****n@s****m | 94 |
| Zoli Somogyi | z****e@g****m | 42 |
| m0nsky | r****s@l****k | 30 |
| sa_ddam213 | s****3@l****m | 30 |
| xbotter | x****r@l****n | 29 |
| Lyrcaxis | l****s@g****m | 26 |
| Jason Couture | j****c@a****o | 19 |
| nipeone | x****y@l****m | 16 |
| Tim Miller | i****1@g****m | 15 |
| eublefar | e****1@g****m | 13 |
| Philipp Bauer | h****o@p****g | 12 |
| Krisbiradar | k****r@h****m | 10 |
| Mihai | m****u@y****m | 10 |
| DeProgrammer | m****9@h****m | 10 |
| Aleksei Smirnov | t****k@i****u | 9 |
| Emmanuel Adebiyi | s****3@g****m | 9 |
| Stephen Toub | s****b@m****m | 9 |
| Michael Lamothe | m****e@g****m | 8 |
| Ares Lazarus | c****v@m****m | 8 |
| Luca Maccarini | l****2@g****m | 7 |
| Phil Scott | p****t@g****m | 6 |
| 桑榆肖物 | s****3@q****m | 6 |
| Scott W Harden | s****n@g****m | 5 |
| Haiping | h****8@g****m | 4 |
| David Cantu | d****u@m****m | 4 |
| Marcel | m****f@g****m | 3 |
| Joey Spiker | j****r@g****m | 3 |
| and 54 more... | ||
Issue and Pull Request metadata
Last synced: about 1 month ago
Total issues: 422
Total pull requests: 1,167
Average time to close issues: 3 months
Average time to close pull requests: 6 days
Total issue authors: 240
Total pull request authors: 87
Average comments per issue: 3.9
Average comments per pull request: 1.6
Merged pull request: 937
Bot issues: 0
Bot pull requests: 237
Past year issues: 78
Past year pull requests: 262
Past year average time to close issues: about 2 months
Past year average time to close pull requests: 5 days
Past year issue authors: 56
Past year pull request authors: 37
Past year average comments per issue: 2.9
Past year average comments per pull request: 1.47
Past year merged pull request: 210
Past year bot issues: 0
Past year bot pull requests: 71
Top Issue Authors
- AsakusaRinne (25)
- aropb (18)
- martindevans (16)
- hswlab (8)
- ChezzPlaya (7)
- LSXAxeller (7)
- zsogitbe (7)
- darcome (5)
- JohnGalt1717 (5)
- xuzeyu91 (5)
- lmxin123 (5)
- vvdb-architecture (4)
- koureasstavros (4)
- phil-scott-78 (4)
- nipeone (4)
Top Pull Request Authors
- martindevans (474)
- dependabot[bot] (237)
- AsakusaRinne (82)
- SignalRT (34)
- m0nsky (30)
- zsogitbe (26)
- jasoncouture (22)
- Lyrcaxis (19)
- stephentoub (15)
- xbotter (13)
- saddam213 (11)
- phil-scott-78 (11)
- sangyuxiaowu (10)
- Lamothe (10)
- swharden (10)
Top Issue Labels
- bug (41)
- stale (41)
- enhancement (26)
- question (22)
- good first issue (16)
- help wanted (11)
- Upstream (10)
- feature request (10)
- do not close (6)
- discussion (6)
- backend (6)
- documentation (4)
- llava (3)
- duplicate (3)
- wontfix (2)
- dependencies (1)
- integrations (1)
- ci/cd (1)
- break change (1)
- FAQ (1)
Top Pull Request Labels
- dependencies (237)
- minor-release (53)
- .NET (46)
- enhancement (38)
- break change (22)
- backend (20)
- ci/cd (20)
- documentation (18)
- native lib (15)
- benchmark (12)
- bug (11)
- stale (10)
- patch-release (9)
- llava (8)
- distribution (6)
- experimental (3)
- help wanted (2)
- Upstream (2)
- do not close (1)
Package metadata
- Total packages: 21
-
Total downloads:
- nuget: 1,554,061 total
- Total dependent packages: 9 (may contain duplicates)
- Total dependent repositories: 0 (may contain duplicates)
- Total versions: 290
- Total maintainers: 2
proxy.golang.org: github.com/SciSharp/LLamaSharp
- Homepage:
- Documentation: https://pkg.go.dev/github.com/SciSharp/LLamaSharp#section-documentation
- Licenses: mit
- Latest release: v0.25.0 (published 6 months ago)
- Last Synced: 2025-12-27T07:11:58.098Z (about 1 month ago)
- Versions: 26
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent packages count: 6.528%
- Average: 6.747%
- Dependent repos count: 6.966%
proxy.golang.org: github.com/scisharp/llamasharp
- Homepage:
- Documentation: https://pkg.go.dev/github.com/scisharp/llamasharp#section-documentation
- Licenses: mit
- Latest release: v0.25.0 (published 6 months ago)
- Last Synced: 2025-12-27T07:11:57.839Z (about 1 month ago)
- Versions: 26
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent packages count: 6.528%
- Average: 6.747%
- Dependent repos count: 6.966%
nuget.org: llamasharp
LLamaSharp is a cross-platform library to run 🦙LLaMA/LLaVA model (and others) in your local device. Based on [llama.cpp](https://github.com/ggerganov/llama.cpp), inference with LLamaSharp is efficient on both CPU and GPU. With the higher-level APIs and RAG support, it's convenient to deploy LLM (Large Language Model) in your application with LLamaSharp.
- Homepage:
- Licenses: MIT
- Latest release: 0.25.0 (published 6 months ago)
- Last Synced: 2025-12-27T07:10:33.407Z (about 1 month ago)
- Versions: 35
- Dependent Packages: 7
- Dependent Repositories: 0
- Downloads: 724,731 Total
-
Rankings:
- Downloads: 7.556%
- Average: 14.29%
- Dependent repos count: 14.978%
- Dependent packages count: 20.338%
- Maintainers (1)
nuget.org: llamasharp.backend.cpu
LLamaSharp.Backend.Cpu is a backend for LLamaSharp to use with Cpu only.
- Homepage: https://github.com/SciSharp/LLamaSharp
- Licenses: MIT
- Latest release: 0.25.0 (published 6 months ago)
- Last Synced: 2026-01-12T12:04:55.397Z (23 days ago)
- Versions: 30
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 211,884 Total
-
Rankings:
- Downloads: 10.778%
- Dependent repos count: 14.978%
- Average: 15.365%
- Dependent packages count: 20.338%
- Maintainers (1)
nuget.org: llamasharp.backend.cuda11
LLamaSharp.Backend.Cuda11 is a backend for LLamaSharp to use with Cuda11.
- Homepage: https://github.com/SciSharp/LLamaSharp
- Licenses: MIT
- Latest release: 0.24.0 (published 9 months ago)
- Last Synced: 2025-12-29T08:39:01.120Z (about 1 month ago)
- Versions: 26
- Dependent Packages: 1
- Dependent Repositories: 0
- Downloads: 51,867 Total
-
Rankings:
- Downloads: 12.911%
- Dependent repos count: 14.978%
- Average: 16.075%
- Dependent packages count: 20.338%
- Maintainers (1)
nuget.org: llamasharp.cpu.unoffical
The .NET binding of LLama.cpp, providing APIs to run the model and deploy it on Web. For model weights to run, please go to https://github.com/SciSharp/LLamaSharp for more information.
nuget.org: llamasharp.backend.cuda12
LLamaSharp.Backend.Cuda12 is a backend for LLamaSharp to use with Cuda12.
- Homepage: https://github.com/SciSharp/LLamaSharp
- Licenses: MIT
- Latest release: 0.25.0 (published 6 months ago)
- Last Synced: 2025-12-27T07:10:33.097Z (about 1 month ago)
- Versions: 27
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 135,049 Total
-
Rankings:
- Downloads: 14.427%
- Dependent repos count: 14.978%
- Average: 16.581%
- Dependent packages count: 20.338%
- Maintainers (1)
nuget.org: llamasharp.semantic-kernel
The integration of LLamaSharp and Microsoft semantic-kernel.
- Homepage:
- Licenses: MIT
- Latest release: 0.25.0 (published 6 months ago)
- Last Synced: 2025-12-27T07:10:32.742Z (about 1 month ago)
- Versions: 24
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 108,661 Total
-
Rankings:
- Dependent repos count: 14.978%
- Dependent packages count: 20.338%
- Average: 21.733%
- Downloads: 29.884%
- Maintainers (1)
nuget.org: llamasharp.backend.macmetal
LLamaSharp.Backend.MacMetal is a backend for LLamaSharp to use MAC with GPU support.
- Homepage: https://github.com/SciSharp/LLamaSharp
- Licenses: MIT
- Latest release: 0.7.0 (published over 2 years ago)
- Last Synced: 2025-12-31T09:22:27.752Z (about 1 month ago)
- Versions: 5
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 3,466 Total
-
Rankings:
- Dependent repos count: 13.819%
- Dependent packages count: 18.835%
- Average: 23.264%
- Downloads: 37.136%
- Maintainers (1)
nuget.org: llamasharp.kernel-memory
The integration of LLamaSharp and Microsoft kernel-memory. It could make it easy to support document search for LLamaSharp model inference.
- Homepage:
- Licenses: MIT
- Latest release: 0.25.0 (published 6 months ago)
- Last Synced: 2025-12-31T09:22:33.249Z (about 1 month ago)
- Versions: 21
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 108,878 Total
-
Rankings:
- Dependent repos count: 14.978%
- Dependent packages count: 20.338%
- Average: 23.946%
- Downloads: 36.521%
- Maintainers (1)
nuget.org: llamasharp.cpu
The .NET binding of llama.cpp, providing APIs to run the model and deploy it on Web.
- Homepage:
- Licenses: MIT
- Latest release: 0.2.1 (published over 2 years ago)
- Last Synced: 2025-12-31T09:22:19.707Z (about 1 month ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 1,338 Total
-
Rankings:
- Dependent repos count: 13.819%
- Dependent packages count: 18.835%
- Average: 26.023%
- Downloads: 45.415%
- Maintainers (1)
nuget.org: llamasharp.unofficial
The .NET binding of LLama.cpp, providing APIs to run the model and deploy it on Web. For model weights to run, please go to https://github.com/SciSharp/LLamaSharp for more information.
- Homepage:
- Licenses: MIT
- Latest release: 0.4.1 (published over 2 years ago)
- Last Synced: 2025-12-31T09:22:23.936Z (about 1 month ago)
- Versions: 3
- Dependent Packages: 1
- Dependent Repositories: 0
- Downloads: 1,265 Total
-
Rankings:
- Dependent repos count: 13.819%
- Dependent packages count: 18.835%
- Average: 26.198%
- Downloads: 45.938%
- Maintainers (1)
nuget.org: llamasharp.backend.cpu.android
LLamaSharp.Backend.Cpu.Android is a backend for LLamaSharp to use with Android Cpu only.
- Homepage: https://github.com/SciSharp/LLamaSharp
- Licenses: MIT
- Latest release: 0.25.0 (published 6 months ago)
- Last Synced: 2025-12-31T09:22:24.720Z (about 1 month ago)
- Versions: 2
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 710 Total
-
Rankings:
- Dependent repos count: 6.823%
- Dependent packages count: 18.306%
- Average: 27.208%
- Downloads: 56.496%
- Maintainers (1)
nuget.org: llamasharp.backend.cuda11.windows
LLamaSharp.Backend.Cuda11.Windows contains the Windows binaries for LLamaSharp with Cuda11 support.
- Homepage: https://github.com/SciSharp/LLamaSharp
- Licenses: MIT
- Latest release: 0.24.0 (published 9 months ago)
- Last Synced: 2025-12-27T07:11:10.493Z (about 1 month ago)
- Versions: 7
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 18,085 Total
-
Rankings:
- Dependent repos count: 7.441%
- Dependent packages count: 19.962%
- Average: 28.297%
- Downloads: 57.487%
- Maintainers (1)
nuget.org: llamasharp.backend.cuda12.linux
LLamaSharp.Backend.Cuda12.Linux contains the Linux binaries for LLamaSharp with Cuda12 support.
- Homepage: https://github.com/SciSharp/LLamaSharp
- Licenses: MIT
- Latest release: 0.25.0 (published 6 months ago)
- Last Synced: 2025-12-31T09:22:28.229Z (about 1 month ago)
- Versions: 8
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 64,037 Total
-
Rankings:
- Dependent repos count: 7.441%
- Dependent packages count: 19.962%
- Average: 28.297%
- Downloads: 57.487%
- Maintainers (1)
nuget.org: llamasharp.backend.cuda12.windows
LLamaSharp.Backend.Cuda12.Windows contains the Windows binaries for LLamaSharp with Cuda12 support.
- Homepage: https://github.com/SciSharp/LLamaSharp
- Licenses: MIT
- Latest release: 0.25.0 (published 6 months ago)
- Last Synced: 2025-12-31T09:22:23.612Z (about 1 month ago)
- Versions: 8
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 74,228 Total
-
Rankings:
- Dependent repos count: 7.441%
- Dependent packages count: 19.962%
- Average: 28.297%
- Downloads: 57.487%
- Maintainers (1)
nuget.org: llamasharp.backend.vulkan.windows
LLamaSharp.Backend.Vulkan.Windows contains the Windows binaries for LLamaSharp with Vulkan support.
- Homepage: https://github.com/SciSharp/LLamaSharp
- Licenses: MIT
- Latest release: 0.25.0 (published 6 months ago)
- Last Synced: 2025-12-31T09:22:26.526Z (about 1 month ago)
- Versions: 8
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 8,911 Total
-
Rankings:
- Dependent repos count: 7.441%
- Dependent packages count: 19.962%
- Average: 28.297%
- Downloads: 57.487%
- Maintainers (1)
nuget.org: llamasharp.backend.vulkan.linux
LLamaSharp.Backend.Vulkan.Linux contains the Linux binaries for LLamaSharp with Vulkan support.
- Homepage: https://github.com/SciSharp/LLamaSharp
- Licenses: MIT
- Latest release: 0.25.0 (published 6 months ago)
- Last Synced: 2025-12-27T07:10:28.911Z (about 1 month ago)
- Versions: 8
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 8,720 Total
-
Rankings:
- Dependent repos count: 7.441%
- Dependent packages count: 19.962%
- Average: 28.297%
- Downloads: 57.487%
- Maintainers (1)
nuget.org: llamasharp.backend.cuda11.linux
LLamaSharp.Backend.Cuda11.Linux contains the Linux binaries for LLamaSharp with Cuda11 support.
- Homepage: https://github.com/SciSharp/LLamaSharp
- Licenses: MIT
- Latest release: 0.24.0 (published 9 months ago)
- Last Synced: 2025-12-29T08:38:58.365Z (about 1 month ago)
- Versions: 7
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 18,095 Total
-
Rankings:
- Dependent repos count: 7.441%
- Dependent packages count: 19.962%
- Average: 28.297%
- Downloads: 57.487%
- Maintainers (1)
nuget.org: llamasharp.backend.vulkan
LLamaSharp.Backend.Vulkan is a backend for LLamaSharp to use with Vulkan.
- Homepage: https://github.com/SciSharp/LLamaSharp
- Licenses: MIT
- Latest release: 0.25.0 (published 6 months ago)
- Last Synced: 2025-12-29T08:38:24.623Z (about 1 month ago)
- Versions: 11
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 9,813 Total
-
Rankings:
- Dependent repos count: 7.61%
- Dependent packages count: 20.416%
- Average: 28.415%
- Downloads: 57.219%
- Maintainers (1)
nuget.org: llamasharp.backend.opencl
LLamaSharp.Backend.OpenCL is a backend for LLamaSharp to use with OpenCL.
- Homepage: https://github.com/SciSharp/LLamaSharp
- Licenses: MIT
- Latest release: 0.13.0 (published over 1 year ago)
- Last Synced: 2025-12-27T07:09:51.640Z (about 1 month ago)
- Versions: 6
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 4,323 Total
-
Rankings:
- Dependent repos count: 14.978%
- Dependent packages count: 20.338%
- Average: 30.344%
- Downloads: 55.717%
- Maintainers (1)
Dependencies
- actions/checkout v3 composite
- crate-ci/typos master composite
- actions/checkout v4 composite
- actions/upload-artifact v3 composite
- actions/cache v4 composite
- actions/checkout v4 composite
- actions/setup-python v5 composite
- actions/upload-artifact v4 composite
- nuget/setup-nuget v1 composite
- LLamaSharp.Backend.Vulkan.Linux $version$
- LLamaSharp.Backend.Vulkan.Windows $version$
- Microsoft.AspNetCore.Mvc.Razor.RuntimeCompilation 8.0.21
- System.Linq.Async 6.0.3
- actions/checkout v4 composite
- actions/setup-dotnet v4 composite
- Microsoft.SemanticKernel.Abstractions 1.64.0
- System.Memory 4.6.3
- actions/cache v4 composite
- actions/checkout v4 composite
- actions/setup-python v5 composite
- actions/upload-artifact v4 composite
- nuget/setup-nuget v1 composite
- LLamaSharp.Backend.Cpu $version$
- Microsoft.Extensions.Logging.Debug 8.0.1
- Microsoft.Maui.Controls $(MauiVersion)
- Microsoft.Maui.Controls.Compatibility $(MauiVersion)
- BenchmarkDotNet 0.15.5
- BenchmarkDotNet.Diagnostics.Windows 0.15.5
- Microsoft.Extensions.Logging.Console 9.0.9
- Microsoft.KernelMemory.Core 0.98.250508.3
- Microsoft.SemanticKernel 1.65.0
- Microsoft.SemanticKernel.Plugins.Memory 1.44.0-alpha
- NAudio 2.2.1
- SixLabors.ImageSharp 3.1.11
- Spectre.Console 0.50.0
- Spectre.Console.ImageSharp 0.50.0
- Whisper.net 1.8.1
- Whisper.net.Runtime 1.8.1
- Whisper.net.Runtime.Clblast 1.5.0
- Whisper.net.Runtime.CoreML 1.8.1
- Whisper.net.Runtime.Cublas 1.5.0
- HuggingfaceHub 0.1.3
- actions/checkout v3 composite
- actions/setup-dotnet v3 composite
- Microsoft.KernelMemory.Abstractions 0.98.250508.3
- LLamaSharp.Backend.Cuda12.Linux $version$
- LLamaSharp.Backend.Cuda12.Windows $version$
- Microsoft.NET.Test.Sdk 17.14.1
- Moq 4.20.72
- System.Linq.Async 6.0.3
- Xunit.SkippableFact 1.5.23
- coverlet.collector 6.0.4
- xunit 2.9.3
- xunit.runner.visualstudio 3.1.3
- actions/checkout v3 composite
- actions/setup-dotnet v3 composite
- Jimver/cuda-toolkit v0.2.15 composite
- actions/checkout v4 composite
- actions/download-artifact v4 composite
- actions/upload-artifact v4 composite
- geekyeggo/delete-artifact v5 composite
- nttld/setup-ndk v1 composite
- actions/cache v4 composite
- actions/checkout v4 composite
- actions/setup-dotnet v4 composite
- actions/upload-artifact v4 composite
- jlumbroso/free-disk-space v1.3.1 composite
- actions/checkout v3 composite
- actions/setup-dotnet v3 composite
- actions/stale v9 composite
- CommunityToolkit.HighPerformance 8.4.0
- IsExternalInit 1.0.3
- Microsoft.Bcl.AsyncInterfaces 9.0.10
- Microsoft.Extensions.AI.Abstractions 9.10.1
- Microsoft.Extensions.Logging.Abstractions 9.0.9
- System.Linq.Async 6.0.3
- System.Memory 4.6.3
- System.Numerics.Tensors 9.0.9
- System.Text.Json 9.0.9
- LLamaSharp.Backend.Cpu $version$
- LLamaSharp.Backend.Cpu $version$
- LLamaSharp.Backend.Cpu $version$
- Microsoft.AspNetCore.OpenApi 8.0.21
- Microsoft.VisualStudio.Validation 17.8.8
- Swashbuckle.AspNetCore 7.3.1