An open API service for producing an overview of a list of open source projects.

awesome-llama: https://github.com/scisharp/llamasharp

chatbot gpt llama llama-cpp llama2 llama3 llamacpp llava llm multi-modal semantic-kernel

Score: 27.462304663089466

Last synced: about 19 hours ago
JSON representation

Repository metadata:

A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.


Owner metadata:


GitHub Events

Total
Last Year

Committers metadata

Last synced: 6 days ago

Total Commits: 1,626
Total Committers: 93
Avg Commits per committer: 17.484
Development Distribution Score (DDS): 0.59

Commits in past year: 211
Committers in past year: 30
Avg Commits per committer in past year: 7.033
Development Distribution Score (DDS) in past year: 0.773

Name Email Commits
Martin Evans m****s@g****m 667
Yaohui Liu A****e@g****m 244
SignalRT a****n@s****m 128
dependabot[bot] 4****] 126
m0nsky r****s@l****k 51
Zoli Somogyi z****e@g****m 45
sa_ddam213 s****3@l****m 30
xbotter x****r@l****n 29
Lyrcaxis l****s@g****m 26
Jason Couture j****c@a****o 19
nipeone x****y@l****m 16
Tim Miller i****1@g****m 15
eublefar e****1@g****m 13
Philipp Bauer h****o@p****g 12
DeProgrammer m****9@h****m 10
Mihai m****u@y****m 10
Krisbiradar k****r@h****m 10
Aleksei Smirnov t****k@i****u 9
Emmanuel Adebiyi s****3@g****m 9
Stephen Toub s****b@m****m 9
Ares Lazarus c****v@m****m 8
Michael Lamothe m****e@g****m 8
Luca Maccarini l****2@g****m 7
Phil Scott p****t@g****m 6
桑榆肖物 s****3@q****m 6
Scott W Harden s****n@g****m 5
copilot-swe-agent[bot] 1****t 4
Haiping h****8@g****m 4
David Cantu d****u@m****m 4
Marcel m****f@g****m 3
and 63 more...

Issue and Pull Request metadata

Last synced: 8 days ago

Total issues: 436
Total pull requests: 1,189
Average time to close issues: 3 months
Average time to close pull requests: 6 days
Total issue authors: 250
Total pull request authors: 90
Average comments per issue: 3.93
Average comments per pull request: 1.58
Merged pull request: 952
Bot issues: 0
Bot pull requests: 248

Past year issues: 49
Past year pull requests: 98
Past year average time to close issues: about 1 month
Past year average time to close pull requests: 7 days
Past year issue authors: 38
Past year pull request authors: 26
Past year average comments per issue: 1.98
Past year average comments per pull request: 1.33
Past year merged pull request: 63
Past year bot issues: 0
Past year bot pull requests: 38

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/scisharp/llamasharp

Top Issue Authors

  • AsakusaRinne (25)
  • aropb (22)
  • martindevans (16)
  • zsogitbe (8)
  • hswlab (8)
  • ChezzPlaya (7)
  • LSXAxeller (7)
  • darcome (5)
  • xuzeyu91 (5)
  • JohnGalt1717 (5)
  • lmxin123 (5)
  • mphacker (4)
  • koureasstavros (4)
  • jasoncouture (4)
  • vvdb-architecture (4)

Top Pull Request Authors

  • martindevans (479)
  • dependabot[bot] (248)
  • AsakusaRinne (82)
  • SignalRT (35)
  • m0nsky (31)
  • zsogitbe (27)
  • jasoncouture (22)
  • Lyrcaxis (19)
  • stephentoub (15)
  • xbotter (13)
  • phil-scott-78 (11)
  • saddam213 (11)
  • Lamothe (10)
  • sangyuxiaowu (10)
  • swharden (10)

Top Issue Labels

  • stale (49)
  • bug (42)
  • enhancement (26)
  • question (22)
  • good first issue (16)
  • feature request (11)
  • help wanted (11)
  • Upstream (10)
  • do not close (7)
  • backend (6)
  • discussion (6)
  • documentation (4)
  • llava (3)
  • duplicate (3)
  • wontfix (2)
  • FAQ (1)
  • break change (1)
  • dependencies (1)
  • ci/cd (1)
  • integrations (1)

Top Pull Request Labels

  • dependencies (248)
  • .NET (57)
  • minor-release (53)
  • enhancement (38)
  • break change (22)
  • ci/cd (20)
  • backend (20)
  • documentation (18)
  • native lib (15)
  • benchmark (12)
  • bug (11)
  • stale (10)
  • patch-release (9)
  • llava (8)
  • distribution (6)
  • experimental (3)
  • Upstream (2)
  • help wanted (2)
  • do not close (1)

Package metadata

proxy.golang.org: github.com/SciSharp/LLamaSharp

  • Homepage:
  • Documentation: https://pkg.go.dev/github.com/SciSharp/LLamaSharp#section-documentation
  • Licenses: mit
  • Latest release: v0.27.0 (published about 1 month ago)
  • Last Synced: 2026-05-24T22:32:39.706Z (8 days ago)
  • Versions: 28
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Rankings:
    • Dependent packages count: 6.528%
    • Average: 6.747%
    • Dependent repos count: 6.966%
proxy.golang.org: github.com/scisharp/llamasharp

nuget.org: llamasharp

LLamaSharp is a cross-platform library to run 🦙LLaMA/Mtmd model (and others) in your local device. Based on [llama.cpp](https://github.com/ggerganov/llama.cpp), inference with LLamaSharp is efficient on both CPU and GPU. With the higher-level APIs and RAG support, it's convenient to deploy LLM (Large Language Model) in your application with LLamaSharp.

  • Homepage:
  • Licenses: MIT
  • Latest release: 0.27.0 (published about 1 month ago)
  • Last Synced: 2026-05-28T20:04:34.729Z (4 days ago)
  • Versions: 37
  • Dependent Packages: 7
  • Dependent Repositories: 0
  • Downloads: 1,062,898 Total
  • Rankings:
    • Downloads: 7.556%
    • Average: 14.29%
    • Dependent repos count: 14.978%
    • Dependent packages count: 20.338%
  • Maintainers (1)
nuget.org: llamasharp.backend.cpu

LLamaSharp.Backend.Cpu is a backend for LLamaSharp to use with Cpu only.

  • Homepage: https://github.com/SciSharp/LLamaSharp
  • Licenses: MIT
  • Latest release: 0.27.0 (published about 1 month ago)
  • Last Synced: 2026-05-24T06:30:27.822Z (9 days ago)
  • Versions: 32
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 430,776 Total
  • Rankings:
    • Downloads: 10.778%
    • Dependent repos count: 14.978%
    • Average: 15.365%
    • Dependent packages count: 20.338%
  • Maintainers (1)
nuget.org: llamasharp.backend.cuda11

LLamaSharp.Backend.Cuda11 is a backend for LLamaSharp to use with Cuda11.

  • Homepage: https://github.com/SciSharp/LLamaSharp
  • Licenses: MIT
  • Latest release: 0.24.0 (published about 1 year ago)
  • Last Synced: 2026-05-27T09:04:14.108Z (6 days ago)
  • Versions: 26
  • Dependent Packages: 1
  • Dependent Repositories: 0
  • Downloads: 54,904 Total
  • Rankings:
    • Downloads: 12.911%
    • Dependent repos count: 14.978%
    • Average: 16.075%
    • Dependent packages count: 20.338%
  • Maintainers (1)
nuget.org: llamasharp.cpu.unoffical

The .NET binding of LLama.cpp, providing APIs to run the model and deploy it on Web. For model weights to run, please go to https://github.com/SciSharp/LLamaSharp for more information.

  • Homepage:
  • Licenses: MIT
  • Latest release: (published 6 days ago)
  • Last Synced: 2026-05-27T09:04:41.039Z (6 days ago)
  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Rankings:
    • Dependent repos count: 13.819%
    • Average: 16.327%
    • Dependent packages count: 18.835%
nuget.org: llamasharp.backend.cuda12

LLamaSharp.Backend.Cuda12 is a backend for LLamaSharp to use with Cuda12.

  • Homepage: https://github.com/SciSharp/LLamaSharp
  • Licenses: MIT
  • Latest release: 0.27.0 (published about 1 month ago)
  • Last Synced: 2026-04-26T17:15:23.168Z (about 1 month ago)
  • Versions: 29
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 231,764 Total
  • Rankings:
    • Downloads: 14.427%
    • Dependent repos count: 14.978%
    • Average: 16.581%
    • Dependent packages count: 20.338%
  • Maintainers (1)
nuget.org: llamasharp.semantic-kernel

The integration of LLamaSharp and Microsoft semantic-kernel.

  • Homepage:
  • Licenses: MIT
  • Latest release: 0.27.0 (published about 1 month ago)
  • Last Synced: 2026-05-28T23:30:42.047Z (4 days ago)
  • Versions: 26
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 116,741 Total
  • Rankings:
    • Dependent repos count: 14.978%
    • Dependent packages count: 20.338%
    • Average: 21.733%
    • Downloads: 29.884%
  • Maintainers (1)
nuget.org: llamasharp.backend.macmetal

LLamaSharp.Backend.MacMetal is a backend for LLamaSharp to use MAC with GPU support.

  • Homepage: https://github.com/SciSharp/LLamaSharp
  • Licenses: MIT
  • Latest release: 0.7.0 (published over 2 years ago)
  • Last Synced: 2026-05-27T09:04:43.045Z (6 days ago)
  • Versions: 5
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 5,741 Total
  • Rankings:
    • Dependent repos count: 13.819%
    • Dependent packages count: 18.835%
    • Average: 23.264%
    • Downloads: 37.136%
  • Maintainers (1)
nuget.org: llamasharp.kernel-memory

The integration of LLamaSharp and Microsoft kernel-memory. It could make it easy to support document search for LLamaSharp model inference.

  • Homepage:
  • Licenses: MIT
  • Latest release: 0.27.0 (published about 1 month ago)
  • Last Synced: 2026-04-26T17:15:23.414Z (about 1 month ago)
  • Versions: 23
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 111,844 Total
  • Rankings:
    • Dependent repos count: 14.978%
    • Dependent packages count: 20.338%
    • Average: 23.946%
    • Downloads: 36.521%
  • Maintainers (1)
nuget.org: llamasharp.cpu

The .NET binding of llama.cpp, providing APIs to run the model and deploy it on Web.

  • Homepage:
  • Licenses: MIT
  • Latest release: 0.2.1 (published about 3 years ago)
  • Last Synced: 2026-05-03T03:48:46.175Z (about 1 month ago)
  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 1,400 Total
  • Rankings:
    • Dependent repos count: 13.819%
    • Dependent packages count: 18.835%
    • Average: 26.023%
    • Downloads: 45.415%
  • Maintainers (1)
nuget.org: llamasharp.unofficial

The .NET binding of LLama.cpp, providing APIs to run the model and deploy it on Web. For model weights to run, please go to https://github.com/SciSharp/LLamaSharp for more information.

  • Homepage:
  • Licenses: MIT
  • Latest release: 0.4.1 (published about 3 years ago)
  • Last Synced: 2026-05-07T00:32:57.614Z (26 days ago)
  • Versions: 3
  • Dependent Packages: 1
  • Dependent Repositories: 0
  • Downloads: 1,370 Total
  • Rankings:
    • Dependent repos count: 13.819%
    • Dependent packages count: 18.835%
    • Average: 26.198%
    • Downloads: 45.938%
  • Maintainers (1)
nuget.org: llamasharp.backend.cpu.android

LLamaSharp.Backend.Cpu.Android is a backend for LLamaSharp to use with Android Cpu only.

  • Homepage: https://github.com/SciSharp/LLamaSharp
  • Licenses: MIT
  • Latest release: 0.27.0 (published about 1 month ago)
  • Last Synced: 2026-04-26T17:15:24.316Z (about 1 month ago)
  • Versions: 4
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 1,277 Total
  • Rankings:
    • Dependent repos count: 6.823%
    • Dependent packages count: 18.306%
    • Average: 27.208%
    • Downloads: 56.496%
  • Maintainers (1)
nuget.org: llamasharp.backend.vulkan.windows

LLamaSharp.Backend.Vulkan.Windows contains the Windows binaries for LLamaSharp with Vulkan support.

  • Homepage: https://github.com/SciSharp/LLamaSharp
  • Licenses: MIT
  • Latest release: 0.27.0 (published about 1 month ago)
  • Last Synced: 2026-04-26T17:15:23.503Z (about 1 month ago)
  • Versions: 10
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 17,189 Total
  • Rankings:
    • Dependent repos count: 7.441%
    • Dependent packages count: 19.962%
    • Average: 28.297%
    • Downloads: 57.487%
  • Maintainers (1)
nuget.org: llamasharp.backend.cuda12.windows

LLamaSharp.Backend.Cuda12.Windows contains the Windows binaries for LLamaSharp with Cuda12 support.

  • Homepage: https://github.com/SciSharp/LLamaSharp
  • Licenses: MIT
  • Latest release: 0.27.0 (published about 1 month ago)
  • Last Synced: 2026-04-26T17:15:23.765Z (about 1 month ago)
  • Versions: 10
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 170,828 Total
  • Rankings:
    • Dependent repos count: 7.441%
    • Dependent packages count: 19.962%
    • Average: 28.297%
    • Downloads: 57.487%
  • Maintainers (1)
nuget.org: llamasharp.backend.cuda11.linux

LLamaSharp.Backend.Cuda11.Linux contains the Linux binaries for LLamaSharp with Cuda11 support.

  • Homepage: https://github.com/SciSharp/LLamaSharp
  • Licenses: MIT
  • Latest release: 0.24.0 (published about 1 year ago)
  • Last Synced: 2026-05-05T16:34:32.537Z (28 days ago)
  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 19,719 Total
  • Rankings:
    • Dependent repos count: 7.441%
    • Dependent packages count: 19.962%
    • Average: 28.297%
    • Downloads: 57.487%
  • Maintainers (1)
nuget.org: llamasharp.backend.vulkan.linux

LLamaSharp.Backend.Vulkan.Linux contains the Linux binaries for LLamaSharp with Vulkan support.

  • Homepage: https://github.com/SciSharp/LLamaSharp
  • Licenses: MIT
  • Latest release: 0.27.0 (published about 1 month ago)
  • Last Synced: 2026-04-26T17:15:23.078Z (about 1 month ago)
  • Versions: 10
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 17,406 Total
  • Rankings:
    • Dependent repos count: 7.441%
    • Dependent packages count: 19.962%
    • Average: 28.297%
    • Downloads: 57.487%
  • Maintainers (1)
nuget.org: llamasharp.backend.cuda12.linux

LLamaSharp.Backend.Cuda12.Linux contains the Linux binaries for LLamaSharp with Cuda12 support.

  • Homepage: https://github.com/SciSharp/LLamaSharp
  • Licenses: MIT
  • Latest release: 0.27.0 (published about 1 month ago)
  • Last Synced: 2026-04-26T17:15:23.428Z (about 1 month ago)
  • Versions: 10
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 157,920 Total
  • Rankings:
    • Dependent repos count: 7.441%
    • Dependent packages count: 19.962%
    • Average: 28.297%
    • Downloads: 57.487%
  • Maintainers (1)
nuget.org: llamasharp.backend.cuda11.windows

LLamaSharp.Backend.Cuda11.Windows contains the Windows binaries for LLamaSharp with Cuda11 support.

  • Homepage: https://github.com/SciSharp/LLamaSharp
  • Licenses: MIT
  • Latest release: 0.24.0 (published about 1 year ago)
  • Last Synced: 2026-05-27T09:04:25.119Z (6 days ago)
  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 19,169 Total
  • Rankings:
    • Dependent repos count: 7.441%
    • Dependent packages count: 19.962%
    • Average: 28.297%
    • Downloads: 57.487%
  • Maintainers (1)
nuget.org: llamasharp.backend.vulkan

LLamaSharp.Backend.Vulkan is a backend for LLamaSharp to use with Vulkan.

  • Homepage: https://github.com/SciSharp/LLamaSharp
  • Licenses: MIT
  • Latest release: 0.27.0 (published about 1 month ago)
  • Last Synced: 2026-04-26T17:15:23.292Z (about 1 month ago)
  • Versions: 13
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 18,442 Total
  • Rankings:
    • Dependent repos count: 7.61%
    • Dependent packages count: 20.416%
    • Average: 28.415%
    • Downloads: 57.219%
  • Maintainers (1)
nuget.org: llamasharp.backend.opencl

LLamaSharp.Backend.OpenCL is a backend for LLamaSharp to use with OpenCL.

  • Homepage: https://github.com/SciSharp/LLamaSharp
  • Licenses: MIT
  • Latest release: 0.13.0 (published almost 2 years ago)
  • Last Synced: 2026-05-27T09:04:23.168Z (6 days ago)
  • Versions: 6
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 4,981 Total
  • Rankings:
    • Dependent repos count: 14.978%
    • Dependent packages count: 20.338%
    • Average: 30.344%
    • Downloads: 55.717%
  • Maintainers (1)

Dependencies

.github/workflows/spell_check.yml actions
  • actions/checkout v3 composite
  • crate-ci/typos master composite
.github/workflows/benchmark.yml actions
  • actions/checkout v4 composite
  • actions/upload-artifact v3 composite
.github/workflows/release-patch.yml actions
  • actions/cache v4 composite
  • actions/checkout v4 composite
  • actions/setup-python v5 composite
  • actions/upload-artifact v4 composite
  • nuget/setup-nuget v1 composite
LLama/runtimes/build/LLamaSharp.Backend.Vulkan.nuspec nuget
  • LLamaSharp.Backend.Vulkan.Linux $version$
  • LLamaSharp.Backend.Vulkan.Windows $version$
LLama.Web/LLama.Web.csproj nuget
  • Microsoft.AspNetCore.Mvc.Razor.RuntimeCompilation 8.0.21
  • System.Linq.Async 6.0.3
.github/workflows/update_api_references.yml actions
  • actions/checkout v4 composite
  • actions/setup-dotnet v4 composite
LLama/runtimes/build/temp.csproj nuget
LLama.SemanticKernel/LLamaSharp.SemanticKernel.csproj nuget
  • Microsoft.SemanticKernel.Abstractions 1.64.0
  • System.Memory 4.6.3
.github/workflows/release-minor.yml actions
  • actions/cache v4 composite
  • actions/checkout v4 composite
  • actions/setup-python v5 composite
  • actions/upload-artifact v4 composite
  • nuget/setup-nuget v1 composite
LLama/runtimes/build/LLamaSharp.Backend.Cpu.nuspec nuget
LLama/runtimes/build/LLamaSharp.Backend.Cuda12.Windows.nuspec nuget
  • LLamaSharp.Backend.Cpu $version$
Llama.Mobile/Llama.Mobile.csproj nuget
  • Microsoft.Extensions.Logging.Debug 8.0.1
  • Microsoft.Maui.Controls $(MauiVersion)
  • Microsoft.Maui.Controls.Compatibility $(MauiVersion)
LLama.Benchmark/LLama.Benchmark.csproj nuget
  • BenchmarkDotNet 0.15.5
  • BenchmarkDotNet.Diagnostics.Windows 0.15.5
LLama.Examples/LLama.Examples.csproj nuget
  • Microsoft.Extensions.Logging.Console 9.0.9
  • Microsoft.KernelMemory.Core 0.98.250508.3
  • Microsoft.SemanticKernel 1.65.0
  • Microsoft.SemanticKernel.Plugins.Memory 1.44.0-alpha
  • NAudio 2.2.1
  • SixLabors.ImageSharp 3.1.11
  • Spectre.Console 0.50.0
  • Spectre.Console.ImageSharp 0.50.0
  • Whisper.net 1.8.1
  • Whisper.net.Runtime 1.8.1
  • Whisper.net.Runtime.Clblast 1.5.0
  • Whisper.net.Runtime.CoreML 1.8.1
  • Whisper.net.Runtime.Cublas 1.5.0
LLama.Experimental/LLama.Experimental.csproj nuget
  • HuggingfaceHub 0.1.3
.github/workflows/release-minor-trigger.yml actions
  • actions/checkout v3 composite
  • actions/setup-dotnet v3 composite
LLama.KernelMemory/LLamaSharp.KernelMemory.csproj nuget
  • Microsoft.KernelMemory.Abstractions 0.98.250508.3
LLama/runtimes/build/LLamaSharp.Backend.Cuda12.nuspec nuget
  • LLamaSharp.Backend.Cuda12.Linux $version$
  • LLamaSharp.Backend.Cuda12.Windows $version$
LLama.Unittest/LLama.Unittest.csproj nuget
  • Microsoft.NET.Test.Sdk 17.14.1
  • Moq 4.20.72
  • System.Linq.Async 6.0.3
  • Xunit.SkippableFact 1.5.23
  • coverlet.collector 6.0.4
  • xunit 2.9.3
  • xunit.runner.visualstudio 3.1.3
.github/workflows/code_format.yml actions
  • actions/checkout v3 composite
  • actions/setup-dotnet v3 composite
.github/workflows/compile.yml actions
  • Jimver/cuda-toolkit v0.2.15 composite
  • actions/checkout v4 composite
  • actions/download-artifact v4 composite
  • actions/upload-artifact v4 composite
  • geekyeggo/delete-artifact v5 composite
  • nttld/setup-ndk v1 composite
.github/workflows/main.yml actions
  • actions/cache v4 composite
  • actions/checkout v4 composite
  • actions/setup-dotnet v4 composite
  • actions/upload-artifact v4 composite
  • jlumbroso/free-disk-space v1.3.1 composite
.github/workflows/release-patch-trigger.yml actions
  • actions/checkout v3 composite
  • actions/setup-dotnet v3 composite
.github/workflows/stale_issues.yml actions
  • actions/stale v9 composite
LLama/LLamaSharp.csproj nuget
  • CommunityToolkit.HighPerformance 8.4.0
  • IsExternalInit 1.0.3
  • Microsoft.Bcl.AsyncInterfaces 9.0.10
  • Microsoft.Extensions.AI.Abstractions 9.10.1
  • Microsoft.Extensions.Logging.Abstractions 9.0.9
  • System.Linq.Async 6.0.3
  • System.Memory 4.6.3
  • System.Numerics.Tensors 9.0.9
  • System.Text.Json 9.0.9
LLama/runtimes/build/LLamaSharp.Backend.Cpu.Android.nuspec nuget
LLama/runtimes/build/LLamaSharp.Backend.Cuda12.Linux.nuspec nuget
  • LLamaSharp.Backend.Cpu $version$
LLama/runtimes/build/LLamaSharp.Backend.Vulkan.Linux.nuspec nuget
  • LLamaSharp.Backend.Cpu $version$
LLama/runtimes/build/LLamaSharp.Backend.Vulkan.Windows.nuspec nuget
  • LLamaSharp.Backend.Cpu $version$
LLama.WebAPI/LLama.WebAPI.csproj nuget
  • Microsoft.AspNetCore.OpenApi 8.0.21
  • Microsoft.VisualStudio.Validation 17.8.8
  • Swashbuckle.AspNetCore 7.3.1