Collections: awesome-llama

https://github.com/sigoden/aichat

All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI Tools & Agents, with access to OpenAI, Claude, Gemini, Ollama, Groq, and more.

ai ai-agents chatbot claude cli function-calling gemini llm ollama openai rag rust shell webui

Last synced: 02 Jun 2026

https://github.com/sobelio/llm-chain

`llm-chain` is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tasks

chatgpt langchain llama llm openai rust text-summary

Last synced: 02 Jun 2026

https://github.com/SilasMarvin/lsp-ai

LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.

ai auto-completion developer-tools ide language-client llama llamacpp llm lsp mistral openai self-hosted

Last synced: 02 Jun 2026

https://github.com/mdrokz/rust-llama.cpp

LLama.cpp rust bindings

api-bindings cpp crates-io ffi llama llama-cpp machine-learning model rust

Last synced: 02 Jun 2026

https://github.com/smallcloudai/refact

AI Agent that handles engineering tasks end-to-end: integrates with developers’ tools, plans, executes, and iterates until it achieves a successful result.

ai-agent developer-tools enterprise fine-tuning on-prem open-source rag self-hosted swe-bench vscode

Last synced: 02 Jun 2026

https://github.com/pleisto/flappy

Production-Ready LLM Agent SDK for Every Developer

agent chatgpt generative-ai llama llm rewoo transformers

Last synced: 02 Jun 2026

https://github.com/ad-si/cai

User friendly CLI tool for AI tasks. Stop thinking about LLMs and prompts, start getting results!

ai anthropic chatgpt claude cli gpt gpt-4o gpt-5 groq llama llama3 llamafile llm machine-learning mistral ml ollama openai prompt rust

Last synced: 02 Jun 2026

https://github.com/Noeda/rllama

Rust+OpenCL+AVX2 implementation of LLaMA inference code

Last synced: 02 Jun 2026

https://github.com/Atome-FE/llama-node

Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llama/alpaca/gpt4all/vicuna/rwkv model.

ai embeddings gpt langchain large-language-models llama llama-node llama-rs llamacpp llm napi napi-rs nodejs rwkv

Last synced: 02 Jun 2026

https://github.com/atome-fe/llama-node

Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llama/alpaca/gpt4all/vicuna/rwkv model.

ai embeddings gpt langchain large-language-models llama llama-node llama-rs llamacpp llm napi napi-rs nodejs rwkv

Last synced: 02 Jun 2026

https://github.com/zackshen/gguf

a GGUF file parser

ai ggml gguf gpt llama llm model

Last synced: 02 Jun 2026

https://github.com/mdegans/drama_llama

Yet another `llama.cpp` Rust wrapper

llama llama2 llama3 llamacpp mistral rust

Last synced: 02 Jun 2026

https://github.com/oxidized-transformers/oxidized-transformers

Modular Rust transformer/LLM library using Candle

bert llama llama2 llm roberta rust transformers

Last synced: 02 Jun 2026

https://github.com/jeremychone/rust-agentic

Support library for building Agentic MCP and Agent2Agent-based services.

Last synced: 02 Jun 2026

https://github.com/yybit/pllm

Portable LLM - A rust library for LLM inference

aigc cpu-inference llama2 llm

Last synced: 02 Jun 2026

https://github.com/floneum/kalosm

Instant, controllable, local pre-trained AI models in Rust

ai candle constrained-generation dioxus floneum-v3 kalosm llama llamacpp llm mistral rust transcription whisper

Last synced: 02 Jun 2026

https://github.com/HubertKasperek/ai-companion-py

Python bindings for ai-companion (only backend, without WebUI)

chatbot library llama llm python

Last synced: 02 Jun 2026

https://github.com/0xricksanchez/AIonic

AIonic: A unified, user-friendly Rust library for seamless integration with various public Large Language Model APIs, such as openAI or Bard

ai api artificial-intelligence bard chatgpt chatgpt-api llama llama2 openai

Last synced: 02 Jun 2026

https://github.com/MNThomson/chat

chat - platform agnostic "ai" cli

chatgpt cli commands gpt-3 gpt-4 linux llama llm ollama openai productivity shell terminal

Last synced: 02 Jun 2026

https://github.com/codito/arey

Simple large language model playground app

ai cli cpu-inference gguf large-language-models llama2 llamacpp llm local-model mistral

Last synced: 02 Jun 2026

https://github.com/dcSpark/shinkai-node

Shinkai allows you to create AI agents without touching code. Define tasks, schedule actions, and let Shinkai write custom code for you. Native crypto support included.

ai chatgpt gui llama3 llm ollama qwen rag

Last synced: 02 Jun 2026

https://github.com/fermyon/ai-examples

A collection of serverless apps that show how Fermyon's Serverless AI (currently in private beta) works. Reference: https://developer.fermyon.com/spin/serverless-ai-tutorial

ai fermyon llama serverless spin

Last synced: 02 Jun 2026

https://github.com/moritztng/fltr

Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.

cli grep grep-like llama llama-2 llm localllama mistral mixtral mixtral-8x7b operating-system rust

Last synced: 02 Jun 2026

https://github.com/fuglede/llama.ttf

A font for writing tiny stories

llama ttf why

Last synced: 02 Jun 2026

https://github.com/hoof-ai/hoof

"Just hoof it!" - A spotlight like interface to Ollama

ai hoof hoofing llama llm ml ollama rust spotlight tauri

Last synced: 02 Jun 2026

https://github.com/Querent-ai/querent

Querent is a foundry of large scale AI system applications

Last synced: 02 Jun 2026

https://github.com/chelsea0x3b/llama-dfdx

LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!

cuda deep-learning inference language-model llama neural-network rust rust-lang

Last synced: 02 Jun 2026

https://github.com/mikecvet/nl-sh

The Natural Language Shell integrates OpenAI's GPTs, Anthropic's Claude, or local GGUF-formatted LLMs directly into the terminal experience, allowing operators to describe their tasks in either POSIX commands or fluent human language

gguf gpt-4 llama2 llm rust rust-lang shell shell-script terminal

Last synced: 02 Jun 2026

https://github.com/subbu963/bott

bott: Your Terminal Copilot

chatbot chatgpt llama llm ollama openai terminal-based

Last synced: 02 Jun 2026

https://github.com/njfio/fluent_cli

Fluent CLI is an advanced command-line interface designed to interact seamlessly with multiple workflow systems like FlowiseAI, Langflow, Make, and Zapier. Tailored for developers and IT professionals, Fluent CLI facilitates robust automation, simplifies complex interactions, and enhances productivity through a powerful and command suite

ai anthropic automation cli flowise-ai gemini generation groqapi langchain langflow llama3 llamaindex llm make openai rag rust workflow zapier

Last synced: 02 Jun 2026

https://github.com/JuliaMerz/pantry

Actor based multi-llm registry + runner.

ggml llama2 llm rust

Last synced: 02 Jun 2026

https://github.com/Sollimann/chatty-llama

A fullstack Rust + React chat app using open-source Llama language models

artificial-intelligence chatbot fullstack llama2 llm meta react rust

Last synced: 02 Jun 2026

https://github.com/Abraxas-365/open-gh-copilot

Open Version of Github copilot , you can run with OpenAi, Anthropic or Local models

ai cli copilo github-copilot llama llm openai

Last synced: 02 Jun 2026

https://github.com/danielgrittner/llama2-rs

LLaMA2 + Rust

ai deep-learning llama2 llama2c llm llm-inference rust

Last synced: 02 Jun 2026

https://github.com/mtb0x1/llama2.rs.wasm

llama2-wasm using rust

llama2 llama2-rs llama2-wasm rust wasm webassembly

Last synced: 02 Jun 2026

https://github.com/AlexisTM/ollama-discord-persona-rs

Generic persona (Ollama discord bot) but in Rust.

bot discord discord-bot gpt-3 kirby llama llama2 mistral mistral-7b ollama rust rust-lang serenity-rs

Last synced: 02 Jun 2026

https://github.com/kpcyrd/summarize-cli

Attempt to summarize text from `stdin`, using a large language model (locally and offline), to `stdout`

llama2 llm local-llm offline-llm text-processing

Last synced: 02 Jun 2026

https://github.com/tbogdala/sentient_core

A terminal style user interface to chat with AI characters using llama LLMs for locally processed AI.

ai chat-application ggml llama llamacpp llm llm-inference rust terminal-ui

Last synced: 02 Jun 2026

https://github.com/gyanaranjans/llma-rust

A simple webapp to showcase the ability to write a simple chatbot webapp using only Rust, TailwindCSS and an Open Source language model such as a variant of GPT, LLaMA, etc.

leptos llama rust

Last synced: 02 Jun 2026

https://github.com/jpmcb/ollama-kubernetes-operator

🦙 A Kubernetes operator for Ollama

kubernetes kubernetes-deployment llama llm ollama rust

Last synced: 02 Jun 2026

https://github.com/chriamue/chat-flame-backend

ChatFlameBackend is an innovative backend solution for chat applications, leveraging the power of the Candle AI framework with a focus on the Mistral model

backend-api candle huggingface-inference-endpoint llama2 llm-inference mistral phi rust-lang

Last synced: 02 Jun 2026

https://github.com/fcn94/llm_stream_endpoint

Simple LLM Rest API using Rust, Warp and Candle. Dedicated for quantized version of either phi-2 ( default) , Mistral, or Llama. Work using CPU or CUDA

api candle cpu cuda cuda-kernels endpoint llama2 llm llm-server mistral-7b phi-2 quantized rest rest-api rust streaming

Last synced: 02 Jun 2026

https://github.com/tbogdala/ai_notepad

A lightweight Rust application to test interaction with large language models. Currently supports running GGUF quantized models with hardware acceleration.

ai candle gui huggingface llama rust text-generation

Last synced: 02 Jun 2026