Collections: awesome-llama

https://github.com/ggml-org/llama.cpp

LLM inference in C/C++

ggml

Last synced: 31 Oct 2026

https://github.com/nomic-ai/gpt4all

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

ai-chat llm-inference

Last synced: 31 Oct 2026

https://github.com/ChunelFeng/CGraph

【A common used C++ & Python DAG framework】一个通用的、无三方依赖的、跨平台的、收录于awesome-cpp的、基于流图的并行计算框架。欢迎star & fork & 交流

ai ai-agents dag graph langgraph pipeline taskflow workflow

Last synced: 31 Oct 2026

https://github.com/chunelfeng/cgraph

【A common used C++ & Python DAG framework】一个通用的、无三方依赖的、跨平台的、收录于awesome-cpp的、基于流图的并行计算框架。欢迎star & fork & 交流

ai ai-agents dag graph langgraph pipeline taskflow workflow

Last synced: 31 Oct 2026

https://github.com/Vali-98/cui-llama.rn

React Native binding of llama.cpp

Last synced: 31 Oct 2026

https://github.com/mybigday/llama.node

Node.js binding of llama.cpp

llama llama-cpp llamacpp llm node-js nodejs

Last synced: 31 Oct 2026

https://github.com/fardjad/rs-llama-cpp

Automated Rust bindings generation for LLaMA.cpp

Last synced: 31 Oct 2026

https://github.com/Seeed-Projects/jetson-examples

The jetson-examples repository by Seeed Studio offers a seamless, one-line command deployment to run vision AI and Generative AI models on the NVIDIA Jetson platform.

cv demo genai jetson seeedstudio

Last synced: 31 Oct 2026

https://github.com/flexflow/flexflow-train

Automatically Discovering Fast Parallelization Strategies for Distributed Deep Neural Network Training

Last synced: 31 Oct 2026

https://github.com/vectorch-ai/ScaleLLM

A high-performance inference system for large language models, designed for production environments.

cuda efficiency gpu inference llama llama3 llm llm-inference model performance production serving speculative transformer

Last synced: 31 Oct 2026

https://github.com/UbiquitousLearning/mllm

Fast Multimodal LLM on Mobile Devices

ai llama llm mobile multimodal

Last synced: 31 Oct 2026

https://github.com/vitoplantamura/OnnxStream

Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but also Mistral 7B on desktops and servers. ARM, x86, WASM, RISC-V supported. Accelerated by XNNPACK. Python, C# and JS(WASM) bindings available.

llama machine-learning mistral onnx raspberry-pi stable-diffusion tinyml wasm webassembly whisper yolov8

Last synced: 31 Oct 2026

https://github.com/sophgo/LLM-TPU

Run generative AI models in sophgo BM1684X/BM1688

bm1684x bm1688 generative-ai internvl3 large-language-models llama3 llm llm-inference qwen2-5-vl qwen3 qwen3-5 qwen3-vl

Last synced: 31 Oct 2026

https://github.com/turing-machines/mentals-ai

No code AI agents

ai ai-agents artificial-intelligence cli gpt gpt-4o llama3 llm machine-learning openai terminal

Last synced: 31 Oct 2026

https://github.com/mgonzs13/llama_ros

llama.cpp (GGUF LLMs) and llava.cpp (GGUF VLMs) for ROS 2

audio cpp embeddings ggml gguf gpt langchain llama llamacpp llava llavacpp llm multimodal rerank reranking ros2 vlm

Last synced: 31 Oct 2026

https://github.com/inferflow/inferflow

Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).

baichuan2 bloom deepseek falcon gemma internlm llama2 llamacpp llm-inference m2m100 minicpm mistral mixtral mixture-of-experts model-quantization moe multi-gpu-inference phi-2 qwen

Last synced: 30 Oct 2026

https://github.com/AXERA-TECH/ax-llm

Explore LLM model deployment based on AXera's AI chips, It provides OpenAI‑compatible APIs and supports AX620E, AX650 and AX637 series chips.

axera edge-computing gemma2 huggingface internvl2 llama3 llm minicpm minicpm-v qwen2 transformer vlm

Last synced: 31 Oct 2026

https://github.com/absadiki/pyllamacpp

Python bindings for llama.cpp

langchain llama llamacpp llms

Last synced: 31 Oct 2026

https://github.com/kuvaus/LlamaGPTJ-chat

Simple chat program for LLaMa, GPT-J, and MPT models.

ai cli cpp gpt gpt4all gptj llama mpt

Last synced: 30 Oct 2026

https://github.com/nrl-ai/CustomChar

Your customized AI assistant - Personal assistants on any hardware! With llama.cpp, whisper.cpp, ggml, LLaMA-v2.

cpp ggml llama llama-cpp llama-v2 llm stt tts whisper-cpp

Last synced: 30 Oct 2026

https://github.com/trzy/llava-cpp-server

LLaVA server (llama.cpp).

llama llama2 llava llm multimodal vision-transformer

Last synced: 30 Oct 2026

https://github.com/CoderLSF/fast-llama

Runs LLaMA with Extremely HIGH speed

cpu-inference inference-engine llama llama2

Last synced: 31 Oct 2026

https://github.com/hwpoison/llamacpp-terminal-chat

A lightweight chat terminal-interface for llama.cpp server written in C++ with many features and windows/linux support.

chat llama llama-server llamacpp mistral-7b roleplay teminal-application

Last synced: 31 Oct 2026

https://github.com/adamydwang/mobilellama

a lightweight C++ LLaMA inference engine for mobile devices

cpp inference llama llm openblas

Last synced: 31 Oct 2026

https://github.com/rendezqueue/rendezllama

CLI for llama.cpp with various commands to guide, edit, and regenerate tokens on the fly.

ai chatbot large-language-models llama llamacpp llm

Last synced: 31 Oct 2026

https://github.com/icppWorld/icpp_llm

on-chain LLMs

internetcomputer llama2 llm

Last synced: 31 Oct 2026

https://github.com/adithya-s-k/LLM-InferenceNet

LLM InferenceNet is a C++ project designed to facilitate fast and efficient inference from Large Language Models (LLMs) using a client-server architecture. It enables optimized interactions with pre-trained language models, making deployment on edge devices easier.

cpp llama llamacpp llm

Last synced: 30 Oct 2026

https://github.com/kuvaus/llama-chat

Simple chat program for LLaMa models

ai cpp gpt gpt4all llama

Last synced: 30 Oct 2026

https://github.com/niansa/libjustlm

Super easy to use library for doing LLaMA/GPT-J stuff! - Mirror of: https://gitlab.com/niansa/libjustlm

ai cpp17 cpp20 gpt-j llama llama2 llm llm-inference mpt python wrapper-library

Last synced: 30 Oct 2026

https://github.com/niansa/discord_llama

Multi-Model and multi-tasking llama Discord Bot - Mirror of: https://gitlab.com/niansa/discord_llama

ai cpp20 discord-bot llama llama2 llamacpp llm llm-inference

Last synced: 30 Oct 2026

https://github.com/gotzmann/booster

Booster - open accelerator for LLM models. Better inference and debugging for AI hackers

chatgpt exllama ggml gpt llama llama-cpp llamacpp llm ollama oobabooga openai vllm

Last synced: 31 Oct 2026

https://github.com/Mobile-Artificial-Intelligence/llama_sdk

lcpp is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)

facebook flutter-ai gemma ggml gguf llama llama2 llamacpp llm llm-inference local-ai meta mistral mixtral mobile-ai

Last synced: 31 Oct 2026

https://github.com/guinmoon/llmfarm_core.swift

Swift library to work with llama and other large language models.

ai falcon gpt-2 gptneox llama llama2 rwkv starcoder swift

Last synced: 31 Oct 2026

https://github.com/znx-x/arcadia-llm-server

This repository is an LLM interface based on llama.cpp and allows you to run your own Arcadia LLM server locally in just a few easy-to-follow steps.

ai bot chat cpp free gpt llama local mistral open-source server

Last synced: 31 Oct 2026

https://github.com/edp1096/my-llama

Go bindings for llama.cpp and webui

alpaca golang llama llamacpp vicuna

Last synced: 30 Oct 2026

https://github.com/cadavidf/sonic-ai

Code. Music. Live.

artificial creativity generation intelligence learning llama machine music

Last synced: 30 Oct 2026

https://github.com/azkadev/llama

LLaMA (Language Learning for Machine Translation) adalah proyek riset yang diprakarsai oleh Facebook AI Research (FAIR) yang bertujuan untuk meningkatkan kualitas terjemahan mesin menggunakan pendekatan yang lebih alami dan berfokus pada bahasa asal.

ai android chatbot chatgpt chatgpt-dart chatgpt-offline chatgpt4 dart flutter indonesia ios linux llama macos windows