https://github.com/Tiiny-AI/PowerInfer

High-speed Large Language Model Serving for Local Deployment

large-language-models llama llm llm-inference local-inference

Last synced: 12 Nov 2026

https://github.com/oobabooga/textgen

Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private.

Last synced: 12 Nov 2026

https://github.com/unslothai/unsloth

Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.

agent ai chatgpt deepseek fine-tuning gemma image-generation llama llm llms openai python qwen reinforcement-learning self-hosted stable-diffusion text-to-speech tts ui unsloth

Last synced: 13 Nov 2026

https://github.com/ggml-org/llama.cpp

LLM inference in C/C++

ggml

Last synced: 13 Nov 2026

https://github.com/itsPreto/baby-code

100% Private & Simple. OSS 🐍 Code Interpreter for LLMs 🦙

flask html langchain-python llama2 llamacpp python3

Last synced: 12 Nov 2026