Collections: awesome-llama

https://github.com/hiyouga/LlamaFactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

agent ai deepseek fine-tuning gemma gpt instruction-tuning large-language-models llama llama3 llm lora moe nlp peft qlora quantization qwen rlhf transformers

Last synced: 15 Sep 2026

https://github.com/b4rtaz/distributed-llama

Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

distributed-computing distributed-llm llama2 llama3 llm llm-inference llms neural-network open-llm

Last synced: 15 Sep 2026

https://github.com/josh-xt/agixt

AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memory, smart features, and a versatile plugin system, AGiXT delivers efficient and comprehensive AI solutions.

agent-llm agi agixt ai artificial automation chromadb intelligence llama llamacpp llm llmops openai python

Last synced: 15 Sep 2026

https://github.com/Josh-XT/AGiXT

agent-llm agi agixt ai artificial automation chromadb intelligence llama llamacpp llm llmops openai python

Last synced: 15 Sep 2026

https://github.com/internlm/lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

codellama cuda-kernels deepspeed fastertransformer internlm llama llama2 llama3 llm llm-inference turbomind

Last synced: 16 Sep 2026

https://github.com/tenstorrent/tt-metal

:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.

accelerator ai cuda deepseek gpu img-gen kernels llama llm metal scale-out stable-diffusion tenstorrent video-gen

Last synced: 16 Sep 2026

https://github.com/ad-si/cai

User friendly CLI tool for AI tasks. Stop thinking about LLMs and prompts, start getting results!

ai anthropic chatgpt claude cli gpt gpt-4o gpt-5 groq llama llama3 llamafile llm machine-learning mistral ml ollama openai prompt rust

Last synced: 15 Sep 2026

https://github.com/vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

amd blackwell cuda deepseek deepseek-v3 gpt gpt-oss inference kimi llama llm llm-serving model-serving moe openai pytorch qwen qwen3 tpu transformer

Last synced: 16 Sep 2026

https://github.com/modular/modular

The Modular Platform (includes MAX & Mojo)

ai language machine-learning max modular mojo programming-language

Last synced: 16 Sep 2026

https://github.com/mudler/LocalAI

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

agents ai api audio-generation decentralized distributed image-generation libp2p llama llm mamba mcp musicgen object-detection rerank stable-diffusion text-generation tts

Last synced: 16 Sep 2026

https://github.com/mudler/localai

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

agents ai api audio-generation decentralized distributed image-generation libp2p llama llm mamba mcp musicgen object-detection rerank stable-diffusion text-generation tts

Last synced: 16 Sep 2026

https://github.com/ggml-org/llama.cpp

LLM inference in C/C++

ggml

Last synced: 16 Sep 2026

https://github.com/the-open-agent/openagent

⚡️next-generation personal AI assistant powered by LLM, RAG and agent loops, supporting computer-use, browser-use and coding agent, demo: https://demo.openagentai.org

agent agentic agentic-ai agi chatbot chatgpt gpt harness hermes-agent knowledge-base langchain llm mcp model-context-protocol multi-agent openagent openai openclaw rag

Last synced: 15 Sep 2026

https://github.com/kaito-project/aikit

🏗️ Fine-tune, build, and deploy open-source LLMs easily!

ai buildkit chatgpt docker fine-tuning finetuning gemma gpt inference kubernetes large-language-models llama llm localllama mistral mixtral nvidia open-llm open-source-llm openai

Last synced: 15 Sep 2026

https://github.com/TheR1D/shell_gpt

A command-line productivity tool powered by AI large language models like GPT-5, will help you accomplish your tasks faster and more efficiently.

chatgpt cheat-sheet cli commands gpt-3 gpt-4 gpt-5 linux llama llm ollama openai productivity python shell terminal

Last synced: 15 Sep 2026

https://github.com/sendbird/sendbird-uikit-react

Build chat in minutes with Sendbird UIKit open source code.

api-for-chat bard chat-api chat-api-platform chat-platform chat-sdk chat-ui chatbot-api chatbot-sdk chatbot-ui chatgpt communications-platform genai-chatbot genai-chatbot-api gpt-powered-chatbot llama2 messaging-api messaging-platform messaging-sdk palm2

Last synced: 15 Sep 2026

https://github.com/josh-xt/AGiXT

agent-llm agi agixt ai artificial automation chromadb intelligence llama llamacpp llm llmops openai python

Last synced: 15 Sep 2026

https://github.com/InternLM/lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

codellama cuda-kernels deepspeed fastertransformer internlm llama llama2 llama3 llm llm-inference turbomind

Last synced: 16 Sep 2026

https://github.com/langgenius/dify

Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack.

agent agentic-ai agentic-framework agentic-workflow ai automation claude deepseek genai gpt llm low-code mcp nextjs no-code openai python skills workflow