Collections: awesome-llama

https://github.com/yas-sim/openvino-chatbot-rag-pdf

LLM Chatbot-RAG by OpenVINO. The chatbot can read a PDF file and answer to the related questions.

chatbot huggingface large-language-models llama llama2 llm neural-chat openvino pdf python rag retrieval-augmented-generation

Last synced: 17 Oct 2026

https://github.com/ymcui/Chinese-LLaMA-Alpaca

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

alpaca alpaca-2 large-language-models llama llama-2 llm lora nlp plm pre-trained-language-models quantization

Last synced: 17 Oct 2026

https://github.com/Uminosachi/open-llm-webui

This repository contains a web application designed to execute relatively compact, locally-operated Large Language Models (LLMs).

chatbot ggml gradio huggingface language-model llama llama2 llama3 llava llava-llama3 llm nlp transformers

Last synced: 17 Oct 2026

https://github.com/InternLM/xtuner

A Next-Generation Training Engine Built for Ultra-Large MoE Models

agent deepseek-v3 gpt-oss intern-s1 internvl kimi-k2 llm multimodal qwen3-moe qwen3-vl reinforcement-learning

Last synced: 17 Oct 2026

https://github.com/AkiRusProd/llm-agent

LLM using long-term memory through vector database

chromadb gpt gpt4all intent-classification large-language-models llama llm machine-learning nlp rag

Last synced: 17 Oct 2026

https://github.com/sinanazem/llm-apps

This repository showcases projects leveraging advanced language models.

chatbots llama2 ollama rag

Last synced: 17 Oct 2026

https://github.com/AlfrescoLabs/alfresco-ai-assistants

A set of Alfresco AI Assistants to help users and customers get the information they need or perform complex tasks, simply conveying each request via natural language

alfresco chatbot genai llama3 llm rag

Last synced: 17 Oct 2026

https://github.com/rbourgeat/ImpAI

😈 ImpAI is an advanced role play app using large language and diffusion models.

ai character-ai chat docker game ggml gguf linux llama llama-cpp llm macos roleplay stable-diffusion windows

Last synced: 17 Oct 2026

https://github.com/kyegomez/M2PT

Implementation of M2PT in PyTorch from the paper: "Multimodal Pathway: Improve Transformers with Irrelevant Data from Other Modalities"

ai attention attention-is-all-you-need gpt4 gpt5 llama ml models mulit-modality multi-modal

Last synced: 17 Oct 2026

https://github.com/katha-ai/VELOCITI

VELOCITI Benchmark Evaluation and Visualisation Code

artificial-intelligence awesome-list benchmark benchmarking chain-of-thought clip dataset evaluation-metrics llama3 llm llm-inference semantic-role-labeling video video-understanding vision-language-model vlm

Last synced: 17 Oct 2026

https://github.com/icppWorld/icgpt

on-chain LLMs for the Internet Computer

internet-computer llama2 llm

Last synced: 17 Oct 2026

https://github.com/PKU-Alignment/safe-rlhf

Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback

ai-safety alpaca beaver datasets deepspeed gpt large-language-models llama llm llms reinforcement-learning reinforcement-learning-from-human-feedback rlhf safe-reinforcement-learning safe-reinforcement-learning-from-human-feedback safe-rlhf safety transformer transformers vicuna

Last synced: 17 Oct 2026

https://github.com/LennardZuendorf/thesis-webapp

Webapp/Application implemention of my thesis about XAI and Interpretability of Transformer Models.

bertviz gradio huggingface interpretable-ai llama2 mistral shap xai

Last synced: 17 Oct 2026

https://github.com/unslothai/unsloth

Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.

agent ai chatgpt deepseek fine-tuning gemma image-generation llama llm llms openai python qwen reinforcement-learning self-hosted stable-diffusion text-to-speech tts ui unsloth

Last synced: 17 Oct 2026

https://github.com/horseee/LLM-Pruner

[NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support Llama-3/3.1, Llama-2, LLaMA, BLOOM, Vicuna, Baichuan, TinyLlama, etc.

baichuan bloom chatglm compression language-model llama llama-2 llama3 llm neurips-2023 pruning pruning-algorithms vicuna

Last synced: 17 Oct 2026

https://github.com/hpcaitech/SwiftInfer

Efficient AI Inference & Serving

artificial-intelligence deep-learning gpt inference llama llama2 llm-inference llm-serving

Last synced: 17 Oct 2026

https://github.com/leehanchung/SMILE-factory

Finetune Falcon, LLaMA, MPT, and RedPajama on consumer hardware using PEFT LoRA

agi falcon gpt llama llm lora mpt nlp redpajama

Last synced: 17 Oct 2026

https://github.com/jorge-armando-navarro-flores/chat-with-multiple-PDFs-LLAMA2

This script is a chat application that allows users to ask questions about multiple PDF documents implemented with meta's LLAMA2

chat-with-pdf faiss langchain llama2 llms python

Last synced: 17 Oct 2026

https://github.com/wenge-research/YAYI

雅意大模型：为客户打造安全可靠的专属大模型，基于大规模中英文多领域指令数据训练的 LlaMA 2 & BLOOM 系列模型，由中科闻歌算法团队研发。(Repo for YaYi Chinese LLMs based on LlaMA2 & BLOOM)

bloom chat chinese llama llama2 llm lora yayi

Last synced: 17 Oct 2026

https://github.com/GaiZhenbiao/ChuanhuChatGPT

GUI for ChatGPT API and many LLMs. Supports agents, file-based QA, GPT finetuning and query with web search. All with a neat UI.

chatbot chatglm chatgpt-api claude dalle3 ernie gemini gemma inspurai llama midjourney minimax moss ollama qwen spark stablelm

Last synced: 17 Oct 2026

https://github.com/hardaatbaath/llama2-pytorch

Implementation of "Llama 2: Open Foundation and Fine-Tuned Chat Models"

deep-learning llama natural-language-processing pytorch-implementation

Last synced: 17 Oct 2026

https://github.com/MoFHeka/LLaMA-Megatron

A LLaMA1/LLaMA12 Megatron implement.

llama llama2 llm llm-training megatron megatron-lm pytorch

Last synced: 17 Oct 2026

https://github.com/nikolamilosevic86/local-genAI-search

Local-GenAI-Search is a generative search engine based on Llama 3, langchain and qdrant that answers questions based on your local files

generative-ai langchain large-language-models llama3 local msmarco python3 qdrant-client search-engine sentence-embeddings sentence-transformers

Last synced: 17 Oct 2026

https://github.com/tmc/go-llama2

Llama 2 inference in one file of pure Go

golang llama2

Last synced: 17 Oct 2026

https://github.com/aju22/LLaMA2

This repository contains an implementation of the LLaMA 2 (Large Language Model Meta AI) model, a Generative Pretrained Transformer (GPT) variant. The implementation focuses on the model architecture and the inference process. The code is restructured and heavily commented to facilitate easy understanding of the key parts of the architecture.

attention gpt kv-cache llama llama2 llm natural-language-processing rms-norm rope transformer

Last synced: 17 Oct 2026

https://github.com/boostcampaitech5/LawBot-Online-Legal-Advice-LLM-Service

사용자가 채팅웹을 통해 자신이 처한 법률적 상황을 제시하면, 입력에 대한 문맥을 모델이 이해하여 가이드라인을 제시하고, 유사한 상황의 판례를 제공하는 웹 서비스입니다. (2023.08.18 서비스 종료)

airflow docker llama2 reactjs selenium tailwindcss

Last synced: 17 Oct 2026

https://github.com/Agora-Lab-AI/Atom

a suite of finetuned LLMs for atomically precise function calling 🧪

ai artificial-intelligence convolutional-neural-networks function-calling gpt-4 llama llama2 llamacpp ml multi-modal open-source rpa rpc task-automation tool-usage transformer workflow-automation

Last synced: 17 Oct 2026

https://github.com/ATH-MaaS/Ovis

A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.

chatbot llama3 multimodal multimodal-large-language-models multimodality qwen vision-language-learning vision-language-model

Last synced: 17 Oct 2026

https://github.com/zetavg/llama-lora-tuner

UI tool for fine-tuning and testing your own LoRA models base on LLaMA, GPT-J and more. One-click run on Google Colab. + A Gradio ChatGPT-like Chat UI to demonstrate your language models.

ai alpaca alpaca-lora google-colab gpt gpt-j language-model llama lora machine-learning peft

Last synced: 17 Oct 2026

https://github.com/zetavg/LLaMA-LoRA-Tuner

UI tool for fine-tuning and testing your own LoRA models base on LLaMA, GPT-J and more. One-click run on Google Colab. + A Gradio ChatGPT-like Chat UI to demonstrate your language models.

ai alpaca alpaca-lora google-colab gpt gpt-j language-model llama lora machine-learning peft

Last synced: 17 Oct 2026

https://github.com/IAAR-Shanghai/Grimoire

Grimoire is All You Need for Enhancing Large Language Models

baichuan chatgpt datasets gpt-4 grimoire icl in-context-learning llama llm phi2

Last synced: 17 Oct 2026

https://github.com/IAAR-Shanghai/FastMem

Fast Memorization of Prompt Improves Context Awareness of Large Language Models (Findings of EMNLP 2024)

context-awareness llama3 llm qwen1-5

Last synced: 17 Oct 2026

https://github.com/micheldumontier/gba-rag

This is a demonstration project to provide LLM-based question answering over the website and documents of German Federal Joint Committee (G-BA).

health llama3 llamaindex llm qdrant-vector-database

Last synced: 17 Oct 2026

https://github.com/horenbergerb/llamagotchi

A bunch of LLaMa model investigations, including recreating generative agents (from the paper Generative Agents: Interactive Simulacra of Human Behavior)

generative-agents langchain llama llamacpp llm machine-learning

Last synced: 17 Oct 2026

https://github.com/chuangchuangtan/LLaVA-NeXT-Image-Llama3-Lora

LLaVA-NeXT-Image-Llama3-Lora, Modified from https://github.com/arielnlee/LLaVA-1.6-ft

finetuning llama3 llava-next lora

Last synced: 17 Oct 2026

https://github.com/Relaxed-System-Lab/HexGen

[ICML 2024] Serving LLMs on heterogeneous decentralized clusters.

decentralized deep-learning generative-inference heterogeneous large-language-models llama2 machine-learning model-serving

Last synced: 17 Oct 2026

https://github.com/SqueezeAILab/SqueezeLLM

[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization

efficient-inference large-language-models llama llm localllm model-compression natural-language-processing post-training-quantization quantization small-models text-generation transformer

Last synced: 17 Oct 2026

https://github.com/ggml-org/llama.cpp

LLM inference in C/C++

ggml

Last synced: 17 Oct 2026

https://github.com/mddunlap924/PII-Detection

Personal Identifiable Information (PII) entity detection and performance enhancement with synthetic data generation

fine-tuning kaggle-competition llama3 llm named-entity-recognition ner pii pii-data pii-detection prompt-engineering

Last synced: 17 Oct 2026

https://github.com/predibase/lorax

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

fine-tuning gpt llama llm llm-inference llm-serving llmops lora model-serving pytorch transformers

Last synced: 17 Oct 2026

https://github.com/OwlAIProject/Owl

A personal wearable AI that runs locally

ai ble bluetooth esp32 llama2 mistral nrf52840 ollama wearable whisper

Last synced: 17 Oct 2026

https://github.com/AdrianBZG/llama-multimodal-vqa

Multimodal Instruction Tuning for Llama 3

chatbot chatgpt gpt-4 huggingface instruction-tuning language-models llama llama2 llama3 multimodal multimodal-instruction-tuning visual-language-learning visual-question-answering vqa

Last synced: 17 Oct 2026

https://github.com/hyperonym/basaran

Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.

generative gpt huggingface language-model llama llm model natural-language-processing nlp openai-api python text-generation transformers

Last synced: 17 Oct 2026

https://github.com/Mahesh3394/query_response_generation_llama

In this project we hosted LLAMA model with 7B parameter for response generation. Here we created a rest api which can generate a response when provided a query text.

ctransformers fastapi langchain llama2 llm nlp pytorch rest-api

Last synced: 17 Oct 2026

https://github.com/silvanmelchior/IncognitoPilot

An AI code interpreter for sensitive data, powered by GPT-4 or Code Llama / Llama 2.

ai chatgpt chatgpt-code-interpreter codellama copilot gpt-4 llama2 llm python

Last synced: 17 Oct 2026

https://github.com/brown-palm/AntGPT

Official code implemtation of paper AntGPT: Can Large Language Models Help Long-term Action Anticipation from Videos?

deep-learning gpt-35-turbo gpt4 large-language-models llama2 peft peft-fine-tuning-llm video-forecasting vision-and-language

Last synced: 17 Oct 2026

https://github.com/jianzhnie/Open-R1

The open source implementation of DeepSeek-R1. 开源复现 DeepSeek-R1

deepseek-r1 deepseek-v3 grpo llm rlhf

Last synced: 17 Oct 2026

https://github.com/artitw/text2text

Text2Text Language Modeling Toolkit

chatbot chatgpt cross-lingual embeddings information-retrieval levenshtein-distance llama llm multi-lingual nlp question-generation rag search tf-idf tokenizer transformers translator

Last synced: 17 Oct 2026

https://github.com/hkproj/pytorch-llama

LLaMA 2 implemented from scratch in PyTorch

language-model llama llama2 paper-implementations pytorch

Last synced: 17 Oct 2026

https://github.com/aahouzi/llama2-chatbot-cpu

A LLaMA2-7b chatbot with memory running on CPU, and optimized using smooth quantization, 4-bit quantization or Intel® Extension For PyTorch with bfloat16.

4-bit-cpu bfloat16 chatbot chatbot-memory chatgpt cpu huggingface int8 intel ipex langchain llama llama2 meta meta-ai neural-compression numa optimization smooth-quantization streamlit

Last synced: 17 Oct 2026

https://github.com/time-series-foundation-models/lag-llama

Lag-Llama: Towards Foundation Models for Probabilistic Time Series Forecasting

forecasting foundation-models lag-llama llama time-series time-series-forecasting time-series-prediction time-series-transformer timeseries timeseries-forecasting transformers

Last synced: 17 Oct 2026

https://github.com/declare-lab/red-instruct

Codes and datasets of the paper Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignment

huggingface-transformers llama llama2 llm llms

Last synced: 17 Oct 2026

https://github.com/dropbox/hqq

Official implementation of Half-Quadratic Quantization (HQQ)

llm machine-learning quantization

Last synced: 17 Oct 2026

https://github.com/TinyLLaVA/TinyLLaVA_Factory

A Framework of Small-scale Large Multimodal Models

large-multimodal-models llama llava nlp tinyllama transformers vision-language

Last synced: 17 Oct 2026

https://github.com/explosion/curated-transformers

🤖 A PyTorch library of curated Transformer models and their composable components

albert bert camembert dolly2 falcon gptneox llama llm llms nlp pytorch roberta transformer transformers xlm-roberta

Last synced: 17 Oct 2026

https://github.com/AIAnytime/Llama2-Medical-Chatbot

This is a medical bot built using Llama2 and Sentence Transformers. The bot is powered by Langchain and Chainlit. The bot runs on a decent CPU machine with a minimum of 16GB of RAM.

Last synced: 17 Oct 2026

https://github.com/Riccorl/llama-trainer

Llama Trainer Utility

huggingface llama llm llm-inference llm-training llms transformer

Last synced: 17 Oct 2026

https://github.com/svjack/CodeActAgent-Gradio

UnOfficial Gradio Repo for ICML 2024 paper "Executable Code Actions Elicit Better LLM Agents" by Xingyao Wang, Yangyi Chen, Lifan Yuan, Yizhe Zhang, Yunzhu Li, Hao Peng, Heng Ji.

agent agent-based-modeling chatbot code-act code-action code-generation code-llms coding gradio gradio-interface llama llama-cpp llama-cpp-python llm llm-agent mistral mistral-7b mixtral prompt python

Last synced: 17 Oct 2026

https://github.com/zjunlp/KnowLM

An Open-sourced Knowledgable Large Language Model Framework.

bilingual chinese deep-learning deepspeed english gpt-3 instructie instruction-following instruction-tuning instructions knowlm language-model large-language-models llama lora models pre-trained-language-models pre-trained-model pre-training reasoning

Last synced: 17 Oct 2026

https://github.com/titanml/takeoff-community

TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models accessible to everyone.

deployment llama llm python quantization

Last synced: 17 Oct 2026

https://github.com/jankais3r/LLaMA_MPS

Run LLaMA (and Stanford-Alpaca) inference on Apple Silicon GPUs.

alpaca apple-silicon chat chatbot chatgpt llama llms macos metal ml mps stanford-alpaca torch

Last synced: 17 Oct 2026

https://github.com/just-ctrlC-ctrlV/Mechanical-Assistant

Imagine a world where your mechanical tasks are streamlined and optimized by a knowledgeable and ever-learning assistant. That's the vision behind this LLM project: a powerful mechanical assistant trained on a vast dataset of mechanical data.

baai langchain llama llama-index llms python streamlit

Last synced: 17 Oct 2026

https://github.com/alta3/llm-the-alta3-way

The greatest LLMs on the planet!

gpt llama llm

Last synced: 17 Oct 2026

https://github.com/kyegomez/AttnWithConvolutions

Interleaved Attention's with convolutions for text modeling

artificial-intelligence attention attention-mechanism convolution convolutional-neural-networks gpt4 llama machine-learning machine-learning-algorithms

Last synced: 17 Oct 2026

https://github.com/abhiverse01/TinyLlama-Base-CodeGen

This repository contains code and resources for fine-tuning a Tiny Llama base model for code generation tasks. The project aims to leverage advanced machine learning techniques to improve the performance of code generation models.

jupyter-notebook llama2 python3

Last synced: 17 Oct 2026

https://github.com/OpenGVLab/InternGPT

InternGPT (iGPT) is an open source demo platform where you can easily showcase your AI models. Now it supports DragGAN, ChatGPT, ImageBind, multimodal chat like GPT-4, SAM, interactive image editing, etc. Try it at igpt.opengvlab.com (支持DragGAN、ChatGPT、ImageBind、SAM的在线Demo系统)

chatgpt click draggan foundation-model gpt gpt-4 gradio husky image-captioning imagebind internimage langchain llama llm multimodal sam segment-anything vicuna video-generation vqa

Last synced: 17 Oct 2026

https://github.com/HectorPulido/discord-bot-LLama

It's a chatbot made with Python that simulates natural conversation with users. The chatbot is designed to be used in the Discord platform, providing an interactive experience for the users. LLAMA can run in user hardware or in colab.

ai chatbot llama

Last synced: 17 Oct 2026

https://github.com/tongjilibo/bert4torch

An elegent pytorch implement of transformers

belle bert bert4keras bert4torch chatglm large-language-models llama llm named-entity-recognition nlp pytorch relation-extraction seq2seq text-classification transformers

Last synced: 17 Oct 2026

https://github.com/YY0649/ICE-PIXIU

ICE-PIXIU：A Cross-Language Financial Megamodeling Framework

internlm large-language-models llama nlp pixiu vllm

Last synced: 17 Oct 2026

https://github.com/WangRongsheng/CareGPT

🌞 CareGPT (关怀GPT)是一个医疗大语言模型，同时它集合了数十个公开可用的医疗微调数据集和开放可用的医疗大语言模型，包含LLM的训练、测评、部署等以促进医疗LLM快速发展。Medical LLM, Open Source Driven for a Healthy Future.

baichuan gpt large-language-models llama llama2 medical-llm

Last synced: 17 Oct 2026

https://github.com/Yxxxb/VoCo-LLaMA

[CVPR'2025] VoCo-LLaMA: This repo is the official implementation of "VoCo-LLaMA: Towards Vision Compression with Large Language Models".

image-compression llama llava

Last synced: 17 Oct 2026

https://github.com/zhudotexe/kani

kani (カニ) is a highly hackable microframework for tool-calling language models. (NLP-OSS @ EMNLP 2023)

chatgpt framework function-calling gpt-4 large-language-models llama llms microframework openai tool-use

Last synced: 17 Oct 2026

https://github.com/tatsu-lab/stanford_alpaca

Code and documentation to train Stanford's Alpaca models, and generate the data.

deep-learning instruction-following language-model

Last synced: 17 Oct 2026

https://github.com/YJiangcm/LTE

[ACL 2024] Learning to Edit: Aligning LLMs with Knowledge Editing

alignment knowledge-editing large-language-models llama model-editing qwen supervised-finetuning

Last synced: 17 Oct 2026

https://github.com/riccardomusmeci/mlx-llm

Large Language Models (LLMs) applications and tools running on Apple Silicon in real-time with Apple MLX.

llama llm mistral mlx phi transformers

Last synced: 17 Oct 2026

https://github.com/duongnguyen-dev/WhisBot

Your Voice Assistant

langchain llama speech-reco text-generation voice-assistant

Last synced: 17 Oct 2026

https://github.com/misonsky/HiFT

memory-efficient fine-tuning; support 24G GPU memory fine-tuning 7B

chinese-llama chinese-llama-65b huggingface-transformers large-language-models llama2 llama3 lora memory-efficient-tuning peft-fine-tuning-llm pytorch-implementation transformers

Last synced: 17 Oct 2026

https://github.com/pjlab-sys4nlp/llama-moe

⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)

continual-pre-training expert-partition llama llm mixture-of-experts moe

Last synced: 17 Oct 2026

https://github.com/lizhongyi123/llama2_chat_fine

该项目为对llama2进行微调及使用中文微调的技术细节，适合初学者观看。

chatgpt chinese llama llama2

Last synced: 17 Oct 2026

https://github.com/jy-yuan/KIVI

[ICML 2024] KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache

inference large-language-models llama llm natural-language-processing quantization transformer

Last synced: 17 Oct 2026

https://github.com/TUDB-Labs/mLoRA

An Efficient "Factory" to Build Multiple LoRA Adapters

baichuan chatglm dpo finetune gpu llama llama2 llm lora mlora peft rlhf

Last synced: 17 Oct 2026

https://github.com/AbineshSivakumar/Llama-2-7B-QLoRA-Vicuna

This repository contains code to fine-tune a Llama-7B-Uncensored model using the Vicuna 70k dataset using Quantised Low Rank Adapations (LoRA).

large-language-models llama llm-training llms qlora vicuna

Last synced: 17 Oct 2026

https://github.com/megvii-research/IntLLaMA

IntLLaMA: A fast and light quantization solution for LLaMA

llama llms quantization

Last synced: 17 Oct 2026

https://github.com/ymcui/Chinese-LLaMA-Alpaca-3

中文羊驼大模型三期项目 (Chinese Llama-3 LLMs) developed from Meta Llama 3

alpaca large-language-models llama llama-2 llama-3 llama3 llm nlp

Last synced: 17 Oct 2026

https://github.com/zilliztech/GPTCache

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.

aigc autogpt babyagi chatbot chatgpt chatgpt-api dolly gpt langchain llama llama-index llm memcache milvus openai redis semantic-search similarity-search vector-search

Last synced: 17 Oct 2026

https://github.com/thomas-yanxin/KarmaVLM

🧘🏻‍♂️KarmaVLM (相生)：A family of high efficiency and powerful visual language model.

llama2 llava multimodel qwen2 vision-language-model visual-language-learning vlm

Last synced: 17 Oct 2026

https://github.com/bigsk1/voice-chat-ai

🎙️ Speak with AI - Run locally using Ollama, OpenAI, Anthropic or xAI - Speech uses SparkTTS, OpenAI, ElevenLabs, Kokoro, xAI and more

ai-speech ai-voice ai-voice-agent anthropic-claude conversational-ai elevenlabs-api fastapi ollama selfhosted tts typecast voice-ai webrtc whisper-ai xai xai-tts

Last synced: 17 Oct 2026

https://github.com/vtuber-plan/langport

Langport is a language model inference service

api chatgpt chatgpt-api fauxpilot langchain language-model llama llama-cpp llm openai tabby

Last synced: 17 Oct 2026

https://github.com/PaddlePaddle/PaddleNLP

Easy-to-use and powerful LLM and SLM library with awesome model zoo.

bert compression distributed-training document-intelligence embedding ernie information-extraction llama llm neural-search nlp paddlenlp pretrained-models question-answering search-engine semantic-analysis sentiment-analysis transformers uie

Last synced: 17 Oct 2026

https://github.com/TencentARC/LLaMA-Pro

[ACL 2024] Progressive LLaMA with Block Expansion.

llama llama2 llm

Last synced: 17 Oct 2026

https://github.com/helixml/helix

♾️ Private Agent Fleet with Spec Coding. Each agent gets their own GPU-accelerated desktop. Run Claude, Codex, Gemini and open models on a full private AI Stack ♾️

agents api genai glm golang helm k8s kimi llm llm-agent llm-serving openai openapi qwen rag self-hosted swagger swarm

Last synced: 17 Oct 2026

https://github.com/zjunlp/EasyEdit

[ACL 2024] An Easy-to-use Knowledge Editing Framework for LLMs.

artificial-intelligence baichuan chatgpt cknowedit easyedit easyedit2 efficient gpt knowedit knowledge-editing knowlm large-language-models llama mmedit model-editing natural-language-processing safeedit tool trustworthy-ai unlearning

Last synced: 17 Oct 2026

https://github.com/ModelTC/lightllm

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

deep-learning gpt llama llm model-serving nlp openai-triton

Last synced: 17 Oct 2026

https://github.com/c0sogi/llama-api

An OpenAI-like LLaMA inference API

api exllama fastapi llama llamacpp

Last synced: 17 Oct 2026

https://github.com/UbiquitousLearning/mllm

Fast Multimodal LLM on Mobile Devices

ai llama llm mobile multimodal

Last synced: 17 Oct 2026

https://github.com/mudler/localai

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

agents ai api audio-generation decentralized distributed image-generation libp2p llama llm mamba mcp musicgen object-detection rerank stable-diffusion text-generation tts

Last synced: 17 Oct 2026

https://github.com/mudler/LocalAI

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

agents ai api audio-generation decentralized distributed image-generation libp2p llama llm mamba mcp musicgen object-detection rerank stable-diffusion text-generation tts

Last synced: 17 Oct 2026

https://github.com/Guitaricet/relora

Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates

deep-learning distributed-training llama nlp peft transformer

Last synced: 17 Oct 2026

https://github.com/chatchat-space/Langchain-Chatchat

Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Llama) RAG and Agent app with langchain

chatbot chatchat chatglm chatgpt embedding faiss fastchat gpt knowledge-base langchain langchain-chatglm llama llm milvus ollama qwen rag retrieval-augmented-generation streamlit xinference