Collections: awesome-llama

https://github.com/PaddlePaddle/PaddleNLP

Easy-to-use and powerful LLM and SLM library with awesome model zoo.

bert compression distributed-training document-intelligence embedding ernie information-extraction llama llm neural-search nlp paddlenlp pretrained-models question-answering search-engine semantic-analysis sentiment-analysis transformers uie

Last synced: 18 Aug 2026

https://github.com/explosion/curated-transformers

🤖 A PyTorch library of curated Transformer models and their composable components

albert bert camembert dolly2 falcon gptneox llama llm llms nlp pytorch roberta transformer transformers xlm-roberta

Last synced: 17 Aug 2026

https://github.com/predibase/lorax

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

fine-tuning gpt llama llm llm-inference llm-serving llmops lora model-serving pytorch transformers

Last synced: 18 Aug 2026

https://github.com/kyegomez/zeta

Build high-performance AI models with modular building blocks

attention-mechanism attention-model chatgpt ffns llms lucidrains openai pytorch pytorch-implementation pytorch-tutorial tensorflow transformer-architecture transformers

Last synced: 17 Aug 2026

https://github.com/hiyouga/LlamaFactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

agent ai deepseek fine-tuning gemma gpt instruction-tuning large-language-models llama llama3 llm lora moe nlp peft qlora quantization qwen rlhf transformers

Last synced: 18 Aug 2026

https://github.com/pleisto/flappy

Production-Ready LLM Agent SDK for Every Developer

agent chatgpt generative-ai llama llm rewoo transformers

Last synced: 17 Aug 2026

https://github.com/Tongjilibo/bert4torch

An elegent pytorch implement of transformers

belle bert bert4keras bert4torch chatglm large-language-models llama llm named-entity-recognition nlp pytorch relation-extraction seq2seq text-classification transformers

Last synced: 17 Aug 2026

https://github.com/tongjilibo/bert4torch

An elegent pytorch implement of transformers

belle bert bert4keras bert4torch chatglm large-language-models llama llm named-entity-recognition nlp pytorch relation-extraction seq2seq text-classification transformers

Last synced: 17 Aug 2026

https://github.com/artitw/text2text

Text2Text Language Modeling Toolkit

chatbot chatgpt cross-lingual embeddings information-retrieval levenshtein-distance llama llm multi-lingual nlp question-generation rag search tf-idf tokenizer transformers translator

Last synced: 17 Aug 2026

https://github.com/oxidized-transformers/oxidized-transformers

Modular Rust transformer/LLM library using Candle

bert llama llama2 llm roberta rust transformers

Last synced: 17 Aug 2026

https://github.com/hiyouga/fastedit

🩹Editing large language models within 10 seconds⚡

bloom chatbots chatgpt falcon gpt large-language-models llama llms pytorch transformers

Last synced: 17 Aug 2026

https://github.com/hiyouga/FastEdit

🩹Editing large language models within 10 seconds⚡

bloom chatbots chatgpt falcon gpt large-language-models llama llms pytorch transformers

Last synced: 17 Aug 2026

https://github.com/jina-ai/rungpt

An open-source cloud-native of large multi-modal models (LMMs) serving framework.

flamingo gpt-4 large-language-models large-multimadality-models llama llm-hosting llm-serve lmm-serve multi-modality opengpt self-hosting transformers

Last synced: 17 Aug 2026

https://github.com/TinyLLaVA/TinyLLaVA_Factory

A Framework of Small-scale Large Multimodal Models

large-multimodal-models llama llava nlp tinyllama transformers vision-language

Last synced: 17 Aug 2026

https://github.com/yuanzhoulvpi2017/zero_nlp

中文nlp解决方案(大模型、数据、模型、训练、推理)

bert chatglm-6b clip gpt gpt2 huggingface-transformers llama llama2 llava nlp pytorch text-generation transformers

Last synced: 17 Aug 2026

https://github.com/time-series-foundation-models/lag-llama

Lag-Llama: Towards Foundation Models for Probabilistic Time Series Forecasting

forecasting foundation-models lag-llama llama time-series time-series-forecasting time-series-prediction time-series-transformer timeseries timeseries-forecasting transformers

Last synced: 17 Aug 2026

https://github.com/chavinlo/trahiv

🤗 Transformers with Hivemind for decentralized finetuning across the Internet, à la BitTorrent

deep-learning dht distributed-systems distributed-training hivemind llama llm transformers volunteer-computing

Last synced: 17 Aug 2026

https://github.com/PKU-Alignment/safe-rlhf

Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback

ai-safety alpaca beaver datasets deepspeed gpt large-language-models llama llm llms reinforcement-learning reinforcement-learning-from-human-feedback rlhf safe-reinforcement-learning safe-reinforcement-learning-from-human-feedback safe-rlhf safety transformer transformers vicuna

Last synced: 17 Aug 2026

https://github.com/apocas/restai

RESTai is an AIaaS (AI as a Service) open-source platform. Supports many public and local LLM suported by Ollama/vLLM/etc. Precise embeddings usage, tuning, analytics etc. Built-in image/audio generation with dynamic loading generators. Live chat deployment. Built-in block based graphical language. Prompt versioning and much more...

blocky embeddings fastapi langchain llama llamaindex llm ollama openai openaiapi python rag stable-diffusion transformers

Last synced: 18 Aug 2026

https://github.com/mukel/llama3.java

Llama 3+ inference in pure Java

chatgpt genai gguf huggingface java llama llama3 llamacpp llm llm-inference llms openai simd transformers

Last synced: 17 Aug 2026

https://github.com/kennethleungty/Llama-2-Open-Source-LLM-CPU-Inference

Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A

c-transformers chatgpt cpu cpu-inference deep-learning document-qa faiss langchain language-models large-language-models llama llama-2 llm machine-learning natural-language-processing nlp open-source-llm python sentence-transformers transformers

Last synced: 17 Aug 2026

https://github.com/minggnim/nlp-models

A repository for training transformer based models

chatbot chatbots ctransformers deeplearning falcon fine-tuning gpt-2 langchain llama2 llms multi-label-classification multi-task-learning nlp pytorch qdrant-vector-database transformers

Last synced: 17 Aug 2026

https://github.com/johnmai-dev/ChatMLX

🤖✨ChatMLX is a modern, open-source, high-performance chat application for MacOS based on large language models.

chat llama mlx mlx-swift qwen swift swift-transformers swiftui transformer transformers

Last synced: 17 Aug 2026

https://github.com/pratyushasharma/laser

The Truth Is In There: Improving Reasoning in Language Models with Layer-Selective Rank Reduction

gpt-j interpretability laser llama2 llm llms model-compression transformers

Last synced: 17 Aug 2026

https://github.com/riccardomusmeci/mlx-llm

Large Language Models (LLMs) applications and tools running on Apple Silicon in real-time with Apple MLX.

llama llm mistral mlx phi transformers

Last synced: 17 Aug 2026

https://github.com/interestingLSY/swiftLLM

A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of vLLM).

cuda gpt inference inference-engine llama llm llm-inference llm-serving llmops mlops model-serving pytorch transformer transformers

Last synced: 17 Aug 2026

https://github.com/misonsky/HiFT

memory-efficient fine-tuning; support 24G GPU memory fine-tuning 7B

chinese-llama chinese-llama-65b huggingface-transformers large-language-models llama2 llama3 lora memory-efficient-tuning peft-fine-tuning-llm pytorch-implementation transformers

Last synced: 17 Aug 2026

https://github.com/jerry1993-tech/Cornucopia-LLaMA-Fin-Chinese

聚宝盆(Cornucopia): 中文金融系列开源可商用大模型，并提供一套高效轻量化的垂直领域LLM训练框架(Pretraining、SFT、RLHF、Quantize等)

chinese finance large-language-models llama nlp qa rlhf sft text-generation transformers

Last synced: 17 Aug 2026

https://github.com/ukairia777/tensorflow-nlp-tutorial

tensorflow를 사용하여 텍스트 전처리부터, Topic Models, BERT, GPT, LLM과 같은 최신 모델의 다운스트림 태스크들을 정리한 Deep Learning NLP 저장소입니다.

bert bert-ner dpo huggingface keras-tutorial llama llm lora named-entity-recognition natural-language-processing nlp nlp-tutorial question-answering sft tensorflow trainer transformers

Last synced: 17 Aug 2026

https://github.com/teelinsan/camoscio

Camoscio: An Italian instruction-tuned language model based on LLaMA

italian language-model llama transformers

Last synced: 17 Aug 2026

https://github.com/shm007g/LLaMA-Cult-and-More

Large Language Models for All, 🦙 Cult and More, Stay in touch !

alpaca chatgpt deepspeed ggml gpt gpt4 gptq llama llm loralib pytorch tensorflow transformers vicuna

Last synced: 17 Aug 2026

https://github.com/Bangla-RAG/PoRAG

Fully Configurable RAG Pipeline for Bengali Language RAG Applications. Supports both Local and Huggingface Models, Built with Langchain.

ai bengali bengali-nlp chromadb langchain llama3 llm nlp rag transformers

Last synced: 17 Aug 2026

https://github.com/nathanlesage/local-chat

LocalChat is a ChatGPT-like chat that runs on your computer

chat chatbot chatgpt electron huggingface language-model llama llamacpp llm local privacy transformers

Last synced: 17 Aug 2026

https://github.com/luffycodes/Tutorbot-Spock

An Education Tutoring Chatbot based on Learning Science Principles powered by Large Language Models

biology-education chatbot gpt intelligent-tutoring-system large-language-models llama transformers vicuna vicuna-13b

Last synced: 17 Aug 2026

https://github.com/seonglae/llama2gptq

Chat to LLaMa 2 that also provides responses with reference documents over vector database. Locally available model using GPTQ 4bit quantization.

chatai chatbot chatgpt cuda gpt langchain llama-2 llama2 model-quantization quantization question-answering rye streamlit-chat transformers

Last synced: 17 Aug 2026

https://github.com/euclaise/SlimTrainer

Full finetuning of large language models without large memory requirements

language-modeling llama transformers

Last synced: 17 Aug 2026

https://github.com/sanjibnarzary/awesome-llm

Curated list of open source and openly accessible large language models

alpaca bloom chatgpt chatgpt-alternative chatgpt-alternatives chatllama gpt gpt-j koala llama llm llms nlp opt peft rlhf transformer transformers vicuna xturing

Last synced: 17 Aug 2026

https://github.com/ModelTC/QLLM

[ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Models"

llama llama2 llm post-training-quantization pytorch quantization transformers

Last synced: 17 Aug 2026

https://github.com/daniel-furman/sft-demos

Language modeling sft demos

chatbot deep-learning instruction-tuning llama nlp text-generation transformers

Last synced: 17 Aug 2026

https://github.com/Esmail-ibraheem/Axon

AI research lab🔬: implementations of AI papers and theoretical research: InstructGPT, llama, transformers, diffusion models, RLHF, etc...

arxiv-papers llama llms paper-implementations pytorch research-paper rlhf transformers

Last synced: 17 Aug 2026

https://github.com/Uminosachi/open-llm-webui

This repository contains a web application designed to execute relatively compact, locally-operated Large Language Models (LLMs).

chatbot ggml gradio huggingface language-model llama llama2 llama3 llava llava-llama3 llm nlp transformers

Last synced: 17 Aug 2026

https://github.com/Betswish/Cross-Lingual-Consistency

Easy-to-use framework for evaluating cross-lingual consistency of factual knowledge (Supported LLaMA, BLOOM, mT5, RoBERTa, etc.) Paper here: https://aclanthology.org/2023.emnlp-main.658/

bloom knowledge llama mt5 roberta transformers

Last synced: 17 Aug 2026

https://github.com/CodeName-Detective/Prompt-to-Song-Generation-using-Large-Language-Models

This project uses LLMs to generate music from text by understanding prompts, creating lyrics, determining genre, and composing melodies. It harnesses LLM capabilities to create songs based on text inputs through a multi-step approach.

deep-learning deep-reinforcement-learning flan-t5 genre-classification llama3 llms natural-language-processing policy-gradient rlhf seq-to-seq transformers

Last synced: 17 Aug 2026

https://github.com/rafaelvp-db/databricks-llm-prompt-engineering

Examples of Prompt Engineering, Zero Shot Learning, Few Shot Learning and Retrieval Augmented Generation (RAG) using Hugging Face, Databricks and MLflow

databricks few-shot-learning gradio hugging-face large-language-models llama2 llm llmops llms mlflow mlops mosaic-ml mosaicml mpt prompt-engineering retrieval-augmented-generation retrieval-augmented-qa transformers zero-shot-learning

Last synced: 17 Aug 2026

https://github.com/SachinKalsi/annotated-research-papers

This repository is a comprehensive collection of research papers, annotations, and concise summaries in the field of Natural Language Processing (NLP). It focuses on machine learning and deep learning techniques, providing valuable resources for NLP enthusiasts and researchers.

deep-learning deep-learning-papers language-model large-language-models llama machine-learning natural-language-processing nlp nlp-machine-learning nlp-papers research-paper transformer-architecture transformers

Last synced: 17 Aug 2026

https://github.com/kazcfz/LlamaIndex-RAG-Chat

Perform RAG (Retrieval-Augmented Generation) from your PDFs using this Colab notebook! Powered by Llama 2

ai chatbot colab colab-notebook huggingface llama-index llama2 llamacpp llm openllm rag retrieval-augmented-generation transformers

Last synced: 17 Aug 2026

https://github.com/davzoku/cria

An end-to-end LLM app prototype based on Llama 2

artificial-intelligence chatbot llama2 llm nextjs transformers

Last synced: 17 Aug 2026

https://github.com/yas-sim/openvino-llm-minimal-code

Most simple and minimal code to run an LLM chatbot from HuggingFace hub with OpenVINO

chatbot huggingface huggingface-transformers intel large-language-models llama llm llm-post-process neuralchat openvino optimum-intel python text-generation tinyllama transformers

Last synced: 17 Aug 2026

https://github.com/Ramseths/app-llama2

Generative AI - LLaMA 2 7B & LangChain, to generate stories based on a genre.

artificial-intelligence generative-ai github gradio langchain large-language-models learn llama2 meta natural-language-processing python student-vscode transformers

Last synced: 17 Aug 2026

https://github.com/Pawandeep-prog/finetune-llm-lora-guide

llama llm lora peft transformers

Last synced: 17 Aug 2026

https://github.com/ColinWu0403/LLaMA-2-hf-Chatbot

Chatbot from pretrained LLaMA-2 LLM model, fine-tuned with medical research papers using RAG (Retrieval-Augmented Generation)

django langchain llama2 llm pytorch reactjs transformers

Last synced: 17 Aug 2026

https://github.com/Gapi505/Sparky-2

This is a discord bot running on llama cpp with the llama 3 model and image geneartion

ai cuda llama3 llamacpp stable-diffusion torch transformers

Last synced: 17 Aug 2026

https://github.com/crux82/BISS-2024

This repository hosts materials from the Bertinoro International Spring School 2024 course

distributional-semantics instruction-tuning large-language-models llama llama2 nlp transformers

Last synced: 17 Aug 2026

https://github.com/kikirizki/miniChatbot

The minimum implementation of chatbot using popular LLM model rewrite from ground up with simplicity in mind

llama llama2 llm llm-inference llm-training mistral nlp transformers transformers-architecture

Last synced: 17 Aug 2026

https://github.com/BobaZooba/shurale

Conversation AI model for open domain dialogs

bitsandbytes cerebras chatgpt deep-learning deep-neural-networks gpt gpt-4 gptq large-language-models llama llama2 llm mistral natural-language-processing nlp openai pytorch torch transformers vicuna

Last synced: 17 Aug 2026

https://github.com/BrightBlueCheese/transformers_and_chemistry

The Role of Model Architecture and Scale in Predicting Molecular Properties: Insights from Fine-Tuning RoBERTa, BART, and LLaMA

bart cheminformatics llama predicting-molecular-properties roberta the-role-of-model-architecture-and-scale transformers

Last synced: 17 Aug 2026

https://github.com/avatsaev/av-local-llm-api

Allows to easily run local REST API with a custom LLM, running locally or remotely, with user defined system instructions. Useful for quick local autmations that require problem solving with large langague models and interaction via a REST API.

fastapi llama llamacpp llm machine-learning mistral openai transformers

Last synced: 17 Aug 2026

https://github.com/v3xlrm1nOwo1/know-Medical-Dialogues-With-LLama2

llama2 medical python pytorch qlora transformers

Last synced: 17 Aug 2026

https://github.com/Siris2314/Llama2YT

Enhanching YT Summarization with OpenAI Whisper + Llama2 + RAG

gguf huggingface llama2 llms mistral-7b nlp nlp-machine-learning openai openai-whisper python retrieval-augmented-generation transformers

Last synced: 17 Aug 2026

https://github.com/bpevangelista/llms_learning

ML – From Scratch to Llama2, Mistral and Phi-2 in Pytorch

course cuda gpt llama llm machine-learning phi transformers

Last synced: 17 Aug 2026

https://github.com/arham-kk/llama2-qlora-sft

This model is a fine-tuned model based on the "TinyPixel/Llama-2-7B-bf16-sharded" model and "timdettmers/openassistant-guanaco" dataset

bitsandbytes fine-tuning language-model llama2 llm nlp peft qlora quantization transformers

Last synced: 17 Aug 2026

https://github.com/Logisx/LLMath-QLoRA

🧮 End-to-end LLM instruction finetuning based on PEFT & QLoRA to solve math problems.

aws docker dvc fastapi instruction-tuning llama llm llmops machine-learning nlp transformers

Last synced: 17 Aug 2026

https://github.com/JinHanLei/LLM-Stream-Service

Streaming API and Web page for Large Language Models (Llama3) based on transformers+flask+gradio.

flask gradio huggingface llama2 llama3 python transformers

Last synced: 17 Aug 2026

https://github.com/EvilFreelancer/MoDA

Is a framework designed to enhance the performance and flexibility of large language models by dynamically selecting and integrating specialized LoRA adapters based on the input query.

adapters gpt llama2 lora router transformers

Last synced: 17 Aug 2026

https://github.com/antonio-f/llama2_colab

Fine-Tune Your Own Llama 2 Model LOCALLY in a Colab Notebook

colab-notebook fine-tuning jupyter-notebook large-language-models llama2 qlora transformers

Last synced: 17 Aug 2026

https://github.com/trifledmatter/model-engine

C++ Implementation of Meta's LLaMA v2 Engine. Credited to ggerganov/llama.cpp

ai artificial intelligence llama llama2 transformers

Last synced: 17 Aug 2026

https://github.com/FareedKhan-dev/2.3-million-parameter-llm-depriac

Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.

deep-learning depricated huggingface large-language-models llama llm python pytorch transformers

Last synced: 17 Aug 2026

https://github.com/Beenaa99/LLM-Prompt-Recovery

ECE-5424 Advanced Machine Learning Final Project - LLM Prompt Recovery task

bart gemma-2b huggingface llama llm mistral-7b mixtral t5-model transformers

Last synced: 17 Aug 2026

https://github.com/abhishek351/Finance-Chatbot-using-Llama-2

Financial Bot with Llama 2(quantized model) It quickly answers financial queries using the llama-2-7b-chat.ggmlv3.q4_0.bin model

huggingface llama2 transformers

Last synced: 17 Aug 2026

https://github.com/tjake/Jlama

Jlama is a modern LLM inference engine for Java

ai genai gpt huggingface java llama llm openai simd transformers

Last synced: 17 Aug 2026

https://github.com/bilalhameed248/Medical-Llama3-8B

Implement fine-tuned version of the powerful Llama3 8B model, specifically designed to answer medical questions in an informative way using hugging face pipeline

bert deep-learning llama3 machine-learning medical medical-notes nlp text-generation transformers

Last synced: 17 Aug 2026

https://github.com/hyperonym/basaran

Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.

generative gpt huggingface language-model llama llm model natural-language-processing nlp openai-api python text-generation transformers