Ecosyste.ms: Summary

https://github.com/nptt9/illama

A fast, lightweight, parallel inference server for Llama LLMs.

exllama exllamav2 flash-attention-2 inference llama llama2 llama3 llm-inference paged-attention server

Last synced: 18 Aug 2026

https://github.com/soumyadeepbose/Jessup-Cellar-RAG-App

Jessup's Helper is a Retrieval Based Chatbot that uses a pre-trained Llama3-8b model to generate responses to user input. Groq has been used for a near instant inference because of the high token speed, and Google Gen AI Studio API has been used to get the embeddings. The model uses a PDF file for information retrieval based responses.

chatbot genai genai-chatbot groq groq-api llama llama3 llm rag

Last synced: 18 Aug 2026

https://github.com/mishushakov/ai-fun

The LLM-powered function builder for TypeScript

ai artificial-intelligence gpt gpt-4 llama llm openai

Last synced: 18 Aug 2026

https://github.com/nikvoid/cliplm

Ask LLaMa about image in your clipboard

command-line-tool computer-vision llama llama-cpp llava

Last synced: 18 Aug 2026

https://github.com/abdur75648/V-Zen

V-Zen: Efficient GUI Understanding and Precise Grounding With A Novel Multimodal LLM Resources

agi chatgpt gpt grounding-dino gui gui-automation large-language-models llama llm mistral multimodal-large-language-models superagi vicuna

Last synced: 18 Aug 2026

https://github.com/soniawmeyer/WanderChat

A Comparison of LLM Chat Bot Implementation Methods with Travel Use Case

ai-engineering chatbot fine-tuning llama llm-training llms lora machine-learning mistral qlora rag rlhf sjsu travel

Last synced: 18 Aug 2026

https://github.com/SeanLee97/AnglE

Train and Infer Powerful Sentence Embeddings with AnglE | 🔥 SOTA on STS and MTEB Leaderboard

dense-retrieval embeddings information-retrieval llama llama2 llm mteb rag retrieval-augmented-generation semantic-similarity semantic-textual-similarity sentence-embedding sentence-embeddings sentence-vector sts stsbenchmark text-embedding text-similarity text-vector text2vec

Last synced: 18 Aug 2026

https://github.com/Programmercito/bot-microia

Bot MicroIA es un bot inteligente para Telegram, diseñado para ofrecer respuestas dinámicas y contextuales mediante modelos de lenguaje avanzados como LLaMA 2 y LLaMA 3, integrados a través de Ollama. Su arquitectura basada en Java y Spring Boot, junto con una API REST, permite una comunicación fluida y escalable entre el bot y los servicios.

ia inteligencia-artificial java llama llama2 llama3 ollama ollama3 springboot telegram

Last synced: 18 Aug 2026

https://github.com/andrewjc/llama.cpp

Andrew C's branch of LLAMA.CPP - ROCM + x86 optimisations

ai deep-learning ggml llama llms ml rocm

Last synced: 18 Aug 2026

https://github.com/li-plus/chat4u

用微信聊天记录训练一个你专属的聊天机器人

alpaca chatbot llama wechat wechaty

Last synced: 18 Aug 2026

https://github.com/camenduru/text-generation-webui-colab

A colab gradio web UI for running Large Language Models

alpaca colab colab-notebook colaboratory gradio koala lama llama llamas llm vicuna

Last synced: 18 Aug 2026

https://github.com/princeton-nlp/LLM-Shearing

[ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning

efficiency llama llama2 llm nlp pre-training pruning

Last synced: 18 Aug 2026

https://github.com/ad-si/cai

User friendly CLI tool for AI tasks. Stop thinking about LLMs and prompts, start getting results!

ai anthropic chatgpt claude cli gpt gpt-4o gpt-5 groq llama llama3 llamafile llm machine-learning mistral ml ollama openai prompt rust

Last synced: 18 Aug 2026

https://github.com/LastBotInc/llama2j

Pure Java Llama2 inference with optional multi-GPU CUDA implementation

inference inference-engine java llama llama2

Last synced: 18 Aug 2026

https://github.com/ngxson/alpaca.cpp-webui

Web UI for Alpaca.cpp - Locally run an Instruction-Tuned Chat-Style LLM

alpaca chatgpt llama nextjs

Last synced: 18 Aug 2026

https://github.com/aandrew-me/tgpt

AI Chatbots in terminal for free

ai chatbot chatgpt cli go golang gpt4 linux llama macos mixtral terminal windows

Last synced: 18 Aug 2026

https://github.com/horenbergerb/llamagotchi

A bunch of LLaMa model investigations, including recreating generative agents (from the paper Generative Agents: Interactive Simulacra of Human Behavior)

generative-agents langchain llama llamacpp llm machine-learning

Last synced: 18 Aug 2026

https://github.com/dhakalnirajan/LLaMA-BitNet

LLaMA-BitNet is a repository dedicated to empowering users to train their own BitNet models built upon LLaMA 2 model, inspired by the groundbreaking paper 'The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits'.

large-language-models llama llama2 llm llms meta microsoft

Last synced: 18 Aug 2026

https://github.com/BlackwellGPT/Blackwell-GPT-App

BlackwellGPT uses a cloud or on-device large language model (Llama 2) to increase the accessibility of basic medical information even in areas with limited internet connectivity.

llama llm medical medical-assistant ondeviceai

Last synced: 18 Aug 2026

https://github.com/patrickcurl/sanechain

Filling in the missing gaps with langchain, and creating OO wrappers to simplify some workloads.

agent ai artificial-intelligence cohereai gpt gpt3 gpt4 inference-engine langchain language-model llama llama-index llamacpp llm llmops llms openai openai-api

Last synced: 18 Aug 2026

https://github.com/j-f1/LLM-Playground

Play with LLaMA & GPT-3!

gpt-3 llama swift

Last synced: 18 Aug 2026

https://github.com/nrl-ai/CustomChar

Your customized AI assistant - Personal assistants on any hardware! With llama.cpp, whisper.cpp, ggml, LLaMA-v2.

cpp ggml llama llama-cpp llama-v2 llm stt tts whisper-cpp

Last synced: 18 Aug 2026

https://github.com/ariya/tinker-chat

chatbot generative-ai gpt llama llama2 llm mistral nlp openai

Last synced: 18 Aug 2026

https://github.com/cedrickchee/awesome-transformer-nlp

A curated list of NLP resources focused on Transformer networks, attention mechanism, GPT, BERT, ChatGPT, LLMs, and transfer learning.

attention-mechanism awesome awesome-list bert chatgpt gpt-2 gpt-3 gpt-4 language-model llama natural-language-processing neural-networks nlp pre-trained-language-models transfer-learning transformer xlnet

Last synced: 18 Aug 2026

https://github.com/ImPavloh/WhiTTsper-The-Lora

Demo combining Whisper for speech recognition and Google TTS for speech synthesis to interact with Alpaca-LoRA.

ai google-colab gtts llama whisper

Last synced: 18 Aug 2026

https://github.com/MNThomson/chat

chat - platform agnostic "ai" cli

chatgpt cli commands gpt-3 gpt-4 linux llama llm ollama openai productivity shell terminal

Last synced: 18 Aug 2026

https://github.com/harshalbhatia/osh

Oh Sh!t (osh) is a command line tool to use LLMs to help in the terminal

alpaca cli llama openai terminal

Last synced: 18 Aug 2026

https://github.com/ngpepin/aido

Bash scripts for in-line CLI review, editing and execution of Bash commands suggested by an LLM in response to a user's requests for assistance.

assistant-chat-bots bash bash-completion bash-prompt bashrc command-line-tool linux llama llm llm-agent mixtral-8x7b

Last synced: 18 Aug 2026

https://github.com/fbaldassarri/alpaca-cpp-container

Docker image to deploy an alpaca-cpp container with conda-ready environments

alpaca alpaca-cpp docker dockerfile llama python python3

Last synced: 18 Aug 2026

https://github.com/codewithdark-git/llama-3-Hackathon

LLaMA Genius is an AI-powered research assistant designed to help users interact with and extract insights from various sources, including uploaded files and web content.

g4f hackathon llama llama3 python3 streamlit-webapp togetherai

Last synced: 18 Aug 2026

https://github.com/PKU-Alignment/llms-resist-alignment

[ACL2025 Best Paper] Language Models Resist Alignment

ai-safety alignment alpaca llama llama2 llama3 llm llms rlhf safe safe-rlhf vicuna

Last synced: 18 Aug 2026

https://github.com/devbrones/llama-prompts

A collection of prompts for Llama

llama llama-prompts prompt-engineering prompts pyllama

Last synced: 18 Aug 2026

https://github.com/unslothai/unsloth

Local UI to run and train LLMs and diffusion models, including Qwen3.8, Kimi K3, MiniMax-H3, Gemma 4, DeepSeek-V4, FLUX and more.

agent ai chatgpt deepseek fine-tuning gemma image-generation llama llm llms openai python qwen reinforcement-learning self-hosted stable-diffusion text-to-speech tts ui unsloth

Last synced: 19 Aug 2026

https://github.com/ymcui/Chinese-LLaMA-Alpaca-2

中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)

64k alpaca alpaca-2 alpaca2 flash-attention large-language-models llama llama-2 llama2 llm nlp rlhf yarn

Last synced: 18 Aug 2026

https://github.com/horseee/LLM-Pruner

[NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support Llama-3/3.1, Llama-2, LLaMA, BLOOM, Vicuna, Baichuan, TinyLlama, etc.

baichuan bloom chatglm compression language-model llama llama-2 llama3 llm neurips-2023 pruning pruning-algorithms vicuna

Last synced: 18 Aug 2026

https://github.com/b0kch01/llama-cpu

🦙 Inference code for LLaMA models (modified for cpu)

cpu llama meta pytorch

Last synced: 18 Aug 2026

https://github.com/ariya/ask-llm

Interact with any LLM service

cerebras deepinfra deepseek fireworks groq hyperbolic jan lepton llama llm lmstudio localai mistral nebius novita ollama openai openrouter phi together

Last synced: 18 Aug 2026

https://github.com/PKU-Alignment/safe-rlhf

Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback

ai-safety alpaca beaver datasets deepspeed gpt large-language-models llama llm llms reinforcement-learning reinforcement-learning-from-human-feedback rlhf safe-reinforcement-learning safe-reinforcement-learning-from-human-feedback safe-rlhf safety transformer transformers vicuna

Last synced: 18 Aug 2026

https://github.com/rendezqueue/rendezllama

CLI for llama.cpp with various commands to guide, edit, and regenerate tokens on the fly.

ai chatbot large-language-models llama llamacpp llm

Last synced: 18 Aug 2026

https://github.com/cadavidf/sonic-ai

Code. Music. Live.

artificial creativity generation intelligence learning llama machine music

Last synced: 18 Aug 2026

https://github.com/EZForever/llama.cpp-static

Static builds of llama.cpp (Currently AMD64 only)

llama llama-cpp llamacpp localai self-hosted

Last synced: 18 Aug 2026

https://github.com/hiyouga/FastEdit

🩹Editing large language models within 10 seconds⚡

bloom chatbots chatgpt falcon gpt large-language-models llama llms pytorch transformers

Last synced: 18 Aug 2026

https://github.com/daniel-furman/sft-demos

Language modeling sft demos

chatbot deep-learning instruction-tuning llama nlp text-generation transformers

Last synced: 18 Aug 2026

https://github.com/dynaboard/ai-studio

An interactive AI chat system that runs entirely within your Macbook.

ai ai-playground chat llama llm summarizer

Last synced: 18 Aug 2026

https://github.com/DominikLindorfer/pyAlpaca

Instruction-following LLaMA Model Trained with Deepspeed to Output Python-Code from General Instructions

alpaca deepspeed finetuning gpt gpt-3 gpt4 llama llm pyalpaca pytorch stanford-alpaca

Last synced: 18 Aug 2026

https://github.com/xNul/codestral-mamba-for-vscode

Use Codestral Mamba with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.

api assistant code codestral continue continuedev copilot github llama llamacpp local mamba mistral mock studio visual vscode

Last synced: 18 Aug 2026

https://github.com/akanyaani/miniLLAMA

A simplified LLAMA implementation for training and inference tasks.

llama llama-models llama2 llm minillama pytorch simple-llama

Last synced: 18 Aug 2026

https://github.com/zjysteven/mink-plus-plus

[ICLR'25 Spotlight] Min-K%++: Improved baseline for detecting pre-training data of LLMs

iclr2025 llama llm mamba membership-inference-attack pretraining-data-detection pythia

Last synced: 18 Aug 2026

https://github.com/kyegomez/Lets-Verify-Step-by-Step

"Improving Mathematical Reasoning with Process Supervision" by OPENAI

artificial-intelligence finetuning gpt4 gpt4-api gpt4vision llama machine-learning

Last synced: 18 Aug 2026

https://github.com/byroneverson/Mia

A simple swift app for MacOS/iOS to test large language models (LLM)

ai app chatbot gptneox ios learning llama llm machine macos pythia stablelm

Last synced: 18 Aug 2026

https://github.com/lenML/llama2-tokenizer.js

llama2 tokenizer for javascript

chatgpt llama llama2 tokenizer

Last synced: 18 Aug 2026

https://github.com/FuxiaoLiu/VisualNews-Repository

[EMNLP'21] Visual News: Benchmark and Challenges in News Image Captioning

alignment benchmark dataset datasets deep-learning emnlp emnlp2021 event-extraction fake fakenews gpt gpt-4 llama llm multimodal named-entity-recognition news pretraining vision-and-language

Last synced: 18 Aug 2026

https://github.com/Ruu3f/freeGPT-webui

WebUI like ChatGPT powered by freeGPT.

ai artificial-intelligence chatbot chatgpt deep-learning free freegpt gpt gpt4all gpt4free llama machine-learning openai python

Last synced: 18 Aug 2026

https://github.com/mag1art/regression2chatgpt

«Анатомия больших языковых моделей: от линейной регрессии к общему искусственному интеллекту» Вспомогательный код

chatgpt llama

Last synced: 18 Aug 2026

https://github.com/ParthSareen/obsidian-rag

Talk to your Obsidian notes!

langchain llama obsidian obsidian-md ollama python

Last synced: 18 Aug 2026

https://github.com/ANOVAsion/IRIOdashboard

IRIOdashboard — An analytical dashboard for IRIO (Inter-Regional Input Output) table

chatbot clustering data-science export-import gdp generative-ai linkage llama machine-learning macroeconomics multiplier openai python regional-economics

Last synced: 18 Aug 2026

https://github.com/WisconsinAIVision/ViP-LLaVA

[CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts

chatbot clip cvpr2024 foundation-models gpt-4 gpt-4-vision llama llama2 llava multi-modal vision-language visual-prompting

Last synced: 18 Aug 2026

https://github.com/lwch/llama2.go

Port of Facebook's LLaMA 2 model in pure go and use little memory

golang inference llama llama2

Last synced: 18 Aug 2026

https://github.com/alibaba/rtp-llm

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

gpt inference llama llm llm-serving llmops model-serving

Last synced: 18 Aug 2026

https://github.com/NisaarAgharia/Indian-LawyerGPT

Fine-Tuning Falcon-7B, LLAMA 2 with QLoRA to create an advanced AI model with a profound understanding of the Indian legal context.

falcon fine-tuning gpt huggingface-transformers large-language-models llama llama2 llms peft qlora

Last synced: 18 Aug 2026

https://github.com/adalkiran/llama-nuts-and-bolts

A holistic way of understanding how Llama and its components run in practice, with code and detailed documentation.

deep-learning educational-project go golang large-language-models llama llama3-1 machine-learning ml transformers unicode utf-8

Last synced: 18 Aug 2026

https://github.com/asad1996172/LLM-Prompt-Pedia

NextJS web app to create and share prompts for different language models

ai authentication chatgpt javascript llama llm mongodb mongoose nextjs prompts react tailwindcss typescript

Last synced: 18 Aug 2026

https://github.com/wxjiao/ParroT

The ParroT framework to enhance and regulate the Translation Abilities during Chat based on open-sourced LLMs (e.g., LLaMA-7b, Bloomz-7b1-mt) and human written translation and evaluation data.

bloomz chatgpt contrastive error-guided gpt-4 human-feedback instruction-tuning llama lora machine-translation

Last synced: 18 Aug 2026

https://github.com/chatchat-space/Langchain-Chatchat

Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Llama) RAG and Agent app with langchain

chatbot chatchat chatglm chatgpt embedding faiss fastchat gpt knowledge-base langchain langchain-chatglm llama llm milvus ollama qwen rag retrieval-augmented-generation streamlit xinference

Last synced: 19 Aug 2026

https://github.com/curtisgray/chatbot-ui

An open source user experience for AI models.

chatbot chatgpt llama llama2 llamacpp openai openai-api openai-chatgpt

Last synced: 18 Aug 2026

https://github.com/ausboss/Local-LLM-Langchain

Load local LLMs effortlessly in a Jupyter notebook for testing purposes alongside Langchain or other agents. Contains Oobagooga and KoboldAI versions of the langchain notebooks with examples.

agi alpaca autogpt jupyter-notebook koboldai langchain language-model llama llm llms machine-learning

Last synced: 18 Aug 2026

https://github.com/elizabethsiegle/replicate-prompt-to-image-sms

chatbot llama llama2 python replicate sms twilio

Last synced: 18 Aug 2026

https://github.com/elizabethsiegle/replicate-llama2-sms-chatbot

chatbot llama llama2 replicate sms twilio

Last synced: 18 Aug 2026

https://github.com/run-llama/LlamaIndexTS

Data framework for your LLM applications. Focus on server side solution

agent chatbot claude-ai create-llama embedding groq-ai javascript llama llama-index llama3 llamaindex llm node nodejs openai react typescript

Last synced: 18 Aug 2026

https://github.com/hululuzhu/llama-lora-chinese-couplet

llama-lora e2e example to demo a Chinese Couplet AI in 10 mins. some thoughts on high quality chat AI

chinese couplet llama llm lora

Last synced: 18 Aug 2026

https://github.com/Uminosachi/open-llm-webui

This repository contains a web application designed to execute relatively compact, locally-operated Large Language Models (LLMs).

chatbot ggml gradio huggingface language-model llama llama2 llama3 llava llava-llama3 llm nlp transformers

Last synced: 18 Aug 2026

https://github.com/Mrbysco/LLamaPalooza

LlamaPalooza! LlamaPalooza! LlamaPalooza! Yeahh

llama minecraft minecraft-mod neoforge neoforge-mod resource

Last synced: 18 Aug 2026

https://github.com/LlamaChinese/Llama-Chinese

Llama中文社区，实时汇总最新Llama学习资料，构建最好的中文Llama大模型开源生态，完全开源可商用

agent llama llama4 llm pretraining rl

Last synced: 19 Aug 2026

https://github.com/zjunlp/EasyEdit

[ACL 2024] An Easy-to-use Knowledge Editing Framework for LLMs.

artificial-intelligence baichuan chatgpt cknowedit easyedit easyedit2 efficient gpt knowedit knowledge-editing knowlm large-language-models llama mmedit model-editing natural-language-processing safeedit tool trustworthy-ai unlearning

Last synced: 19 Aug 2026

https://github.com/SushritPasupuleti/Jarvis

Using Facebook's Llama to build myself a versatile set of AI-powered tools.

bubbletea fastapi golang grpc langchain leptos llama rust tailwindcss wasm

Last synced: 18 Aug 2026

https://github.com/Esmail-ibraheem/Tinyllamas-pytorch

Tinyllamas🦙 is an Extensible advanced language model framework, inspired by the original Llama model.

attention-mechanism llama llama2 llms paper-implementations pytorch

Last synced: 18 Aug 2026

https://github.com/alvion427/PerroPastor

Run Llama based LLMs in Unity entirely in compute shaders with no dependencies

ai llama llama2 llm ml unity

Last synced: 18 Aug 2026

https://github.com/jackaduma/ChatGLM-LoRA-RLHF-PyTorch

A full pipeline to finetune ChatGLM LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the ChatGLM architecture. Basically ChatGPT but with ChatGLM

chatglm chatglm-6b chatgpt deepspeed finetune gpt llama llm lora peft ppo pytorch reward-models rlhf

Last synced: 18 Aug 2026

https://github.com/oelin/tinyllama

A pedagogical implementation of TinyLlama.

deep-learning education educational language-model llama llama2 machine-learning natural-language-processing

Last synced: 18 Aug 2026

https://github.com/amithkoujalgi/ollama-pdf-bot

A bot that accepts PDF docs and lets you ask questions on it.

bot chat-bot llama llama2 llm ollama pdf pdf-bot

Last synced: 18 Aug 2026

https://github.com/KimRass/transformer_based_models

Study on 'Transformer'-based models

byte-pair-encoding deberta distilbert electra gpt gpt-2 gpt-3 llama masked-language-modeling palm rotary-position-embedding sentence-bert sentencepiece t5 transformer wordpiece xlnet

Last synced: 18 Aug 2026

https://github.com/LEL-A/doc

Overarching documentation and planning to build so-called instruction-following large language models aka "ChatGPT-style" models for the European language area.

alpaca chat english europe german gpt language large-language-models llama llm multilingual nlp

Last synced: 18 Aug 2026

https://github.com/5663015/LLMs_train

一套代码指令微调大模型

baichuan bloom chatglm-6b deepspeed language-model llama llm-training llms lora pythia

Last synced: 18 Aug 2026

https://github.com/samyfodil/taubyte-llama-satellite

ai cloud llama llama2 ollama taubyte webassembly

Last synced: 18 Aug 2026

https://github.com/rtx56/mm2-scripts

mm2 scripts / mm2 scripts

audio blooket disassembler fractals geolocation intranet llama location mfcc nfc podcast qt spotlight telnet vuejs

Last synced: 18 Aug 2026

https://github.com/Orfeous/llamacpp.net

C#/.NET binding of llama.cpp

ai chatbot gpt llama llamacpp llm

Last synced: 18 Aug 2026

https://github.com/guimaraesabrina/explore_open_llms

[📚] Repository dedicated to the study and testing of open-source community LLMs.

databricks dolly llama microsoft openllm phi3

Last synced: 18 Aug 2026

https://github.com/azkadev/llama

LLaMA (Language Learning for Machine Translation) adalah proyek riset yang diprakarsai oleh Facebook AI Research (FAIR) yang bertujuan untuk meningkatkan kualitas terjemahan mesin menggunakan pendekatan yang lebih alami dan berfokus pada bahasa asal.

ai android chatbot chatgpt chatgpt-dart chatgpt-offline chatgpt4 dart flutter indonesia ios linux llama macos windows

Last synced: 18 Aug 2026

https://github.com/capjamesg/autodistill-llama

Use LLaMA to label data for use in training a fine-tuned LLM.

llama llm model-distillation

Last synced: 18 Aug 2026

https://github.com/kaito-project/aikit

🏗️ Fine-tune, build, and deploy open-source LLMs easily!

ai buildkit chatgpt docker fine-tuning finetuning gemma gpt inference kubernetes large-language-models llama llm localllama mistral mixtral nvidia open-llm open-source-llm openai

Last synced: 19 Aug 2026

https://github.com/jackaduma/Alpaca-LoRA-RLHF-PyTorch

A full pipeline to finetune Alpaca LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the Alpaca architecture. Basically ChatGPT but with Alpaca

alpaca chatgpt deepspeed finetune gpt llama llm lora peft ppo pytorch reward-models rlhf