Ecosyste.ms: Summary

https://github.com/Praveen76/Fine-tune-LLAMA-with-QLoRA

This repository showcases the implementation of the QLoRA Method to fine-tune the Llama language model, enabling efficient deployment of lightweight models for various downstream tasks in natural language processing. Explore advanced techniques for enhancing LLMs in practical applications.

finetune-llm large-language-models llama qlora

Last synced: 02 Nov 2026

https://github.com/frost-beta/llama2-high-level-cpp

Inference Llama2 with High-Level C++.

llm

Last synced: 02 Nov 2026

https://github.com/teelinsan/camoscio

Camoscio: An Italian instruction-tuned language model based on LLaMA

italian language-model llama transformers

Last synced: 02 Nov 2026

https://github.com/trzy/llava-cpp-server

LLaVA server (llama.cpp).

llama llama2 llava llm multimodal vision-transformer

Last synced: 02 Nov 2026

https://github.com/icebaker/obsidian-nano-bots

Nano Bots for Obsidian: small, AI-powered bots that can be easily shared as a single file, designed to support multiple providers such as Cohere Command, Google Gemini, Maritaca AI, Mistral AI, Ollama, OpenAI ChatGPT, and others, + function calling.

alpaca chatgpt cohere-ai gemini-ai gemini-pro google-gemini gpt gpt-4 llama llm maritaca-ai mistral nano-bots obsidian obsidian-md obsidian-plugin ollama openai openai-api vicuna

Last synced: 02 Nov 2026

https://github.com/icebaker/vscode-nano-bots

Boost productivity and power your workflow with Nano Bots for Visual Studio Code: small, AI-powered bots that can be easily shared as a single file, designed to support multiple providers such as Cohere Command, Google Gemini, Maritaca AI MariTalk, Mistral AI, Ollama, OpenAI ChatGPT, and others, with support for calling tools (functions).

alpaca chatgpt cohere-ai gemini-ai gemini-pro google-gemini gpt gpt-4 llama llm maritaca-ai mistral-ai nano-bots ollama openai openai-api vicuna visual-studio-code vscode vscode-extension

Last synced: 02 Nov 2026

https://github.com/vySoSerious/llamabian

This repository contains my experiments with building a personal assistant using Python and the Llama 3.1 8B model.

ai artificial-intelligence chatbot experiment llama llama3 personal-assistant

Last synced: 02 Nov 2026

https://github.com/wiktor-k/llama-chat

Implements a simple REPL chat with a locally running instance of Ollama.

llama llm machine-learning ollama ollama-api

Last synced: 02 Nov 2026

https://github.com/madbookhub/llama.dvd

Concise RAG

llama python rag

Last synced: 02 Nov 2026

https://github.com/calcuis/callgg

GGUF caller

callgg gguf llama

Last synced: 02 Nov 2026

https://github.com/s-JoL/Llama3-extend-vocab

A demo of expanding the vocabulary of the Llama3 model, applicable to other vocabularies that use TikToken as well.

llama llama3 llama3-chinese qwen2

Last synced: 02 Nov 2026

https://github.com/Loguru-AI/Loguru-CLI

An interactive commandline interface that brings intelligence to your logs.

ai artificial-intelligence gen-ai generative-ai llama llama3 llm log log-ai log-analysis log-analytics log-intelligence logs-ai logs-intelligence ollama

Last synced: 02 Nov 2026

https://github.com/andrew264/Smol-LM

Language model based on🦙

llm pytorch

Last synced: 02 Nov 2026

https://github.com/laelhalawani/gguf_llama

Wrapper for simplified use of Llama2 GGUF quantized models.

cpu-inference gguf llama llama2 llamacpp quantization

Last synced: 02 Nov 2026

https://github.com/calcuis/gguf-selector

GGUF selector

connector gguf llama selector

Last synced: 02 Nov 2026

https://github.com/aDarkDev/llama3.1-telethon

llama3.1 8B ai on telethon telegram robot without hf token

ai chatbot free-ai llama llama3 llama3-8b ollama telethon

Last synced: 02 Nov 2026

https://github.com/tacheometry/rbxts-llama

TS typings for the Lua Library for Immutable Data (Llama) by Frelerik

immutable llama roblox roblox-ts

Last synced: 02 Nov 2026

https://github.com/galatolofederico/vanilla-llama

Plain pytorch implementation of LLaMA

llama llama-inference-server llama-pytorch

Last synced: 02 Nov 2026

https://github.com/adithya-s-k/CompanionLLM

CompanionLLM - A framework to finetune LLMs to be your own sentient conversational companion

fine-tuning finetuning hacktoberfest hacktoberfest-accepted hacktoberfest2023 huggingface llama llama2 llamacpp llm llm-inference llm-training lora mit-license open-source peft

Last synced: 02 Nov 2026

https://github.com/ggml-org/llama.cpp

LLM inference in C/C++

ggml

Last synced: 02 Nov 2026

https://github.com/belladoreai/llama-tokenizer-js

JS tokenizer for LLaMA 1 and 2

javascript llama llm tokenizer

Last synced: 02 Nov 2026

https://github.com/ExplainableML/in-context-impersonation

[NeurIPS 2023 Spotlight] In-Context Impersonation Reveals Large Language Models' Strengths and Biases

artificial-intelligence bandit chatbot clip in-context-impersonation llama llama2 mmlu neurips-2023 reasoning text-generation

Last synced: 02 Nov 2026

https://github.com/bishwenduk029/anyscale-chat

Vercel AI chatbot with Anyscale endpoints

ai anyscale anyscale-endpoint chatbot code-llama llama llama-70b mistral mistral-7b nextjs react shadcn-ui vercel zephyr

Last synced: 02 Nov 2026

https://github.com/atisharma/chasm

CHAracter State Management - generative interactive fiction

games interactive-fiction llm pi text-adventure

Last synced: 02 Nov 2026

https://github.com/Mobile-Artificial-Intelligence/llama_sdk

lcpp is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)

facebook flutter-ai gemma ggml gguf llama llama2 llamacpp llm llm-inference local-ai meta mistral mixtral mobile-ai

Last synced: 02 Nov 2026

https://github.com/PeeteKeesel/PaperGPT

:microscope: Choose a academic research papers and get a TL;DR for it in seconds.

bart bert computer-vision cv gpt huggingface huggingface-transformers large-language-models llama llm meta openai research-paper text-summarizer

Last synced: 02 Nov 2026

https://github.com/hiyouga/LlamaFactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

agent ai deepseek fine-tuning gemma gpt instruction-tuning large-language-models llama llama3 llm lora moe nlp peft qlora quantization qwen rlhf transformers

Last synced: 02 Nov 2026

https://github.com/HKUNLP/multilingual-transfer

Code for paper ”Language Versatilists vs. Specialists: An Empirical Revisiting on Multilingual Transfer Ability“

bloom llama llms multilingual reasoning transfer

Last synced: 02 Nov 2026

https://github.com/mkopecki/socrates

self-hostable, modular AI assistant server & client focused on performance and UX.

ai assistant gpt gpt-4 llama llama2 llm

Last synced: 02 Nov 2026

https://github.com/EuroLeaps/secllama

SecLlama is a LLM and set of applications specialized for cybersecurity.

cybersecurity llama llm

Last synced: 02 Nov 2026

https://github.com/magicxor/pacos

A telegram bot working as a frontend for koboldcpp

alpaca chatgpt csharp dotnet dotnet7 gpt kobold koboldai llama telegram-bot

Last synced: 02 Nov 2026

https://github.com/wenhaochai/STEVE

[ECCV 2024] STEVE in Minecraft is for See and Think: Embodied Agent in Virtual Environment

computer-vision dataset embodied-agent large-language-models llama minecraft

Last synced: 02 Nov 2026

https://github.com/rakeshkanneeswaran/LuminaIDE_an_AI_Integrated_IDE

A personalized IDE developed from scratch, featuring AI integration with models like LLaMA, Mistral, and LLava. Includes a real-time terminal, intuitive file explorer, and Ace Editor to enhance productivity and streamline coding workflows.

express ide llama llama2 llava mistral react websocket

Last synced: 02 Nov 2026

https://github.com/heisemind/qlora-llama

This project enables fine-tuning using QLoRA for question-answering Llama 2 model.

huggingface llama llama2 lora python

Last synced: 02 Nov 2026

https://github.com/monk1337/NanoPeft

The simplest repository & Neat implementation of different Lora methods for training/fine-tuning Transformer-based models (i.e., BERT, GPTs). [ Research purpose ]

huggingface llama llm lora low-rank-adaptation mistral peft qlora quantization

Last synced: 02 Nov 2026

https://github.com/rbourgeat/ImpAI

😈 ImpAI is an advanced role play app using large language and diffusion models.

ai character-ai chat docker game ggml gguf linux llama llama-cpp llm macos roleplay stable-diffusion windows

Last synced: 02 Nov 2026

https://github.com/JuliusHaring/chatbot-template

A comprehensive chatbot system with integrated LLM querying and Messenger Bot interfacing capabilities. To be used as a template for implementation.

chatbot chatgpt chatgpt-api llama llamaindex telegram telegram-bot vectorstore

Last synced: 02 Nov 2026

https://github.com/ashleykleynhans/textgen-docker

Docker image for the Text Generation Web UI: A Gradio web UI for Large Language Models with support for multiple inference backends.

api docker docker-image gradio llama llama-cpp llm runpod textgen webui

Last synced: 02 Nov 2026

https://github.com/jasonacox/ProtosAI

A Study in Artificial Intelligence - Simple scripts that explore capabilities provided by neural networks (NN), generative pre-trained transformers (GPT) and large language models (LLM).

artifical-intelligense gpt large-language-models llama llamacpp llm neural-network sentiment-analysis speech-recognition summarizer transformer

Last synced: 02 Nov 2026

https://github.com/Lathashree01/ClinicalRE_n2c2

LLaMA based Clinical RE for n2c2 2018 dataset

deep-learning large-language-models llama llama2-7b nlp

Last synced: 02 Nov 2026

https://github.com/janhq/cortex.cpp

Local AI API Platform

gguf llamacpp onnx onnxruntime

Last synced: 02 Nov 2026

https://github.com/BobaZooba/xllm

🦖 X—LLM: Cutting Edge & Easy LLM Finetuning

alpaca bitsandbytes cerebras chatgpt deep-learning deep-neural-networks gpt gpt-4 gptq large-language-models llama llama2 llm mistral openai pytorch torch vicuna zephyr

Last synced: 02 Nov 2026

https://github.com/balisujohn/localpilot

codellama on CPU without Docker

code code-llama codellama llama text-generation-webui vscode vscode-extension vscodium wizardcoder

Last synced: 02 Nov 2026

https://github.com/StarRing2022/ChatGPTX-Uni

实现一种多Lora权值集成切换+Zero-Finetune零微调增强的跨模型技术方案，LLM-Base+LLM-X+Alpaca，初期，LLM-Base为Chatglm6B底座模型，LLM-X是LLAMA增强模型。该方案简易高效，目标是使此类语言模型能够低能耗广泛部署，并最终在小模型的基座上发生“智能涌现”，力图最小计算代价达成ChatGPT、GPT4、ChatRWKV等人类友好亲和效果。当前可以满足总结、提问、问答、摘要、改写、评论、扮演等各种需求。

auto-gpt chatglm-6b chatgpt4 chatrwkv llama lora-fusion spiking-neural-network

Last synced: 02 Nov 2026

https://github.com/yangjianxin1/Firefly-LLaMA2-Chinese

Firefly中文LLaMA-2大模型，支持增量预训练Baichuan2、Llama2、Llama、Falcon、Qwen、Baichuan、InternLM、Bloom等大模型

baichaun2 baichuan baichuan-13b bloom chatglm falcon firefly internlm llama llama-2 llama2 llm lora pretrain qlora qwen xverse

Last synced: 02 Nov 2026

https://github.com/JavaLLM/llama4j

An easy-to-use Java SDK for running LLaMA models on edge devices, powered by LLaMA.cpp

gpt llama llama-cpp llm

Last synced: 02 Nov 2026

https://github.com/open-mmlab/Multimodal-GPT

Multimodal-GPT

flamingo gpt gpt-4 llama multimodal transformer vision-and-language

Last synced: 02 Nov 2026

https://github.com/josStorer/selfhostedAI

A collection of one-click self-hosted AI

chatglm chatgpt llama llm stable-diffusion

Last synced: 02 Nov 2026

https://github.com/Pur-Labs/purgpt.js

Official package for PurGPT.

ai anthropic api chatbot claude gpt image javascript js library llama module node npm ora package purgpt sberbank ts typescript

Last synced: 02 Nov 2026

https://github.com/einzig-diego/LLaMA-CPP-Server-Endpoint-API

Examples of how to call the REST api endpoint of the C++ port of LLaMA by ggerganov. Adjust the JSON to your needs

json json-api llama llamacpp rest-api

Last synced: 02 Nov 2026

https://github.com/minorprojects/Stable-CAT

Stable Causal Attention Transformer(StableCAT) is a tiny, minimal modern LLM architecture for casual Language Modelling suitable for training medium size large language models and built for educational purposes

gpt-2 llama llm nlp nlp-machine-learning stable-cat transformer

Last synced: 02 Nov 2026

https://github.com/mapluisch/LLaVA-WebSocket-Server

Python-based WebSocket for CLI LLaVA inference.

inference llama llama2 llava llm llm-inference python websocket websockets

Last synced: 02 Nov 2026

https://github.com/janelu9/EasyLLM

Running Large Language Model easily.

deepseek deepspeed fine-tuning llama megatron npu pretrain qwen qwen-vl rlhf vllm

Last synced: 02 Nov 2026

https://github.com/atomlayer/llama_cute_voice_assistant

Llama cute voice assistant

assistant llama llama2 oobabooga rvc silero whisper

Last synced: 02 Nov 2026

https://github.com/EvilFreelancer/benchmarking-llms

Comprehensive benchmarks and evaluations of Large Language Models (LLMs) with a focus on hardware usage, generation speed, and memory requirements.

benchmark llama llm mgpt mpt rugpt

Last synced: 02 Nov 2026

https://github.com/adithyab94/Attiri

Attiri: An Instruction-following LLaMa and Alpaca model for Tamil

ai llama llm nlp tamil

Last synced: 02 Nov 2026

https://github.com/Cxmrykk/Wilt-CLI

CLI for Petals (Petals Chat WebSocket API)

bloom chatbot cli gpt language-models large-language-models linux llama machine-learning petals terminal-app

Last synced: 02 Nov 2026

https://github.com/PaddlePaddle/PaddleNLP

Easy-to-use and powerful LLM and SLM library with awesome model zoo.

bert compression distributed-training document-intelligence embedding ernie information-extraction llama llm neural-search nlp paddlenlp pretrained-models question-answering search-engine semantic-analysis sentiment-analysis transformers uie

Last synced: 02 Nov 2026

https://github.com/jankais3r/LLaMA_MPS

Run LLaMA (and Stanford-Alpaca) inference on Apple Silicon GPUs.

alpaca apple-silicon chat chatbot chatgpt llama llms macos metal ml mps stanford-alpaca torch

Last synced: 02 Nov 2026

https://github.com/longday1102/VietAI-experiment-LLaMA-2

⚡ LLaMA-2 model experiment

llama llama2

Last synced: 02 Nov 2026

https://github.com/fcoagz/pycisco

Pycisco es un bot de Telegram que te permite comunicarte con una inteligencia artificial. Utiliza herramientas de lenguaje natural para analizar y responder a tus mensajes.

chatbot chatbot-telegram chatgpt chatgpt-free falcon gpt-35-turbo language-model llama python

Last synced: 02 Nov 2026

https://github.com/rozek/node-red-flow-openai-api

Node-RED Flows for OpenAI API compatible endpoints calling llama.cpp

llama llamacpp node-red node-red-flow openai openai-api

Last synced: 02 Nov 2026

https://github.com/ghost-x-ai/ghost-8b-beta

Ghost 8B Beta is a large language model developed with goals that include excellent multilingual support, superior knowledge capabilities, and cost-effectiveness. The model comes in two context length versions, 8k and 128k, along with multilingual function tools support by default.

ai ghost llama llama3 llm multilingual

Last synced: 02 Nov 2026

https://github.com/adithya-s-k/LLM-InferenceNet

LLM InferenceNet is a C++ project designed to facilitate fast and efficient inference from Large Language Models (LLMs) using a client-server architecture. It enables optimized interactions with pre-trained language models, making deployment on edge devices easier.

cpp llama llamacpp llm

Last synced: 02 Nov 2026

https://github.com/godsofcrypto/chat-llama-bot

alpaca bot chat chat-bot chatgpt chatllama cryptominer gpt-4 gpt4 large-language-model large-language-models llama llamacpp mining-software software-tools text-generation-webui vicuna

Last synced: 02 Nov 2026

https://github.com/remixer-dec/llama-mps

Experimental fork of Facebooks LLaMa model which runs it with GPU acceleration on Apple Silicon M1/M2

llama llm macos mps

Last synced: 02 Nov 2026

https://github.com/NVIDIA/nim-anywhere

Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench

genai langchain lcel llama llama3 llm nim nvidia nvwb-project rag

Last synced: 02 Nov 2026

https://github.com/hopperrr/amethyst_13b_mistral

A Google Colab running the Amethyst Mistral 13b LLM

amethyst llama llm mistral mistralai

Last synced: 02 Nov 2026

https://github.com/X-rayLaser/DistributedLLM

Run LLM inference by spliting models into parts and hosting each part on a separate machine. Project is no longer maintained.

artificial-intelligence deep-learning large-language-models llama llamacpp machine-learning neural-networks nlp

Last synced: 02 Nov 2026

https://github.com/RichardScottOZ/k2

Code and datasets for paper "Learning A Foundation Language Model for Geoscience Knowledge Understanding and Utilization"

geoscience llama llm nlp

Last synced: 02 Nov 2026

https://github.com/JFab00/Desktop-Llama

csharp desktop-app llama

Last synced: 02 Nov 2026

https://github.com/langroid/langroid

Harness LLMs with Multi-Agent Programming

agents ai chatgpt function-calling gpt gpt-4 gpt4 information-retrieval language-model llama llm llm-agent llm-framework local-llm multi-agent-systems openai-api rag retrieval-augmented-generation

Last synced: 02 Nov 2026

https://github.com/calhounpaul/LLaMA-PEFT-LoRa-subreddit-chatbot-colab

Parameter Efficient Fine Tuning (PEFT) to create a chatbot from Facebook's LLaMA Large Language Model (LLM) on a public corpus (subreddit submissions and comments rearranged as chats).

chatbot huggingface-transformers llama peft reddit

Last synced: 02 Nov 2026

https://github.com/themaximalist/llm.js

Universal LLM Interface

anthropic google groq large-language-models llm ollama openai xai

Last synced: 02 Nov 2026

https://github.com/mkellerman/gpt4all-ui

Simple Docker Compose to load gpt4all (Llama.cpp) as an API and chatbot-ui for the web interface. This mimics OpenAI's ChatGPT but as a local instance (offline).

api gpt4all llama python ui web

Last synced: 02 Nov 2026

https://github.com/henomis/alpaca-go

Port of alpaca.cpp in Golang with embedded C/C++

ai alpaca go llama llm

Last synced: 02 Nov 2026

https://github.com/clarkmcc/chitchat

A simple LLM chat front-end that makes it easy to find, download, and mess around with models on your local machine.

gpu llama llm rust tauri

Last synced: 02 Nov 2026

https://github.com/pwwang/pxGPT

pxGPT: Your personal, powerful and private GPT

gpt-3 gpt4all llama llama2 llm openai

Last synced: 02 Nov 2026

https://github.com/wafflecomposite/langchain-ask-pdf-local

An AI-app that allows you to upload a PDF and ask questions about it. It uses StableVicuna 13B and runs locally.

langchain llama llamacpp llm self-hosted stablevicuna

Last synced: 02 Nov 2026

https://github.com/leehanchung/SMILE-factory

Finetune Falcon, LLaMA, MPT, and RedPajama on consumer hardware using PEFT LoRA

agi falcon gpt llama llm lora mpt nlp redpajama

Last synced: 02 Nov 2026

https://github.com/curtisgray/wingman

Wingman is the fastest and easiest way to run Llama models on your PC or Mac.

ai chatbot chatgpt download downloader gpu gpu-acceleration gpu-monitoring inference inference-engine inference-server linux llama llamacpp llm local macos openai windows

Last synced: 02 Nov 2026

https://github.com/mukel/llama3.java

Llama 3+ inference in pure Java

chatgpt genai gguf huggingface java llama llama3 llamacpp llm llm-inference llms openai simd transformers

Last synced: 02 Nov 2026

https://github.com/AlenVelocity/langchain-llama

Run LLAMA LLMs in Node with Langchain

ai llama vicuna

Last synced: 02 Nov 2026

https://github.com/rabilrbl/llamafile-builder

A simple github actions script to build a llamafile and uploads to huggingface

llama llama2 llamacpp llamafile llamafile-builder llamafile-server

Last synced: 02 Nov 2026

https://github.com/spv420/llama_tui

wip tui for chatting with llama.cpp models

alpaca gpt3 gpt4 gum llama llamacpp python vicuna

Last synced: 02 Nov 2026

https://github.com/ziwang-com/AGI-MAP

AGI模块库架构图

agi aigc autogpt automl babyagi gpt gpt4 langchain llama llama2 openai

Last synced: 02 Nov 2026

https://github.com/anakin87/llama2-haystack

Using Llama2 with Haystack, the NLP/LLM framework.

haystack large-language-models llama llm nlp

Last synced: 02 Nov 2026

https://github.com/alex000kim/ML-Pipeline-With-DVC-SkyPilot-HuggingFace

data-science dvc large-language-models llama llama2 llm machine-learning mlops natural-language-processing skypilot

Last synced: 02 Nov 2026

https://github.com/pritamgouda11/Retrieval-Augmented-Generation

This project is an implementation of Retrieval-Augmented Generation (RAG) using Streamlit. It integrates various document loaders and NLP models to allow users to upload documents, process them into text chunks, and create vector stores for efficient retrieval.

cohere documentprocessing llama nlp openai rag streamlit

Last synced: 02 Nov 2026

https://github.com/mounta11n/VowelReconstruct

An easy to use and understand method for the average user to test various aspects of intelligence of your LLM in only one run.

guanaco linguistics llama llamacpp llm

Last synced: 02 Nov 2026

https://github.com/ashleykleynhans/llava-docker

Docker image for LLaVA: Large Language and Vision Assistant

ai chatbot chatgpt docker docker-image foundation-models gpt-4 instruction-tuning llama llama-2 llama2 llava llm multimodal runpod vision-language-model visual-language-learning

Last synced: 02 Nov 2026

https://github.com/maxi-w/llama2-chat-interface

Gradio Chat Interface for Llama 2

gradio llama llama2 llm

Last synced: 02 Nov 2026

https://github.com/usesecond/aigate

Universal gateway for Generative AI providers (WIP)

ai anthropic inference llama llm machine-learning meta openai replicate

Last synced: 02 Nov 2026

https://github.com/fshnkarimi/Similar-Paper-Reccomendation

This repository contains an application designed to recommend scientific papers that are most similar to a given input paragraph. The application uses the llama and weaviate libraries to achieve this.

data-indexing gpt large-language-models llama llm python streamlit vector-database weaviate

Last synced: 02 Nov 2026