An open API service for producing an overview of a list of open source projects.

awesome-llama: https://github.com/znx-x/arcadia-llm-server

ai bot chat cpp free gpt llama local mistral open-source server

Score: -Infinity

Last synced: about 20 hours ago
JSON representation

Repository metadata:

This repository is an LLM interface based on llama.cpp and allows you to run your own Arcadia LLM server locally in just a few easy-to-follow steps.


Owner metadata:


GitHub Events

Total
Last Year

Committers metadata

Last synced: 26 days ago


Issue and Pull Request metadata

Last synced: over 1 year ago


Dependencies

examples/llava/requirements.txt pypi
  • pillow *
  • torch *
examples/server/bench/requirements.txt pypi
  • matplotlib *
  • requests *
examples/server/tests/requirements.txt pypi
  • aiohttp * test
  • behave * test
  • huggingface_hub * test
  • numpy * test
  • openai * test
  • prometheus-client * test
gguf-py/pyproject.toml pypi
  • pytest ^5.2 develop
  • numpy >=1.17
  • python >=3.8
requirements/requirements-convert-hf-to-gguf.txt pypi
  • einops *
  • torch *
requirements/requirements-convert-llama-ggml-to-gguf.txt pypi
requirements/requirements-convert-lora-to-ggml.txt pypi
  • torch *
requirements/requirements-convert-persimmon-to-gguf.txt pypi
  • torch *
requirements/requirements-convert.txt pypi
  • gguf >=0.1.0
  • numpy *
  • protobuf >=4.21.0,<5.0.0
  • sentencepiece *
  • transformers >=4.35.2,<5.0.0
requirements.txt pypi
Package.swift swiftpm
examples/batched.swift/Package.swift swiftpm