Data

Tools

Indexes

Applications

Experiments

Summary

An open API service for producing an overview of a list of open source projects.

awesome-llama: https://github.com/predibase/lorax

fine-tuning gpt llama llm llm-inference llm-serving llmops lora model-serving pytorch transformers

Score: 20.628871011077816

Last synced: about 6 hours ago
JSON representation

Repository metadata:

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

Owner metadata:

GitHub Events

Total
Last Year

Committers metadata

Last synced: about 2 months ago

Total Commits: 899
Total Committers: 65
Avg Commits per committer: 13.831
Development Distribution Score (DDS): 0.702

Commits in past year: 37
Committers in past year: 10
Avg Commits per committer in past year: 3.7
Development Distribution Score (DDS) in past year: 0.757

Name Email Commits
OlivierDehaene o****r@h****o 268
Travis Addair t****r@g****m 224
Magdy Saleh 1****h 94
Geoffrey Angus g****y@p****m 43
Nicolas Patry p****s@p****m 42
Noah Yoshida n****7@g****m 38
Ajinkya Tejankar t****a@g****m 27
Florian Zimmermeister f****z@g****m 21
Jeffrey Tang 8****g 20
Arnav Garg 1****1 14
Nick Hill n****l@u****m 13
Joseph Barker 1****e 7
Timothy 7****t 7
abidwael 1****l 5
LS t****l 5
Gyanesh Mishra 1****a 4
Seongjin Lee l****9@n****m 4
wvaneaton 6****n 4
Antoni Baum a****m@p****m 3
Nguyen Huy Tuong 5****1 2
Jonas Schroeder 3****2 2
dependabot[bot] 4****] 2
Ikko Eltociear Ashimine e****r@g****m 2
Claudio Montanari c****5@g****m 2
Alex Sherstinsky a****y 2
lewtun l****l@g****m 2
llama-shepard 1****d 2
regisss 1****s 2
ssmi153 1****3 2
Abhinav Singh a****h@g****m 1
and 35 more...

Issue and Pull Request metadata

Last synced: about 2 months ago

Total issues: 231
Total pull requests: 627
Average time to close issues: 14 days
Average time to close pull requests: 3 days
Total issue authors: 114
Total pull request authors: 45
Average comments per issue: 1.66
Average comments per pull request: 0.33
Merged pull request: 503
Bot issues: 0
Bot pull requests: 6

Past year issues: 16
Past year pull requests: 104
Past year average time to close issues: about 6 hours
Past year average time to close pull requests: 3 days
Past year issue authors: 14
Past year pull request authors: 13
Past year average comments per issue: 0.19
Past year average comments per pull request: 0.13
Past year merged pull request: 80
Past year bot issues: 0
Past year bot pull requests: 4

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/predibase/lorax

Top Issue Authors

  • tgaddair (38)
  • thincal (13)
  • prd-tuong-nguyen (12)
  • flozi00 (8)
  • noyoshi (7)
  • abhibst (5)
  • magdyksaleh (5)
  • GirinMan (4)
  • sleepwalker2017 (3)
  • KrisWongz (3)
  • mrcchef (3)
  • oscarjohansson94 (3)
  • codybum (3)
  • hayleyhu (3)
  • joaopcm1996 (3)

Top Pull Request Authors

  • tgaddair (203)
  • magdyksaleh (117)
  • noyoshi (63)
  • ajtejankar (58)
  • jeffreyftang (25)
  • flozi00 (22)
  • arnavgarg1 (20)
  • joseph-predibase (16)
  • Infernaught (10)
  • wvaneaton (8)
  • thincal (8)
  • geoffreyangus (7)
  • dependabot[bot] (6)
  • GirinMan (5)
  • alexsherstinsky (5)

Top Issue Labels

  • enhancement (46)
  • bug (30)
  • good first issue (15)
  • question (12)
  • documentation (4)

Top Pull Request Labels

  • dependencies (6)
  • python (6)

Package metadata

proxy.golang.org: github.com/predibase/lorax

  • Homepage:
  • Documentation: https://pkg.go.dev/github.com/predibase/lorax#section-documentation
  • Licenses: apache-2.0
  • Latest release: v0.12.1 (published about 1 year ago)
  • Last Synced: 2025-12-22T04:19:40.377Z (about 2 months ago)
  • Versions: 19
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Rankings:
    • Dependent packages count: 6.528%
    • Average: 6.747%
    • Dependent repos count: 6.966%
pypi.org: lorax-client

LoRAX Python Client

  • Homepage: https://github.com/predibase/lorax
  • Documentation: https://lorax-client.readthedocs.io/
  • Licenses: Apache-2.0
  • Latest release: 0.6.3 (published over 1 year ago)
  • Last Synced: 2025-12-22T04:19:07.836Z (about 2 months ago)
  • Versions: 13
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 3,739 Last month
  • Rankings:
    • Dependent packages count: 9.973%
    • Average: 38.803%
    • Dependent repos count: 67.634%
  • Maintainers (2)

Dependencies

.github/workflows/build.yaml actions
  • actions/checkout v3 composite
  • docker/build-push-action v2 composite
  • docker/login-action v1 composite
.github/workflows/client-tests.yaml actions
  • actions/checkout v2 composite
  • actions/setup-python v1 composite
.github/workflows/load_test.yaml actions
  • actions/checkout v3 composite
  • aws-actions/configure-aws-credentials v1 composite
  • philschmid/philschmid-ec2-github-runner main composite
.github/workflows/tests.yaml actions
  • actions-rs/toolchain v1 composite
  • actions/cache v3 composite
  • actions/checkout v2 composite
  • actions/github-script v6 composite
  • actions/setup-python v1 composite
  • arduino/setup-protoc v1 composite
Cargo.lock cargo
  • 382 dependencies
Cargo.toml cargo
launcher/Cargo.toml cargo
  • float_eq 1.0.1 development
  • reqwest 0.11.14 development
  • clap 4.1.4
  • ctrlc 3.2.5
  • nix 0.26.2
  • serde 1.0.152
  • serde_json 1.0.93
  • tracing 0.1.37
  • tracing-subscriber 0.3.16
router/Cargo.toml cargo
router/client/Cargo.toml cargo
router/grpc-metadata/Cargo.toml cargo
Dockerfile docker
  • base latest build
  • chef latest build
  • debian bullseye-slim build
  • kernel-builder latest build
  • lukemathwalker/cargo-chef latest-rust-1.70 build
  • nvidia/cuda 11.8.0-base-ubuntu20.04 build
  • pytorch-install latest build
clients/python/poetry.lock pypi
  • atomicwrites 1.4.1 develop
  • coverage 7.2.1 develop
  • iniconfig 2.0.0 develop
  • pluggy 1.0.0 develop
  • py 1.11.0 develop
  • pytest 6.2.5 develop
  • pytest-asyncio 0.17.2 develop
  • pytest-cov 3.0.0 develop
  • toml 0.10.2 develop
  • tomli 2.0.1 develop
  • PyYAML 6.0
  • aiohttp 3.8.4
  • aiosignal 1.3.1
  • async-timeout 4.0.2
  • asynctest 0.13.0
  • attrs 22.2.0
  • certifi 2022.12.7
  • charset-normalizer 3.1.0
  • colorama 0.4.6
  • filelock 3.10.0
  • frozenlist 1.3.3
  • huggingface-hub 0.13.2
  • idna 3.4
  • importlib-metadata 6.0.0
  • multidict 6.0.4
  • packaging 23.0
  • pydantic 1.10.6
  • requests 2.28.2
  • tqdm 4.65.0
  • typing-extensions 4.5.0
  • urllib3 1.26.15
  • yarl 1.8.2
  • zipp 3.15.0
clients/python/pyproject.toml pypi
  • pytest ^6.2.5 develop
  • pytest-asyncio ^0.17.2 develop
  • pytest-cov ^3.0.0 develop
  • aiohttp ^3.8
  • huggingface-hub >= 0.12, < 1.0
  • pydantic ^1.10
  • python ^3.7
integration-tests/requirements.txt pypi
  • docker * test
  • lorax * test
  • pytest * test
  • pytest-asyncio ==0.17.2 test
  • syrupy * test
server/custom_kernels/setup.py pypi
server/exllama_kernels/setup.py pypi
server/poetry.lock pypi
  • accelerate 0.19.0
  • aiohttp 3.8.6
  • aiosignal 1.3.1
  • async-timeout 4.0.3
  • attrs 23.1.0
  • backoff 2.2.1
  • bitsandbytes 0.41.1
  • certifi 2023.7.22
  • charset-normalizer 3.3.0
  • click 8.1.7
  • colorama 0.4.6
  • datasets 2.14.4
  • deprecated 1.2.14
  • dill 0.3.7
  • einops 0.6.1
  • exceptiongroup 1.1.3
  • filelock 3.12.4
  • frozenlist 1.4.0
  • fsspec 2023.9.2
  • googleapis-common-protos 1.61.0
  • grpc-interceptor 0.15.3
  • grpcio 1.59.0
  • grpcio-reflection 1.59.0
  • grpcio-status 1.59.0
  • grpcio-tools 1.59.0
  • hf-transfer 0.1.3
  • huggingface-hub 0.14.1
  • idna 3.4
  • iniconfig 2.0.0
  • jinja2 3.1.2
  • loguru 0.6.0
  • markupsafe 2.1.3
  • mpmath 1.3.0
  • multidict 6.0.4
  • multiprocess 0.70.15
  • networkx 3.1
  • numpy 1.25.2
  • opentelemetry-api 1.15.0
  • opentelemetry-exporter-otlp 1.15.0
  • opentelemetry-exporter-otlp-proto-grpc 1.15.0
  • opentelemetry-exporter-otlp-proto-http 1.15.0
  • opentelemetry-instrumentation 0.36b0
  • opentelemetry-instrumentation-grpc 0.36b0
  • opentelemetry-proto 1.15.0
  • opentelemetry-sdk 1.15.0
  • opentelemetry-semantic-conventions 0.36b0
  • packaging 23.2
  • pandas 2.1.0
  • pandas 2.1.1
  • pluggy 1.3.0
  • protobuf 4.24.4
  • psutil 5.9.6
  • pyarrow 13.0.0
  • pytest 7.4.2
  • python-dateutil 2.8.2
  • pytz 2023.3.post1
  • pyyaml 6.0.1
  • regex 2023.10.3
  • requests 2.31.0
  • safetensors 0.3.1
  • scipy 1.9.3
  • sentencepiece 0.1.99
  • setuptools 68.2.2
  • six 1.16.0
  • sympy 1.12
  • texttable 1.7.0
  • tokenizers 0.13.3
  • tomli 2.0.1
  • torch 2.1.0
  • tqdm 4.66.1
  • transformers 4.29.2
  • typer 0.6.1
  • typing-extensions 4.8.0
  • tzdata 2023.3
  • urllib3 2.0.7
  • win32-setctime 1.1.0
  • wrapt 1.15.0
  • xxhash 3.4.1
  • yarl 1.9.2
server/pyproject.toml pypi
  • accelerate ^0.19.0
  • bitsandbytes ^0.41.1
  • datasets ^2.14.0
  • einops ^0.6.1
  • grpc-interceptor ^0.15.0
  • grpcio ^1.51.1
  • grpcio-reflection ^1.51.1
  • grpcio-status ^1.51.1
  • hf-transfer ^0.1.2
  • huggingface-hub ^0.14.1
  • loguru ^0.6.0
  • opentelemetry-api ^1.15.0
  • opentelemetry-exporter-otlp ^1.15.0
  • opentelemetry-instrumentation-grpc ^0.42b0
  • protobuf ^4.21.7
  • python ^3.9
  • safetensors 0.3.1
  • scipy ^1.0.0
  • sentencepiece ^0.1.97
  • texttable ^1.6.7
  • tokenizers 0.13.3
  • transformers 4.29.2
  • typer ^0.6.1
server/requirements.txt pypi
  • accelerate ==0.19.0
  • aiohttp ==3.8.5
  • aiosignal ==1.3.1
  • async-timeout ==4.0.2
  • attrs ==23.1.0
  • backoff ==2.2.1
  • bitsandbytes ==0.41.1
  • boto3 ==1.28.34
  • certifi ==2023.5.7
  • charset-normalizer ==3.1.0
  • click ==8.1.3
  • colorama ==0.4.6
  • datasets ==2.14.0
  • deprecated ==1.2.14
  • dill ==0.3.7
  • einops ==0.6.1
  • filelock ==3.12.2
  • frozenlist ==1.4.0
  • fsspec ==2023.6.0
  • googleapis-common-protos ==1.59.1
  • grpc-interceptor ==0.15.2
  • grpcio ==1.56.0
  • grpcio-reflection ==1.56.0
  • grpcio-status ==1.56.0
  • hf-transfer ==0.1.3
  • huggingface-hub ==0.14.1
  • idna ==3.4
  • jinja2 ==3.1.2
  • loguru ==0.6.0
  • markupsafe ==2.1.3
  • mpmath ==1.3.0
  • multidict ==6.0.4
  • multiprocess ==0.70.15
  • networkx ==3.1
  • numpy ==1.25.0
  • opentelemetry-api ==1.15.0
  • opentelemetry-exporter-otlp ==1.15.0
  • opentelemetry-exporter-otlp-proto-grpc ==1.15.0
  • opentelemetry-exporter-otlp-proto-http ==1.15.0
  • opentelemetry-instrumentation ==0.36b0
  • opentelemetry-instrumentation-grpc ==0.36b0
  • opentelemetry-proto ==1.15.0
  • opentelemetry-sdk ==1.15.0
  • opentelemetry-semantic-conventions ==0.36b0
  • packaging ==23.1
  • pandas ==2.0.3
  • peft ==0.4.0
  • protobuf ==4.23.3
  • psutil ==5.9.5
  • pyarrow ==12.0.1
  • python-dateutil ==2.8.2
  • pytz ==2023.3
  • pyyaml ==6.0
  • regex ==2023.6.3
  • requests ==2.31.0
  • safetensors ==0.3.1
  • scipy *
  • sentencepiece ==0.1.99
  • setuptools ==68.0.0
  • six ==1.16.0
  • sympy ==1.12
  • texttable ==1.6.7
  • tokenizers ==0.13.3
  • torch ==2.0.1
  • tqdm ==4.65.0
  • transformers ==4.29.2
  • typer ==0.6.1
  • typing-extensions ==4.7.1
  • tzdata ==2023.3
  • urllib3 ==1.26.12
  • win32-setctime ==1.1.0
  • wrapt ==1.15.0
  • xxhash ==3.2.0
  • yarl ==1.9.2
.github/workflows/release_charts.yaml actions
  • actions/checkout v3 composite
  • azure/setup-helm v3.5 composite
  • helm/chart-releaser-action v1.5.0 composite