An open API service for producing an overview of a list of open source projects.

awesome-llama: https://github.com/LLM-Semantic-Router/vllm-router

huggingface kubernetes llama2 llm llm-inference vllm

Score: 5.0875963352323845

Last synced: about 23 hours ago
JSON representation

Repository metadata:

vLLM Router


Owner metadata:


GitHub Events

Total
Last Year

Committers metadata

Last synced: 5 months ago

Total Commits: 22
Total Committers: 3
Avg Commits per committer: 7.333
Development Distribution Score (DDS): 0.455

Commits in past year: 0
Committers in past year: 0
Avg Commits per committer in past year: 0.0
Development Distribution Score (DDS) in past year: 0.0

Name Email Commits
Huamin Chen h****n@r****m 12
BO WEN b****n@u****m 9
Chen Wang C****1@i****m 1

Dependencies

Dockerfile docker
  • python 3.10-slim build
requirements.txt pypi
  • fastapi *
  • httpx *
  • kubernetes *
  • uvicorn *