An open API service for producing an overview of a list of open source projects.

awesome-llama: https://github.com/fcn94/llm_stream_endpoint

api candle cpu cuda cuda-kernels endpoint llama2 llm llm-server mistral-7b phi-2 quantized rest rest-api rust streaming

Score: 1.3862943611198906

Last synced: about 18 hours ago
JSON representation

Repository metadata:

Simple LLM Rest API using Rust, Warp and Candle. Dedicated for quantized version of either phi-2 ( default) , Mistral, or Llama. Work using CPU or CUDA


Owner metadata:


GitHub Events

Total
Last Year

Committers metadata

Last synced: 15 days ago

Total Commits: 51
Total Committers: 1
Avg Commits per committer: 51.0
Development Distribution Score (DDS): 0.0

Commits in past year: 0
Committers in past year: 0
Avg Commits per committer in past year: 0.0
Development Distribution Score (DDS) in past year: 0.0

Name Email Commits
fcn94 f****t@g****m 51

Issue and Pull Request metadata

Last synced: 5 months ago

Total issues: 0
Total pull requests: 0
Average time to close issues: N/A
Average time to close pull requests: N/A
Total issue authors: 0
Total pull request authors: 0
Average comments per issue: 0
Average comments per pull request: 0
Merged pull request: 0
Bot issues: 0
Bot pull requests: 0

Past year issues: 0
Past year pull requests: 0
Past year average time to close issues: N/A
Past year average time to close pull requests: N/A
Past year issue authors: 0
Past year pull request authors: 0
Past year average comments per issue: 0
Past year average comments per pull request: 0
Past year merged pull request: 0
Past year bot issues: 0
Past year bot pull requests: 0

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/fcn94/llm_stream_endpoint

Top Issue Authors

Top Pull Request Authors


Top Issue Labels

Top Pull Request Labels


Dependencies

Cargo.toml cargo