awesome-llama: https://github.com/c0sogi/llama-api
api exllama fastapi llama llamacpp
Score: 5.958424693029782
Last synced: about 5 hours ago
JSON representation
Repository metadata:
An OpenAI-like LLaMA inference API
- Host: GitHub
- URL: https://github.com/c0sogi/llama-api
- Owner: c0sogi
- License: mit
- Created: 2023-07-20T12:57:35.000Z (over 2 years ago)
- Default Branch: master
- Last Pushed: 2023-09-17T16:41:20.000Z (over 2 years ago)
- Last Synced: 2026-01-31T09:55:55.631Z (7 days ago)
- Topics: api, exllama, fastapi, llama, llamacpp
- Language: Python
- Homepage:
- Size: 664 KB
- Stars: 113
- Watchers: 3
- Forks: 9
- Open Issues: 16
-
Metadata Files:
- Readme: readme.md
- License: LICENSE.md
Owner metadata:
- Name:
- Login: c0sogi
- Email:
- Kind: user
- Description: SKKU undergraduate, majoring in Mechanical Engineering
- Website:
- Location: Suwon, South Korea
- Twitter:
- Company:
- Icon url: https://avatars.githubusercontent.com/u/121936784?u=0a1a530ceb4fa338dbc6e5ceb71f545f84842c3c&v=4
- Repositories: 2
- Last Synced at: 2023-03-23T17:34:41.049Z
- Profile URL: https://github.com/c0sogi
GitHub Events
Total
- Issues event: 1
- Watch event: 2
- Total: 3
Last Year
- Issues event: 1
- Total: 1
Committers metadata
Last synced: 9 days ago
Total Commits: 108
Total Committers: 3
Avg Commits per committer: 36.0
Development Distribution Score (DDS): 0.111
Commits in past year: 0
Committers in past year: 0
Avg Commits per committer in past year: 0.0
Development Distribution Score (DDS) in past year: 0.0
| Name | Commits | |
|---|---|---|
| c0sogi | d****s@n****m | 96 |
| c0sogi | a****a@a****a | 6 |
| c0sogi | d****1@i****m | 6 |
Issue and Pull Request metadata
Last synced: 5 months ago
Total issues: 23
Total pull requests: 7
Average time to close issues: 3 days
Average time to close pull requests: about 3 hours
Total issue authors: 12
Total pull request authors: 1
Average comments per issue: 1.39
Average comments per pull request: 0.0
Merged pull request: 7
Bot issues: 0
Bot pull requests: 0
Past year issues: 1
Past year pull requests: 0
Past year average time to close issues: N/A
Past year average time to close pull requests: N/A
Past year issue authors: 1
Past year pull request authors: 0
Past year average comments per issue: 0.0
Past year average comments per pull request: 0
Past year merged pull request: 0
Past year bot issues: 0
Past year bot pull requests: 0
Top Issue Authors
- Dougie777 (9)
- delta-whiplash (2)
- kreolsky (2)
- Samraw003 (1)
- AndreiBlindu (1)
- morgendigital (1)
- Immortalin (1)
- alexellis (1)
- ehartford (1)
- jordandroid (1)
- ashercn97 (1)
- atisharma (1)
Top Pull Request Authors
- c0sogi (7)
Top Issue Labels
Top Pull Request Labels
Dependencies
- fastapi *
- llama_cpp_python *
- ninja ==1.11.1
- numpy *
- orjson *
- psutil *
- safetensors ==0.3.1
- scikit-learn *
- sentencepiece >=0.1.97
- tensorflow >=2.0.0
- tensorflow-hub *
- torch ==2.0.1
- transformers *
- uvicorn *
- actions/checkout v3 composite
- actions/setup-python v2 composite
- nvidia/cuda 11.8.0-devel-ubuntu22.04 build
- cosogi/llama-api latest
- cosogi/llama-api latest
- 127 dependencies
- black ^23.7.0 develop
- flake8 ^6.0.0 develop
- httpx ^0.24.1 develop
- mkdocs ^1.4.3 develop
- mkdocs-material ^9.1.19 develop
- mkdocstrings ^0.22.0 develop
- pytest ^7.4.0 develop
- pytest-asyncio ^0.21.1 develop
- twine ^4.0.2 develop
- cmake >=3.18.0
- diskcache ^5.6.1
- fastapi >=0.100.1
- filelock ^3.12
- ninja ^1.11.1
- numpy ^1.24.3
- orjson ^3.9
- poetry ^1.5.1
- psutil ^5.9
- pydantic ^2.0.0
- pydantic-settings ^2.0.0
- python >=3.8.1,<3.12
- pyyaml ^6.0
- safetensors >=0.3.3
- sentencepiece >=0.1.97
- sse-starlette ^1.6
- tensorflow-hub >=0.14
- tiktoken >=0.4.0
- transformers ^4.31.0
- typing-extensions >=4.6.0
- uvicorn ^0.23