awesome-llama: https://github.com/toverainc/willow-inference-server
cuda deep-learning llama llm privacy speech-recognition speech-to-text text-to-speech vicuna webrtc whisper willow
Score: 8.470101583882387
Last synced: about 19 hours ago
JSON representation
Repository metadata:
Open source, local, and self-hosted highly optimized language inference server supporting ASR/STT, TTS, and LLM across WebRTC, REST, and WS
- Host: GitHub
- URL: https://github.com/toverainc/willow-inference-server
- Owner: toverainc
- License: apache-2.0
- Created: 2023-02-03T22:07:46.000Z (about 3 years ago)
- Default Branch: main
- Last Pushed: 2025-06-25T21:53:23.000Z (8 months ago)
- Last Synced: 2026-02-01T08:54:10.891Z (9 days ago)
- Topics: cuda, deep-learning, llama, llm, privacy, speech-recognition, speech-to-text, text-to-speech, vicuna, webrtc, whisper, willow
- Language: Python
- Homepage:
- Size: 3.3 MB
- Stars: 488
- Watchers: 17
- Forks: 55
- Open Issues: 42
-
Metadata Files:
- Readme: README.md
- License: LICENSE.md
Owner metadata:
- Name: Tovera
- Login: toverainc
- Email: team@tovera.com
- Kind: organization
- Description:
- Website: http://www.tovera.com
- Location:
- Twitter: toverainc
- Company:
- Icon url: https://avatars.githubusercontent.com/u/84786158?v=4
- Repositories: 18
- Last Synced at: 2024-05-14T00:19:07.493Z
- Profile URL: https://github.com/toverainc
GitHub Events
Total
- Fork event: 17
- Issue comment event: 19
- Issues event: 3
- Pull request event: 4
- Push event: 3
- Watch event: 94
- Total: 140
Last Year
- Fork event: 10
- Issue comment event: 4
- Issues event: 1
- Pull request event: 4
- Push event: 3
- Watch event: 61
- Total: 83
Committers metadata
Last synced: 16 days ago
Total Commits: 422
Total Committers: 9
Avg Commits per committer: 46.889
Development Distribution Score (DDS): 0.13
Commits in past year: 0
Committers in past year: 0
Avg Commits per committer in past year: 0.0
Development Distribution Score (DDS) in past year: 0.0
| Name | Commits | |
|---|---|---|
| Kristian Kielhofner | k****s@t****m | 367 |
| freethenation | r****r@y****m | 16 |
| Stijn Tintel | s****n@l****e | 15 |
| freethenation | f****n@d****o | 11 |
| Eric Swanson | e****n@a****m | 6 |
| Richard Klafter | r****d@j****m | 4 |
| nikito | n****b@g****m | 1 |
| lon | l****n@r****g | 1 |
| freethenation | f****n@x****n | 1 |
Issue and Pull Request metadata
Last synced: about 2 months ago
Total issues: 77
Total pull requests: 34
Average time to close issues: about 1 month
Average time to close pull requests: about 1 month
Total issue authors: 30
Total pull request authors: 9
Average comments per issue: 3.38
Average comments per pull request: 0.62
Merged pull request: 24
Bot issues: 0
Bot pull requests: 0
Past year issues: 2
Past year pull requests: 2
Past year average time to close issues: about 1 hour
Past year average time to close pull requests: about 2 months
Past year issue authors: 2
Past year pull request authors: 1
Past year average comments per issue: 0.5
Past year average comments per pull request: 0.0
Past year merged pull request: 0
Past year bot issues: 0
Past year bot pull requests: 0
Top Issue Authors
- kristiankielhofner (37)
- nikito (4)
- bert269 (4)
- obones (2)
- smithfred (2)
- ceinstaller (2)
- skorokithakis (2)
- guarddog13 (2)
- the-mentor (1)
- NickJLange (1)
- happenpappen (1)
- lordratner (1)
- ccsmart (1)
- fromeijn (1)
- lachesis (1)
Top Pull Request Authors
- richardklafter (13)
- kristiankielhofner (7)
- lachesis (5)
- stintel (3)
- happenpappen (2)
- nikito (1)
- jstrot (1)
- NickJLange (1)
- longregen (1)
Top Issue Labels
Top Pull Request Labels
Dependencies
- actions/checkout v3 composite
- py-actions/flake8 v2 composite
- nvcr.io/nvidia/tensorrt 22.12-py3 build
- ${IMAGE} ${TAG}
- nginx 1.25.0
- ${IMAGE} ${TAG}
- nginx 1.25.0
- GitPython ==3.1.32
- HyperPyYAML ==1.2.1
- Jinja2 ==3.1.2
- Mako ==1.2.4
- MarkupSafe ==2.1.1
- Pillow ==9.3.0
- PyYAML ==6.0
- Pygments ==2.15.1
- accelerate ==0.21.0
- aiofiles ==23.1.0
- aiohttp ==3.8.5
- aioice ==0.9.0
- aiortc ==1.5.0
- aiosignal ==1.3.1
- altair ==5.0.1
- anyio ==3.7.0
- appdirs ==1.4.4
- async-timeout ==4.0.2
- attrs ==23.1.0
- audioread ==3.0.0
- av ==10.0.0
- certifi ==2023.7.22
- cffi ==1.15.1
- charset-normalizer ==2.1.1
- click ==8.1.3
- cmake ==3.25.0
- colorlog ==6.7.0
- contourpy ==1.1.0
- cryptography ==41.0.2
- ctranslate2 ==3.19.0
- cycler ==0.11.0
- datasets ==2.13.0
- decorator ==5.1.1
- dill ==0.3.6
- dnspython ==2.3.0
- docker-pycreds ==0.4.0
- docopt ==0.6.2
- email-validator ==2.0.0.post2
- entrypoints ==0.4
- exceptiongroup ==1.1.1
- fastapi ==0.97.0
- ffmpy ==0.3.0
- filelock ==3.9.0
- fonttools ==4.40.0
- frozenlist ==1.3.3
- fsspec ==2023.6.0
- gitdb ==4.0.10
- google-crc32c ==1.5.0
- gunicorn ==20.1.0
- h11 ==0.14.0
- httpcore ==0.17.2
- httptools ==0.5.0
- httpx ==0.24.1
- huggingface-hub ==0.15.1
- idna ==3.4
- ifaddr ==0.2.0
- importlib-metadata ==6.6.0
- importlib-resources ==5.12.0
- itsdangerous ==2.1.2
- joblib ==1.2.0
- jsonschema ==4.17.3
- kiwisolver ==1.4.4
- lazy_loader ==0.2
- librosa ==0.10.0.post2
- linkify-it-py ==2.0.2
- lit ==15.0.7
- llvmlite ==0.40.0
- markdown-it-py ==2.2.0
- markdown2 ==2.4.8
- matplotlib ==3.7.1
- mdit-py-plugins ==0.3.3
- mdurl ==0.1.2
- mpmath ==1.3.0
- msgpack ==1.0.5
- multidict ==6.0.4
- multiprocess ==0.70.14
- networkx ==3.0
- nh3 ==0.2.13
- num2words ==0.5.12
- numba ==0.57.0
- numpy ==1.23.5
- orjson ==3.9.1
- packaging ==23.1
- pandas ==2.0.2
- pathtools ==0.1.2
- peft ==0.3.0
- pkgutil_resolve_name ==1.3.10
- platformdirs ==2.6.0
- pooch ==1.6.0
- prompt-toolkit ==3.0.38
- protobuf ==4.21.12
- psutil ==5.9.5
- pyOpenSSL ==23.2.0
- pyarrow ==12.0.1
- pycparser ==2.21
- pycuda ==2022.2.2
- pydantic ==1.10.9
- pydub ==0.25.1
- pyee ==10.0.1
- pylibsrtp ==0.8.0
- pyparsing ==3.0.9
- pyrsistent ==0.19.3
- pyston-lite ==2.3.5
- pyston-lite-autoload ==2.3.5
- python-dateutil ==2.8.2
- python-dotenv ==1.0.0
- python-multipart ==0.0.6
- pytools ==2022.1.13
- pytz ==2023.3
- regex ==2023.6.3
- requests ==2.31.0
- responses ==0.23.1
- rfc3986 ==2.0.0
- rich ==13.4.2
- rouge ==1.0.1
- ruamel.yaml ==0.17.28
- ruamel.yaml.clib ==0.2.7
- safetensors ==0.3.1
- scikit-learn ==1.2.2
- scipy ==1.10.1
- semantic-version ==2.10.0
- sentencepiece ==0.1.99
- sentry-sdk ==1.25.1
- setproctitle ==1.3.2
- shortuuid ==1.0.11
- six ==1.16.0
- smmap ==5.0.0
- sniffio ==1.3.0
- soundfile ==0.12.1
- soxr ==0.3.5
- speechbrain ==0.5.14
- starlette ==0.27.0
- svgwrite ==1.4.3
- sympy ==1.11.1
- threadpoolctl ==3.1.0
- tiktoken ==0.4.0
- tokenizers ==0.13.3
- toolz ==0.12.0
- tqdm ==4.65.0
- transformers ==4.31.0
- triton ==2.0.0
- types-PyYAML ==6.0.12.10
- typing_extensions ==4.4.0
- tzdata ==2023.3
- uc-micro-py ==1.0.2
- ujson ==5.8.0
- urllib3 ==1.26.13
- uvicorn ==0.22.0
- uvloop ==0.17.0
- wandb ==0.15.4
- watchfiles ==0.19.0
- wavedrom ==2.0.3.post3
- wcwidth ==0.2.6
- websockets ==11.0.3
- xxhash ==3.2.0
- yarl ==1.9.2
- zipp ==3.15.0