awesome-llama: https://github.com/Picovoice/picollm

compression efficient-inference gemma generative-ai language-model language-models large-language-model llama llama2 llama3 llm llm-inference llms mistral mixtral model-compression natural-language-processing quantization self-hosted

Score: 15.432392693287607

Last synced: about 17 hours ago
JSON representation

Repository metadata:

On-device LLM Inference Powered by X-Bit Quantization

• Host: GitHub
• URL: https://github.com/Picovoice/picollm
• Owner: Picovoice
• License: apache-2.0
• Created: 2024-04-09T21:23:22.000Z (almost 2 years ago)
• Default Branch: main
• Last Pushed: 2026-01-26T23:59:47.000Z (9 days ago)
• Last Synced: 2026-01-31T03:54:06.822Z (5 days ago)
• Topics: compression, efficient-inference, gemma, generative-ai, language-model, language-models, large-language-model, llama, llama2, llama3, llm, llm-inference, llms, mistral, mixtral, model-compression, natural-language-processing, quantization, self-hosted
• Language: Python
• Homepage: https://picovoice.ai/
• Size: 97.8 MB
• Stars: 278
• Watchers: 9
• Forks: 15
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

---

Owner metadata:

• Name: Picovoice
• Login: Picovoice
• Email: hello@picovoice.ai
• Kind: organization
• Description: Edge Voice AI Platform
• Website: https://picovoice.ai
• Location: Vancouver, Canada
• Twitter:
• Company:
• Icon url: https://avatars.githubusercontent.com/u/37164515?v=4
• Repositories: 28
• Last Synced at: 2023-03-01T20:55:13.334Z
• Profile URL: https://github.com/Picovoice

---

GitHub Events

Total

• Create event: 55
• Delete event: 49
• Fork event: 6
• Issue comment event: 21
• Issues event: 12
• Pull request event: 65
• Pull request review comment event: 4
• Pull request review event: 32
• Push event: 192
• Release event: 3
• Watch event: 87
• Total: 526

Last Year

• Create event: 32
• Delete event: 32
• Fork event: 6
• Issue comment event: 10
• Issues event: 10
• Pull request event: 42
• Pull request review comment event: 4
• Pull request review event: 16
• Push event: 112
• Release event: 1
• Watch event: 55
• Total: 320

---

Committers metadata

Last synced: 11 days ago

Name	Email	Commits
Ian	i****n@p****i	19
matt200-ok	m****w@p****i	12
picoliu	l****u@p****i	11
Kwangsoo Yeo	k****o@p****i	11
dependabot[bot]	4****]	9
Eric Mikulin	E****k	6
Alireza Kenarsari	a****a@p****i	3
chr1swill	a****3@g****m	1
Albert Ho	8****o	1
Pouya Rostam	p****a@p****i	1

---

Issue and Pull Request metadata

Last synced: 7 days ago

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/Picovoice/picollm

---

---

---

Package metadata

• Total packages: 6
• Total downloads:
  • npm: 65 last-month
  • pypi: 334 last-month
  • nuget: 1,403 total
• Total dependent packages: 0 (may contain duplicates)
• Total dependent repositories: 0 (may contain duplicates)
• Total versions: 63
• Total maintainers: 10

---

Dependencies