awesome-llama: https://github.com/EmbeddedLLM/embeddedllm

aipc cpu directml directx-12 gemma ipexllm llama llm llm-inference llm-serving mistral model-inference npu open-source-llm openvino openvino-inference-engine phi-3 windows

Score: 5.049856007249537

Last synced: about 11 hours ago
JSON representation

Repository metadata:

EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU

• Host: GitHub
• URL: https://github.com/EmbeddedLLM/embeddedllm
• Owner: EmbeddedLLM
• Created: 2024-06-17T13:45:35.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2024-10-06T10:31:49.000Z (over 1 year ago)
• Last Synced: 2025-11-08T02:04:02.887Z (3 months ago)
• Topics: aipc, cpu, directml, directx-12, gemma, ipexllm, llama, llm, llm-inference, llm-serving, mistral, model-inference, npu, open-source-llm, openvino, openvino-inference-engine, phi-3, windows
• Language: Python
• Homepage:
• Size: 12.6 MB
• Stars: 44
• Watchers: 2
• Forks: 1
• Open Issues: 8
• Metadata Files:
  • Readme: README.md
  • Changelog: CHANGELOG.md

---

Owner metadata:

• Name: EmbeddedLLM
• Login: EmbeddedLLM
• Email: info@embeddedLLM.com
• Kind: organization
• Description:
• Website:
• Location:
• Twitter:
• Company:
• Icon url: https://avatars.githubusercontent.com/u/148834374?v=4
• Repositories: 1
• Last Synced at: 2023-10-25T09:49:02.798Z
• Profile URL: https://github.com/EmbeddedLLM

---

GitHub Events

Total

• Fork event: 1
• Issues event: 2
• Watch event: 24
• Total: 27

Last Year

• Fork event: 1
• Issues event: 2
• Watch event: 21
• Total: 24

---

Committers metadata

Last synced: 3 months ago

Name	Email	Commits
TJian	t****6@g****m	20
Sze Yu Sim	3****u	14
Tan Pin Siang	t****g@g****m	2

---

Issue and Pull Request metadata

Last synced: 5 months ago

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/EmbeddedLLM/embeddedllm

---

---

---

Dependencies