awesome-llama: https://github.com/modelize-ai/LLM-Inference-Deployment-Tutorial

gpt inference llama llm llm-inference model-serving transformer tutorial

Score: 2.9444389791664403

Last synced: about 11 hours ago
JSON representation

Repository metadata:

Tutorial for LLM developers about engine design, service deployment, evaluation/benchmark, etc. Provide a C/S style optimized LLM inference engine.

• Host: GitHub
• URL: https://github.com/modelize-ai/LLM-Inference-Deployment-Tutorial
• Owner: modelize-ai
• License: apache-2.0
• Created: 2023-08-28T19:57:23.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2023-09-05T03:34:24.000Z (over 2 years ago)
• Last Synced: 2026-02-02T04:52:23.169Z (7 days ago)
• Topics: gpt, inference, llama, llm, llm-inference, model-serving, transformer, tutorial
• Language: Python
• Homepage:
• Size: 94.7 KB
• Stars: 19
• Watchers: 1
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

---

Owner metadata:

• Name: modelize-ai
• Login: modelize-ai
• Email:
• Kind: organization
• Description:
• Website:
• Location:
• Twitter:
• Company:
• Icon url: https://avatars.githubusercontent.com/u/136322859?v=4
• Repositories: 1
• Last Synced at: 2023-07-02T08:32:18.664Z
• Profile URL: https://github.com/modelize-ai

---

GitHub Events

Total

• Total: 0

Last Year

• Total: 0

---

Committers metadata

Last synced: 24 days ago

Name	Email	Commits
PanQiWei	5****5@q****m	43

---

Issue and Pull Request metadata

Last synced: 5 months ago

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/modelize-ai/LLM-Inference-Deployment-Tutorial

---

---