awesome-llama: https://github.com/kennethleungty/Llama-2-Open-Source-LLM-CPU-Inference

c-transformers chatgpt cpu cpu-inference deep-learning document-qa faiss langchain language-models large-language-models llama llama-2 llm machine-learning natural-language-processing nlp open-source-llm python sentence-transformers transformers

Score: 8.281977058867758

Last synced: about 23 hours ago
JSON representation

Repository metadata:

Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A

• Host: GitHub
• URL: https://github.com/kennethleungty/Llama-2-Open-Source-LLM-CPU-Inference
• Owner: kennethleungty
• License: mit
• Created: 2023-07-06T05:42:43.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2023-11-06T14:03:21.000Z (over 2 years ago)
• Last Synced: 2026-01-20T23:46:40.311Z (20 days ago)
• Topics: c-transformers, chatgpt, cpu, cpu-inference, deep-learning, document-qa, faiss, langchain, language-models, large-language-models, llama, llama-2, llm, machine-learning, natural-language-processing, nlp, open-source-llm, python, sentence-transformers, transformers
• Language: Python
• Homepage: https://towardsdatascience.com/running-llama-2-on-cpu-inference-for-document-q-a-3d636037a3d8
• Size: 4.52 MB
• Stars: 973
• Watchers: 13
• Forks: 209
• Open Issues: 15
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

---

Owner metadata:

• Name: Kenneth Leung
• Login: kennethleungty
• Email:
• Kind: user
• Description: Data Scientist at BCG • Tech Writer • Pharmacist • linkedin.com/in/kennethleungty • kennethleungty.medium.com
• Website: https://linkedin.com/in/kennethleungty
• Location: Singapore
• Twitter:
• Company: Boston Consulting Group (BCG)
• Icon url: https://avatars.githubusercontent.com/u/16691614?u=79bee1ac6e74702838f71386c675f0ed6202b0b3&v=4
• Repositories: 16
• Last Synced at: 2023-03-05T18:07:46.652Z
• Profile URL: https://github.com/kennethleungty

---

GitHub Events

Total

• Fork event: 9
• Watch event: 26
• Total: 35

Last Year

• Fork event: 4
• Watch event: 13
• Total: 17

---

Committers metadata

Last synced: 16 days ago

Name	Email	Commits
Kenneth Leung	k****y@g****m	30
Ikko Eltociear Ashimine	e****r@g****m	2
Seyed Saeid Masoumzadeh	m****h@g****m	1
Mohammad Fasha	m****a@g****m	1

---

Issue and Pull Request metadata

Last synced: 5 months ago

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/kennethleungty/Llama-2-Open-Source-LLM-CPU-Inference

---

---

---

Dependencies