awesome-llama: https://github.com/aahouzi/llama2-chatbot-cpu

4-bit-cpu bfloat16 chatbot chatbot-memory chatgpt cpu huggingface int8 intel ipex langchain llama llama2 meta meta-ai neural-compression numa optimization smooth-quantization streamlit

Score: 3.8066624897703196

Last synced: about 22 hours ago
JSON representation

Repository metadata:

A LLaMA2-7b chatbot with memory running on CPU, and optimized using smooth quantization, 4-bit quantization or Intel® Extension For PyTorch with bfloat16.

• Host: GitHub
• URL: https://github.com/aahouzi/llama2-chatbot-cpu
• Owner: aahouzi
• License: mit
• Created: 2023-08-10T13:32:14.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2024-02-27T08:52:56.000Z (about 2 years ago)
• Last Synced: 2026-03-27T10:55:53.773Z (7 days ago)
• Topics: 4-bit-cpu, bfloat16, chatbot, chatbot-memory, chatgpt, cpu, huggingface, int8, intel, ipex, langchain, llama, llama2, meta, meta-ai, neural-compression, numa, optimization, smooth-quantization, streamlit
• Language: Python
• Homepage:
• Size: 30.3 MB
• Stars: 15
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

---

Owner metadata:

• Name: Anas Ahouzi
• Login: aahouzi
• Email:
• Kind: user
• Description: AI Software Engineer @Intel
• Website:
• Location: Paris, France
• Twitter: ahouzi_anas
• Company: @intel
• Icon url: https://avatars.githubusercontent.com/u/112881240?u=0611ee0a00d57faab35b72f439b1ae08c5fda883&v=4
• Repositories: 1
• Last Synced at: 2023-05-30T08:29:53.435Z
• Profile URL: https://github.com/aahouzi

---

GitHub Events

Total

• Total: 0

Last Year

• Total: 0

---

Committers metadata

Last synced: 3 days ago

Name	Email	Commits
Anas Ahouzi	1****l	47
Anas Ahouzi	1****i	15
dependabot[bot]	4****]	6

---

Issue and Pull Request metadata

Last synced: 3 months ago

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/aahouzi/llama2-chatbot-cpu

---

---

---

Dependencies