awesome-llama: https://github.com/adithya-s-k/LLM-InferenceNet

cpp llama llamacpp llm

Score: 2.6390573296152584

Last synced: about 13 hours ago
JSON representation

Repository metadata:

LLM InferenceNet is a C++ project designed to facilitate fast and efficient inference from Large Language Models (LLMs) using a client-server architecture. It enables optimized interactions with pre-trained language models, making deployment on edge devices easier.

• Host: GitHub
• URL: https://github.com/adithya-s-k/LLM-InferenceNet
• Owner: adithya-s-k
• Created: 2023-07-26T07:19:37.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2023-07-28T04:44:07.000Z (over 2 years ago)
• Last Synced: 2026-01-19T17:59:54.421Z (21 days ago)
• Topics: cpp, llama, llamacpp, llm
• Language: C++
• Homepage:
• Size: 57.6 KB
• Stars: 7
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

---

Owner metadata:

• Name: Adithya S K
• Login: adithya-s-k
• Email:
• Kind: user
• Description: Exploring Generative AI • Google DSC Lead'23 • Cloud & Full Stack Engineer • Drones & IoT • FOSS Contributor
• Website: https://adithyask.com/
• Location: Indian
• Twitter: adithya_s_k
• Company: Cognitivelab
• Icon url: https://avatars.githubusercontent.com/u/27956426?u=582ecb2d706a63fc67eb1b54579c7ab19cf391fd&v=4
• Repositories: 60
• Last Synced at: 2024-04-23T00:10:31.896Z
• Profile URL: https://github.com/adithya-s-k

---

GitHub Events

Total

• Total: 0

Last Year

• Total: 0

---

Committers metadata

Last synced: 8 days ago

Name	Email	Commits
raunak kodwani	6****r	18
Adithya S K	a****i@g****m	11

---

Issue and Pull Request metadata

Last synced: 5 months ago

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/adithya-s-k/LLM-InferenceNet

---

---