awesome-llama: https://github.com/inferflow/inferflow

baichuan2 bloom deepseek falcon gemma internlm llama2 llamacpp llm-inference m2m100 minicpm mistral mixtral mixture-of-experts model-quantization moe multi-gpu-inference phi-2 qwen

Score: 7.640123172695363

Last synced: about 22 hours ago
JSON representation

Repository metadata:

Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).

• Host: GitHub
• URL: https://github.com/inferflow/inferflow
• Owner: inferflow
• License: mit
• Created: 2023-12-26T03:21:22.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2024-03-15T06:52:33.000Z (over 2 years ago)
• Last Synced: 2026-05-21T11:39:32.583Z (29 days ago)
• Topics: baichuan2, bloom, deepseek, falcon, gemma, internlm, llama2, llamacpp, llm-inference, m2m100, minicpm, mistral, mixtral, mixture-of-experts, model-quantization, moe, multi-gpu-inference, phi-2, qwen
• Language: C++
• Homepage:
• Size: 1.89 MB
• Stars: 252
• Watchers: 8
• Forks: 24
• Open Issues: 8
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

---

Owner metadata:

• Name:
• Login: inferflow
• Email:
• Kind: user
• Description:
• Website:
• Location:
• Twitter:
• Company:
• Icon url: https://avatars.githubusercontent.com/u/154857160?v=4
• Repositories: 1
• Last Synced at: 2024-01-17T01:02:23.213Z
• Profile URL: https://github.com/inferflow

---

GitHub Events

Total

• Fork event: 2
• Issues event: 1
• Watch event: 15
• Total: 18

Last Year

• Fork event: 1
• Watch event: 6
• Total: 7

---

Committers metadata

Last synced: 4 months ago

Name	Email	Commits
shumingshi	s****i@t****m	51
Inferflow	1****w	7
Shuming Shi	6****i	7
leyangcui	l****i@t****m	5
Enbozhao	b****b@o****m	2
chenglin	c****3@g****m	2
huayangli	w****i@g****m	1
Deng Cai	t****d@g****m	1

---

Issue and Pull Request metadata

Last synced: 7 months ago

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/inferflow/inferflow

---

---