https://github.com/wentbackward/hikyaku

inference llm load-balancer openai-api

Score: 2.772588722239781

Last synced: about 3 hours ago
JSON representation

Repository metadata:

A superfast proxy and smart load-balancer for AI Inference — virtualize models, share local and provider back-ends, optimal caching, lock-in sampling parameters, debug message flow and obtain OTel metrics

• Host: GitHub
• URL: https://github.com/wentbackward/hikyaku
• Owner: wentbackward
• License: mit
• Created: 2026-03-28T03:39:34.000Z (3 months ago)
• Default Branch: main
• Last Pushed: 2026-06-16T19:56:38.000Z (11 days ago)
• Last Synced: 2026-06-25T10:54:03.953Z (2 days ago)
• Topics: inference, llm, load-balancer, openai-api
• Language: Go
• Homepage: https://hikyaku.ai/
• Size: 18.8 MB
• Stars: 8
• Watchers: 0
• Forks: 4
• Open Issues: 8
• Metadata Files:
  • Readme: README.md
  • License: LICENSE
  • Security: docs/security.md

---

Owner metadata:

• Name:
• Login: wentbackward
• Email:
• Kind: user
• Description:
• Website:
• Location:
• Twitter:
• Company:
• Icon url: https://avatars.githubusercontent.com/u/1219178?v=4
• Repositories: 5
• Last Synced at: 2024-03-17T12:10:13.561Z
• Profile URL: https://github.com/wentbackward