awesome-llama: https://github.com/kyegomez/SwitchTransformers

ai gpt4 llama mixture-model mixture-of-experts mixture-of-models ml moe multi-modal

Score: 13.771662113360549

Last synced: about 18 hours ago
JSON representation

Repository metadata:

Implementation of Switch Transformers from the paper: "Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity"

• Host: GitHub
• URL: https://github.com/kyegomez/SwitchTransformers
• Owner: kyegomez
• License: mit
• Created: 2024-01-22T11:38:12.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2026-05-11T05:20:04.000Z (23 days ago)
• Last Synced: 2026-05-24T02:03:25.541Z (10 days ago)
• Topics: ai, gpt4, llama, mixture-model, mixture-of-experts, mixture-of-models, ml, moe, multi-modal
• Language: Python
• Homepage: https://discord.gg/GYbXvDGevY
• Size: 2.42 MB
• Stars: 141
• Watchers: 1
• Forks: 18
• Open Issues: 2
• Metadata Files:
  • Readme: README.md
  • Funding: .github/FUNDING.yml
  • License: LICENSE
• Funding:
  • Github: kyegomez

---

Owner metadata:

• Name: Eternal Reclaimer
• Login: kyegomez
• Email:
• Kind: user
• Description: Leader of Agora, the open source Multi-Modal AI research lab join our community here: https://discord.gg/hCJpnhA5aP
• Website: https://www.swarms.world/
• Location: Miami
• Twitter: KyeGomezB
• Company: Automated Public Assistance Company
• Icon url: https://avatars.githubusercontent.com/u/98760976?u=20f6194e354d56e7751f1c06283cc5422dd0285b&v=4
• Repositories: 331
• Last Synced at: 2024-04-15T05:04:07.231Z
• Profile URL: https://github.com/kyegomez

---

GitHub Events

Total

• Create event: 10
• Delete event: 10
• Fork event: 6
• Issue comment event: 12
• Issues event: 1
• Pull request event: 19
• Pull request review event: 1
• Watch event: 72
• Total: 131

Last Year

• Create event: 6
• Delete event: 6
• Fork event: 1
• Issue comment event: 2
• Pull request event: 8
• Watch event: 12
• Total: 35

---

Committers metadata

Last synced: 4 days ago

Name	Email	Commits
Kye	k****e@a****m	7
Eternal Reclaimer	9****z	2
dependabot[bot]	4****]	1

---

Issue and Pull Request metadata

Last synced: 22 days ago

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/kyegomez/SwitchTransformers

---

---

---

Package metadata

• Total packages: 1
• Total downloads:
  • pypi: 2,230 last-month
• Total dependent packages: 0
• Total dependent repositories: 0
• Total versions: 4
• Total maintainers: 1

---

Dependencies