awesome-llama: https://github.com/Guitaricet/relora

deep-learning distributed-training llama nlp peft transformer

Score: 6.169610732491456

Last synced: about 7 hours ago
JSON representation

Repository metadata:

Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates

• Host: GitHub
• URL: https://github.com/Guitaricet/relora
• Owner: Guitaricet
• License: apache-2.0
• Created: 2023-04-27T20:26:35.000Z (almost 3 years ago)
• Default Branch: main
• Last Pushed: 2024-04-21T20:09:58.000Z (almost 2 years ago)
• Last Synced: 2026-02-01T06:08:57.176Z (6 days ago)
• Topics: deep-learning, distributed-training, llama, nlp, peft, transformer
• Language: Jupyter Notebook
• Homepage: https://arxiv.org/abs/2307.05695
• Size: 1.89 MB
• Stars: 473
• Watchers: 8
• Forks: 42
• Open Issues: 5
• Metadata Files:
  • Readme: README.dev.md
  • License: LICENSE
  • Citation: CITATION.cff

---

Owner metadata:

• Name: Vlad Lialin
• Login: Guitaricet
• Email: vlad.lialin@gmail.com
• Kind: user
• Description: Deep Learning for Robotics @ 1X Technologies
• Website:
• Location: San Francisco, CA
• Twitter:
• Company: @1x-technologies
• Icon url: https://avatars.githubusercontent.com/u/2821124?u=c380c5e2c839a8e5ec1294b0dae7d27a100d8971&v=4
• Repositories: 75
• Last Synced at: 2026-02-02T17:38:30.785Z
• Profile URL: https://github.com/Guitaricet

---

GitHub Events

Total

• Fork event: 4
• Issue comment event: 6
• Issues event: 1
• Watch event: 32
• Total: 43

Last Year

• Fork event: 2
• Watch event: 20
• Total: 22

---

Committers metadata

Last synced: 6 days ago

Name	Email	Commits
Vladislav Liain	g****t@g****m	214

---

Issue and Pull Request metadata

Last synced: 5 months ago

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/Guitaricet/relora

---

---

---

Dependencies