awesome-llama: https://github.com/ModelTC/QLLM
llama llama2 llm post-training-quantization pytorch quantization transformers
Score: 4.406719247264253
Last synced: about 18 hours ago
JSON representation
Repository metadata:
[ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Models"
- Host: GitHub
- URL: https://github.com/ModelTC/QLLM
- Owner: ModelTC
- License: apache-2.0
- Created: 2024-02-21T04:13:17.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2024-03-11T02:56:00.000Z (almost 2 years ago)
- Last Synced: 2026-01-31T09:56:19.993Z (7 days ago)
- Topics: llama, llama2, llm, post-training-quantization, pytorch, quantization, transformers
- Language: Python
- Homepage: https://arxiv.org/abs/2310.08041
- Size: 1.68 MB
- Stars: 39
- Watchers: 7
- Forks: 4
- Open Issues: 2
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Owner metadata:
- Name: ModelTC
- Login: ModelTC
- Email:
- Kind: organization
- Description: Model Infra
- Website:
- Location:
- Twitter:
- Company:
- Icon url: https://avatars.githubusercontent.com/u/69665675?v=4
- Repositories: 8
- Last Synced at: 2023-03-03T20:14:52.752Z
- Profile URL: https://github.com/ModelTC
GitHub Events
Total
- Fork event: 2
- Issues event: 1
- Watch event: 5
- Total: 8
Last Year
- Fork event: 2
- Watch event: 1
- Total: 3
Committers metadata
Last synced: 16 days ago
Total Commits: 9
Total Committers: 2
Avg Commits per committer: 4.5
Development Distribution Score (DDS): 0.111
Commits in past year: 0
Committers in past year: 0
Avg Commits per committer in past year: 0.0
Development Distribution Score (DDS) in past year: 0.0
| Name | Commits | |
|---|---|---|
| liujingcs | l****5@o****m | 8 |
| XHPlus | x****s@1****m | 1 |
Issue and Pull Request metadata
Last synced: 5 months ago
Total issues: 2
Total pull requests: 0
Average time to close issues: N/A
Average time to close pull requests: N/A
Total issue authors: 2
Total pull request authors: 0
Average comments per issue: 0.5
Average comments per pull request: 0
Merged pull request: 0
Bot issues: 0
Bot pull requests: 0
Past year issues: 1
Past year pull requests: 0
Past year average time to close issues: N/A
Past year average time to close pull requests: N/A
Past year issue authors: 1
Past year pull request authors: 0
Past year average comments per issue: 0.0
Past year average comments per pull request: 0
Past year merged pull request: 0
Past year bot issues: 0
Past year bot pull requests: 0
Top Issue Authors
- sunnyxiaohu (1)
- shengqihailuo1 (1)
Top Pull Request Authors
Top Issue Labels
Top Pull Request Labels
Dependencies
- accelerate *
- attributedict *
- datasets >=2.0.0
- einops *
- jsonlines *
- matplotlib *
- numexpr *
- numpy *
- omegaconf >=2.2
- openai >=0.6.4
- peft >=0.2.0
- protobuf *
- pybind11 >=2.6.2
- pycountry *
- pytablewriter *
- rouge-score >=0.0.4
- sacrebleu ==1.5.0
- scikit-learn >=0.24.1
- sentencepiece *
- sqlitedict *
- texttable *
- tokenizers >=0.12.1
- toml *
- torch >=2.0.0
- torchvision *
- tqdm-multiprocess *
- transformers ==4.37.2
- zstandard *