awesome-llama: https://github.com/PaddlePaddle/PaddleNLP
bert compression distributed-training document-intelligence embedding ernie information-extraction llama llm neural-search nlp paddlenlp pretrained-models question-answering search-engine semantic-analysis sentiment-analysis transformers uie
Score: 26.171561381091568
Last synced: about 8 hours ago
JSON representation
Repository metadata:
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
- Host: GitHub
- URL: https://github.com/PaddlePaddle/PaddleNLP
- Owner: PaddlePaddle
- License: apache-2.0
- Created: 2021-02-05T13:07:42.000Z (over 5 years ago)
- Default Branch: develop
- Last Pushed: 2026-05-23T02:54:28.000Z (3 months ago)
- Last Synced: 2026-08-05T22:42:55.735Z (7 days ago)
- Topics: bert, compression, distributed-training, document-intelligence, embedding, ernie, information-extraction, llama, llm, neural-search, nlp, paddlenlp, pretrained-models, question-answering, search-engine, semantic-analysis, sentiment-analysis, transformers, uie
- Language: Python
- Homepage: https://paddlenlp.readthedocs.io
- Size: 112 MB
- Stars: 12,964
- Watchers: 96
- Forks: 3,033
- Open Issues: 358
-
Metadata Files:
- Readme: README.md
- Contributing: .github/CONTRIBUTING_en.md
- License: LICENSE
- Code of conduct: .github/CODE_OF_CONDUCT.md
Owner metadata:
- Name: PaddlePaddle
- Login: PaddlePaddle
- Email:
- Kind: organization
- Description:
- Website: http://paddlepaddle.org
- Location:
- Twitter:
- Company:
- Icon url: https://avatars.githubusercontent.com/u/23534030?v=4
- Repositories: 85
- Last Synced at: 2023-02-27T13:30:46.845Z
- Profile URL: https://github.com/PaddlePaddle
GitHub Events
Total
- Commit comment event: 1
- Create event: 68
- Delete event: 46
- Fork event: 198
- Issue comment event: 3813
- Issues event: 573
- Member event: 9
- Pull request event: 2734
- Pull request review comment event: 1372
- Pull request review event: 2117
- Push event: 1013
- Release event: 4
- Watch event: 800
- Total: 12748
Last Year
- Commit comment event: 1
- Create event: 68
- Delete event: 46
- Fork event: 198
- Issue comment event: 3817
- Issues event: 575
- Member event: 9
- Pull request event: 2734
- Pull request review comment event: 1372
- Pull request review event: 2117
- Push event: 1013
- Release event: 4
- Watch event: 802
- Total: 12756
Committers metadata
Last synced: 1 day ago
Total Commits: 5,694
Total Committers: 379
Avg Commits per committer: 15.024
Development Distribution Score (DDS): 0.941
Commits in past year: 84
Committers in past year: 40
Avg Commits per committer in past year: 2.1
Development Distribution Score (DDS) in past year: 0.845
| Name | Commits | |
|---|---|---|
| Zhong Hui | z****t@g****m | 335 |
| Sijun He | s****e@h****m | 265 |
| Linjie Chen | 4****c | 241 |
| lugimzzz | 6****z | 226 |
| 骑马小猫 | 1****6@q****m | 216 |
| w5688414 | w****4@g****m | 212 |
| Jack Zhou | z****e@b****m | 203 |
| wawltor | f****4@h****m | 199 |
| Jiaqi Liu | 7****0@q****m | 198 |
| yujun | 5****u | 181 |
| liu zhengxi | 3****8@q****m | 178 |
| smallv0221 | 3****1 | 160 |
| Zeyu Chen | c****1@b****m | 154 |
| Weiguo Zhu | D****9@g****m | 138 |
| gongenlei | g****l@q****m | 126 |
| Noel | w****3@b****m | 124 |
| Siming Dai | 9****6@q****m | 118 |
| yingyibiao | y****6@1****m | 116 |
| Liujie0926 | 4****6 | 74 |
| westfish | w****h@1****m | 68 |
| zhang junjun | 1****1@q****m | 67 |
| Guo Sheng | g****g@b****m | 66 |
| tianxin | t****4@b****m | 65 |
| Ting Liu | w****n@f****m | 61 |
| Yuanle Liu | y****e@1****m | 51 |
| Steffy-zxf | 4****f | 46 |
| chenxujun | c****c | 41 |
| kinghuin | k****l@1****m | 40 |
| chenxiaozeng | c****7@b****m | 39 |
| Milen | 3****0 | 36 |
| and 349 more... | ||
Issue and Pull Request metadata
Last synced: 1 day ago
Total issues: 1,460
Total pull requests: 5,779
Average time to close issues: 7 months
Average time to close pull requests: about 1 month
Total issue authors: 952
Total pull request authors: 357
Average comments per issue: 2.95
Average comments per pull request: 1.93
Merged pull request: 3,452
Bot issues: 0
Bot pull requests: 1
Past year issues: 23
Past year pull requests: 187
Past year average time to close issues: 2 months
Past year average time to close pull requests: 3 days
Past year issue authors: 18
Past year pull request authors: 48
Past year average comments per issue: 0.87
Past year average comments per pull request: 0.93
Past year merged pull request: 86
Past year bot issues: 0
Past year bot pull requests: 0
Top Issue Authors
- cqray1990 (19)
- ZTurboX (13)
- goldwater668 (13)
- dingidng (12)
- zhaogf01 (10)
- gggdroa (10)
- liuzhipengchd (9)
- tianchiguaixia (9)
- BEILOP (8)
- hitzhu (7)
- ZHUI (7)
- Wong4j (7)
- Chinesejunzai (6)
- sanbuphy (6)
- natureLanguageQing (6)
Top Pull Request Authors
- DrownFish19 (314)
- ZHUI (298)
- DesmonDay (290)
- lugimzzz (217)
- SylarTiaNII (149)
- Liujie0926 (136)
- w5688414 (132)
- yuanlehome (123)
- JunnYu (120)
- zhangbo9674 (115)
- sneaxiy (111)
- wtmlon (96)
- wj-Mcat (92)
- ForFishes (80)
- blacksheep-Aristotle (79)
Top Issue Labels
- question (936)
- stale (554)
- triage (451)
- bug (322)
- others (50)
- documentation (24)
- pipelines (7)
- text classification (5)
- enhancement (4)
- keep (3)
- ie (3)
- ppdiffusers (3)
- LLM (2)
- Enterprise (2)
- FAQ (2)
- contributor (2)
- model-compression (2)
- sentiment-analysis (2)
- hackathon (2)
- pre-training (1)
- data augmentation (1)
- taskflow (1)
- :sparkles: feature (1)
- help wanted (1)
- uie-x (1)
- installation (1)
Top Pull Request Labels
- contributor (818)
- stale (574)
- HappyOpenSource (69)
- Beijing Innovation Consortium (28)
- pipelines (26)
- status: proposed (23)
- hackathon (14)
- XPU (13)
- enhancement (7)
- QA (6)
- faster (6)
- neural-search (5)
- status: accepted (4)
- documentation (4)
- Trainer (4)
- skip-ci: distribute-a100 (4)
- 多硬件 (4)
- question (3)
- skip-ci: distribute-v100 (3)
- inference (3)
- 易用性 (3)
- question answering (3)
- model-compression (2)
- status: not progressed (2)
- triage (2)
- ie (2)
- python (1)
- deploy (1)
- dependencies (1)
- bug (1)
Package metadata
- Total packages: 9
-
Total downloads:
- pypi: 44,730 last-month
- Total docker downloads: 799
- Total dependent packages: 19 (may contain duplicates)
- Total dependent repositories: 454 (may contain duplicates)
- Total versions: 222
- Total maintainers: 2
pypi.org: paddlenlp
Easy-to-use and powerful NLP library with Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including Neural Search, Question Answering, Information Extraction and Sentiment Analysis end-to-end system.
- Homepage: https://github.com/PaddlePaddle/PaddleNLP
- Documentation: https://paddlenlp.readthedocs.io/
- Licenses: Apache 2.0
- Latest release: 2.8.1 (published about 2 years ago)
- Last Synced: 2026-08-12T00:06:34.732Z (1 day ago)
- Versions: 96
- Dependent Packages: 15
- Dependent Repositories: 438
- Downloads: 28,140 Last month
- Docker Downloads: 799
-
Rankings:
- Forks count: 0.221%
- Stargazers count: 0.244%
- Dependent repos count: 0.684%
- Dependent packages count: 0.962%
- Average: 0.981%
- Downloads: 1.779%
- Docker downloads count: 1.994%
- Maintainers (1)
pypi.org: fast-tokenizer-python
PaddleNLP Fast Tokenizer Library written in C++
- Homepage: https://github.com/PaddlePaddle/PaddleNLP/fast_tokenizer
- Documentation: https://fast-tokenizer-python.readthedocs.io/
- Licenses: Apache 2.0
- Latest release: 1.0.2 (published over 3 years ago)
- Last Synced: 2026-08-12T00:06:32.727Z (1 day ago)
- Versions: 4
- Dependent Packages: 2
- Dependent Repositories: 14
- Downloads: 161 Last month
-
Rankings:
- Forks count: 0.22%
- Stargazers count: 0.243%
- Dependent packages count: 3.242%
- Average: 3.329%
- Dependent repos count: 3.914%
- Downloads: 9.028%
- Maintainers (1)
proxy.golang.org: github.com/PaddlePaddle/PaddleNLP
- Homepage:
- Documentation: https://pkg.go.dev/github.com/PaddlePaddle/PaddleNLP#section-documentation
- Licenses: apache-2.0
- Latest release: v2.8.1+incompatible (published about 2 years ago)
- Last Synced: 2026-08-12T00:06:36.850Z (1 day ago)
- Versions: 49
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent packages count: 6.999%
- Average: 8.173%
- Dependent repos count: 9.346%
proxy.golang.org: github.com/paddlepaddle/paddlenlp
- Homepage:
- Documentation: https://pkg.go.dev/github.com/paddlepaddle/paddlenlp#section-documentation
- Licenses: apache-2.0
- Latest release: v2.8.1+incompatible (published about 2 years ago)
- Last Synced: 2026-08-12T00:06:37.373Z (1 day ago)
- Versions: 49
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent packages count: 6.999%
- Average: 8.173%
- Dependent repos count: 9.346%
pypi.org: paddle-pipelines
Paddle-Pipelines: An End to End Natural Language Proceessing Development Kit Based on PaddleNLP
- Homepage: https://github.com/PaddlePaddle/PaddleNLP
- Documentation: https://paddle-pipelines.readthedocs.io/
- Licenses: Apache 2.0
- Latest release: 0.6.2 (published over 2 years ago)
- Last Synced: 2026-08-12T00:06:32.531Z (1 day ago)
- Versions: 11
- Dependent Packages: 0
- Dependent Repositories: 1
- Downloads: 483 Last month
-
Rankings:
- Forks count: 0.22%
- Stargazers count: 0.243%
- Dependent packages count: 7.306%
- Average: 8.621%
- Downloads: 13.258%
- Dependent repos count: 22.077%
- Maintainers (1)
pypi.org: tool-helpers
Data tool helpers for PaddleNLP pre-training.
- Homepage: https://github.com/PaddlePaddle/PaddleNLP/blob/develop/model_zoo/ernie-1.0/data_tools
- Documentation: https://tool-helpers.readthedocs.io/
- Licenses: Apache 2.0
- Latest release: 0.1.2 (published almost 2 years ago)
- Last Synced: 2026-08-12T00:06:34.470Z (1 day ago)
- Versions: 3
- Dependent Packages: 1
- Dependent Repositories: 0
- Downloads: 8,394 Last month
-
Rankings:
- Stargazers count: 0.294%
- Forks count: 0.341%
- Dependent packages count: 6.633%
- Average: 11.585%
- Downloads: 20.046%
- Dependent repos count: 30.611%
- Maintainers (1)
pypi.org: faster-tokenizer
PaddleNLP Faster Tokenizer Library written in C++
- Homepage: https://github.com/PaddlePaddle/PaddleNLP/faster_tokenizer
- Documentation: https://faster-tokenizer.readthedocs.io/
- Licenses: Apache 2.0
- Latest release: 0.2.0 (published almost 4 years ago)
- Last Synced: 2026-08-12T00:06:33.371Z (1 day ago)
- Versions: 7
- Dependent Packages: 1
- Dependent Repositories: 0
- Downloads: 119 Last month
-
Rankings:
- Stargazers count: 0.294%
- Forks count: 0.341%
- Dependent packages count: 6.633%
- Average: 12.253%
- Downloads: 23.384%
- Dependent repos count: 30.611%
- Maintainers (1)
pypi.org: faster-tokenizers
PaddleNLP Faster Tokenizer Library written in C++
- Homepage: https://github.com/PaddlePaddle/PaddleNLP/faster_tokenizers
- Documentation: https://faster-tokenizers.readthedocs.io/
- Licenses: Apache 2.0
- Latest release: 0.1.1 (published about 4 years ago)
- Last Synced: 2026-08-12T00:06:36.200Z (1 day ago)
- Versions: 2
- Dependent Packages: 0
- Dependent Repositories: 1
- Downloads: 39 Last month
-
Rankings:
- Forks count: 0.22%
- Stargazers count: 0.243%
- Dependent packages count: 7.306%
- Average: 13.199%
- Dependent repos count: 22.077%
- Downloads: 36.148%
- Maintainers (1)
pypi.org: fast-dataindex
Data tool helpers for PaddleNLP pre-training.
- Homepage: https://github.com/PaddlePaddle/PaddleNLP/blob/develop/model_zoo/ernie-1.0/data_tools
- Documentation: https://fast-dataindex.readthedocs.io/
- Licenses: Apache 2.0
- Latest release: 0.1.2 (published almost 2 years ago)
- Last Synced: 2026-08-12T00:06:33.240Z (1 day ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 7,394 Last month
-
Rankings:
- Dependent packages count: 10.31%
- Average: 34.168%
- Dependent repos count: 58.026%
- Maintainers (1)
Dependencies
.github/workflows/lint.yml
actions
- actions/checkout v3 composite
- actions/setup-python v1 composite
.github/workflows/release.yml
actions
- actions/checkout v2 composite
- actions/setup-python v1 composite
.github/workflows/stale.yml
actions
- actions/stale v6.0.1 composite
docs/requirements.txt
pypi
- Markdown <3.4
- jinja2 ==3.0.3
- paddlepaddle >=2.2.2,<2.4.0
- readthedocs-sphinx-search ==0.1.0
- sphinx ==3.5.2
- sphinx-copybutton ==0.3.1
- sphinx-markdown-tables ==0.0.15
- sphinx_rtd_theme ==0.5.2
paddlenlp/experimental/autonlp/requirements.txt
pypi
- hyperopt >=0.2.5
- ray >=2.0
requirements-dev.txt
pypi
- fast_tokenizer_python * development
- paddlepaddle >=2.4.1 development
- parameterized * development
- pre-commit * development
- pytest * development
- pytest-cov * development
- pytest-xdist * development
- regex * development
requirements.txt
pypi
- Flask-Babel <3.0.0
- colorama *
- colorlog *
- datasets >=2.0.0
- dill <0.3.5
- fastapi *
- huggingface_hub >=0.11.1
- jieba *
- multiprocess <=0.70.12.2
- paddle2onnx *
- paddlefsl *
- protobuf >=3.1.0,<=3.20.0
- rich *
- sentencepiece *
- seqeval *
- tqdm *
- typer *
- uvicorn *
- visualdl *
scripts/regression/requirements_ci.txt
pypi
- GPUtil *
- PyYAML ==5.4.1
- attrdict ==2.0.1
- bce-python-sdk *
- beautifulsoup4 *
- cma *
- coverage *
- fast_tokenizer_python *
- h5py *
- lac *
- nltk *
- opencv-contrib-python ==4.6.0.66
- opencv-python ==4.6.0.66
- packaging *
- paddleocr *
- pandas *
- parameterized *
- psutil *
- pybind11 *
- pycryptodome *
- pynvml *
- pypinyin *
- pyrouge *
- pytest *
- regex *
- scikit-learn *
- subword_nmt ==0.3.7
- visualdl *
- yacs *
- zstandard *
tests/requirements.txt
pypi
- fast_tokenizer_python * test
- parameterized * test
- regex * test
- sentencepiece * test
- torch >=1.5 test
- transformers * test
.github/workflows/pipelines.yml
actions
- actions/checkout v3 composite
- actions/setup-python v4 composite
csrc/requirements.txt
pypi
- cupy-cuda116 *
- pybind11 *
pyproject.toml
pypi
setup.py
pypi
slm/pipelines/docker/docker-compose.yml
docker
- docker.elastic.co/elasticsearch/elasticsearch 8.3.3
- paddlepaddle/paddlenlp pipelines-cpu-1.0
llm/server/server/requirements.txt
pypi
- asyncio *
- fastapi *
- httpx *
- openai ==1.44.1
- opencv-python *
- patchify *
- pycryptodome *
- pynvml *
- sentencepiece *
- shortuuid *
- tiktoken *
- transformers *
- tritonclient ==2.41.1
- uvicorn *
ops/csrc/fp8/setup.py
pypi
slm/applications/text_classification/hierarchical/few-shot/requirements_gpu.txt
pypi
- onnx *
- onnxconverter-common *
- onnxruntime-gpu *
- paddle2onnx >=1.0.3
- paddlenlp >=2.4.3
- paddlepaddle-gpu >=2.4rc
- psutil *
slm/applications/text_classification/hierarchical/retrieval_based/requirements.txt
pypi
- hnswlib >=0.5.2
- numpy >=1.17.2
- paddle-serving-app >=0.7.0
- paddle-serving-client >=0.7.0
- paddle-serving-server-gpu >=0.7.0.post102
- paddlenlp >=2.3.4
- paddlepaddle-gpu >=2.3.0
- pandas ==0.25.1
- pybind11 *
- pymilvus ==1.1.2
- visualdl >=2.2.2
slm/applications/text_classification/multi_class/few-shot/requirements_gpu.txt
pypi
- onnx *
- onnxconverter-common *
- onnxruntime-gpu *
- paddle2onnx >=1.0.3
- paddlenlp >=2.4.3
- paddlepaddle-gpu >=2.4rc
- psutil *
slm/examples/information_extraction/DuUIE/requirements.txt
pypi
- importlib_metadata *
- nltk *
- paddlenlp *
- tabulate *
- visualdl *
slm/model_zoo/bert/static_ipu/requirements.txt
pypi
- datasets *
- h5py *
- multiprocess *
- numpy *
- paddlenlp *
- scipy *
- tqdm *
- wandb *
slm/model_zoo/ernie-vil2.0/requirements.txt
pypi
- paddlenlp >=2.5.1
- paddlepaddle >=2.4.1
- pyarrow *
- python >=3.7
llm/application/distill/requirements.txt
pypi
- aiofiles *
- datasets *
- omegaconf ==2.4.0.dev3
- openai *
- tenacity *
slm/examples/semantic_indexing/requirements.txt
pypi
- faiss ==1.5.3
- hnswlib ==0.6.2
- numpy ==1.22.4
- paddle ==1.0.2
- paddlenlp ==2.3.4
- paddlepaddle ==2.3.1
- regex ==2022.7.25
- spacy ==3.4.1
- tqdm ==4.64.0
slm/model_zoo/gpt-3/external_ops/setup.py
pypi
slm/pipelines/docs/requirements.txt
pypi
- griffe *
- mkdocs *
- mkdocs-jupyter *
- mkdocs-material *
- mkdocstrings *
- mkdocstrings-python *
csrc/npu/setup.py
pypi
slm/applications/neural_search/requirements.txt
pypi
- hnswlib >=0.5.2
- numpy >=1.17.2
- paddle-serving-app >=0.7.0
- paddle-serving-client >=0.7.0
- paddle-serving-server-gpu >=0.7.0.post102
- paddlenlp >=2.1.1
- paddlepaddle-gpu >=2.2.3
- pandas *
- pybind11 *
- pymilvus >=2.1.0
- visualdl >=2.2.2
slm/applications/text_classification/multi_label/few-shot/requirements_cpu.txt
pypi
- onnxruntime *
- paddle2onnx >=1.0.3
- paddlenlp >=2.4.3
- paddlepaddle >=2.4rc
- psutil *
slm/applications/text_classification/multi_class/retrieval_based/requirements.txt
pypi
- hnswlib >=0.5.2
- numpy >=1.17.2
- paddle-serving-app >=0.7.0
- paddle-serving-client >=0.7.0
- paddle-serving-server-gpu >=0.7.0.post102
- paddlenlp >=2.3.4
- paddlepaddle-gpu >=2.3.0
- pandas ==0.25.1
- pybind11 *
- pymilvus ==1.1.2
- visualdl >=2.2.2
slm/applications/text_classification/multi_label/few-shot/requirements_gpu.txt
pypi
- onnx *
- onnxconverter-common *
- onnxruntime-gpu *
- paddle2onnx >=1.0.3
- paddlenlp >=2.4.3
- paddlepaddle-gpu >=2.4rc
- psutil *
slm/examples/code_generation/codegen/requirements.txt
pypi
- fastapi ==0.79.0
- openai ==0.8.0
- pydantic ==1.9.1
- python-dotenv ==0.20.0
- regex ==2022.6.2
- sse_starlette ==0.10.3
- uvicorn ==0.17.6
slm/examples/machine_translation/requirements.txt
pypi
- attrdict *
- easydict *
- pyyaml *
- subword_nmt *
slm/examples/model_interpretation/requirements.txt
pypi
- nvgpu >=0.9.0
- regex >=2021.11.10
- spacy >=2.3.7
- tqdm >=4.62.3
- visualdl >=2.2.2
slm/examples/simultaneous_translation/stacl/demo/requirements.txt
pypi
- PyYAML ==5.4.1
- attrdict ==2.0.1
- jieba ==0.42.1
- subword-nmt ==0.3.7
- websocket-client ==1.0.1
slm/examples/simultaneous_translation/stacl/requirements.txt
pypi
- PyYAML ==5.4.1
- attrdict ==2.0.1
- jieba ==0.42.1
- subword_nmt ==0.3.7
slm/examples/torch_migration/requirements.txt
pypi
- paddlenlp *
- paddlepaddle-gpu ==2.2.0
- torch >=1.7
- transformers *
slm/model_zoo/ernie-layout/deploy/python/requirements.txt
pypi
- paddleocr *
slm/pipelines/examples/structured_index/requirements.txt
pypi
- faiss-gpu ==1.7.2
- fitz *
- frontend *
- numpy *
- paddlenlp ==3.0.0b2
- paddleocr ==2.7.3
- tqdm *
slm/pipelines/examples/tree-of-thought/requirements.txt
pypi
- aiohttp ==3.8.4
- aiosignal ==1.3.1
- async-timeout ==4.0.2
- attrs ==23.1.0
- certifi ==2023.5.7
- charset-normalizer ==3.1.0
- erniebot ==0.5.0
- frozenlist ==1.3.3
- idna ==3.4
- mpmath ==1.3.0
- multidict ==6.0.4
- numpy ==1.24.3
- paddlenlp ==2.7.1
- paddlepaddle-gpu ==2.6.0
- pandas ==2.0.3
- requests ==2.31.0
- sympy ==1.12
- tqdm ==4.65.0
- urllib3 ==2.0.2
- yarl ==1.9.2
slm/applications/text_classification/hierarchical/few-shot/requirements_cpu.txt
pypi
- onnxruntime *
- paddle2onnx >=1.0.3
- paddlenlp >=2.4.3
- paddlepaddle >=2.4rc
- psutil *
slm/applications/text_classification/multi_label/retrieval_based/requirements.txt
pypi
- hnswlib >=0.5.2
- paddlenlp >=2.3.7
- pandas ==0.25.1
- pybind11 *
- pymilvus ==1.1.2
slm/model_zoo/ernie-layout/requirements.txt
pypi
- editdistance >=0.6.0
- opencv-python >=4.6.0.66
slm/model_zoo/gpt-3/requirements.txt
pypi
- Pillow ==9.3.0
- blobfile ==1.3.3
- colorama ==0.4.5
- colorlog ==6.6.0
- omegaconf ==2.2.2
- opencv-python >=4.2.0.32
- pybind11 ==2.10.0
- regex ==2022.7.25
- requests ==2.25.1
- tqdm >=4.62.1
slm/pipelines/setup.py
pypi
llm/server/requirements-dev.txt
pypi
- black ==23.3.0 development
- isort ==5.11.5 development
- pre-commit * development
slm/examples/benchmark/peft/torch/requirements.txt
pypi
- bitsandbytes ==0.39.0
- datasets ==2.12.0
- deepspeed ==0.9.4
- sentencepiece *
- torch ==2.0.1
- transformers ==4.30.2
.github/actions/check-bypass/action.yml
actions
- PFCCLab/ci-bypass v1 composite
.github/workflows/approval.yml
actions
- ./.github/actions/check-bypass * composite
.github/workflows/check-bypass.yml
actions
- PFCCLab/ci-bypass v1 composite
.github/workflows/unittest-cpu.yml
actions
slm/pipelines/benchmarks/requirements.txt
pypi
- datasets *
- mteb *
- typer ==0.9.0
slm/pipelines/requirements.txt
pypi
- aistudio_sdk *
- boilerpy3 *
- click ==8.0
- elasticsearch >=7.7,<=7.11
- events *
- faiss-cpu >=1.7.2
- langdetect *
- markdown *
- mmh3 *
- more_itertools *
- nltk *
- numba *
- opencv-contrib-python-headless *
- opencv-python >=4.4
- paddlenlp >=2.5.2
- paddleocr ==2.6.1.3
- pdf2image >1.14
- pydantic *
- pymilvus >=2.1
- pypdf *
- python-docx *
- requests *
- spacy *
- sqlalchemy >=1.4.2,<2
- sqlalchemy_utils *
- sseclient-py ==1.7.2
- tritonclient *
- typing_extensions ==4.5.0
- wordcloud ==1.8.2.2
slm/pipelines/docker/Dockerfile
docker
- paddlepaddle/paddlenlp pipelines-cpu-1.0 build
ops/setup.py
pypi
ops/csrc/setup.py
pypi
slm/applications/text_classification/multi_class/few-shot/requirements_cpu.txt
pypi
- onnxruntime *
- paddle2onnx >=1.0.3
- paddlenlp >=2.4.3
- paddlepaddle >=2.4rc
- psutil *
slm/pipelines/examples/contrastive_training/requirements.txt
pypi
- h11 ==0.16.0
- mteb ==1.12.80
- requests *
- typer ==0.9.0
slm/pipelines/tests/requirements.txt
pypi
- paddlepaddle >=2.4.1 test
- pytest * test
.github/workflows/PaddleFormers-PR-Check.yml
actions
- ./.github/actions/check-bypass * composite
.github/workflows/rerun.yml
actions
- ./.github/actions/rerun-workflow * composite
- actions/checkout v3 composite
.github/workflows/unittest-gpu.yml
actions
slm/pipelines/docker/docker-compose-gpu.yml
docker
- docker.elastic.co/elasticsearch/elasticsearch 8.3.3
- paddlepaddle/paddlenlp pipelines-1.0-gpu-cuda10.2-cudnn7
slm/model_zoo/ernie-3.0/deploy/python/requirements.txt
pypi
- fast-tokenizer-python *
ops/requirements.txt
pypi
- einops >=0.6.1
- numpy *
- paddlenlp >=3.0.0.b2
- triton >=3.0.0
csrc/xpu/src/setup.py
pypi
.github/actions/rerun-workflow/action.yml
actions
.github/workflows/llm.yml
actions