ai_book

ai ai-ml cv deep-learning gpt-4 knowledge-distillation llama llm llmops machine-learning machinelearning mlops mlops-workflow nlp pytorch sagemaker tutorial xai

Score: 5.14166355650266

Last synced: about 1 hour ago
JSON representation

Repository metadata:

AI book for everyone

Host: GitHub
URL: https://github.com/YeonwooSung/ai_book
Owner: YeonwooSung
Created: 2020-06-27T15:46:28.000Z (almost 6 years ago)
Default Branch: master
Last Pushed: 2026-04-08T06:51:07.000Z (about 2 months ago)
Last Synced: 2026-05-16T03:35:48.655Z (19 days ago)
Topics: ai, ai-ml, cv, deep-learning, gpt-4, knowledge-distillation, llama, llm, llmops, machine-learning, machinelearning, mlops, mlops-workflow, nlp, pytorch, sagemaker, tutorial, xai
Language: Jupyter Notebook
Homepage:
Size: 632 MB
Stars: 34
Watchers: 1
Forks: 7
Open Issues: 23
Metadata Files:
- Readme: README.md
- Funding: .github/FUNDING.yml
Funding:
- Github: YeonwooSung
- Buy me a coffee: blackbeenie

Owner metadata:

Name: Yeonwoo Sung
Login: YeonwooSung
Email:
Kind: user
Description: As I've always been
Website:
Location:
Twitter:
Company:
Icon url: https://avatars.githubusercontent.com/u/30489717?u=7deffe9e0bc24a4e05edb422687ffc64487f2ddd&v=4
Repositories: 14
Last Synced at: 2023-03-05T13:09:45.052Z
Profile URL: https://github.com/YeonwooSung

GitHub Events

Total

Create event: 24
Delete event: 19
Fork event: 1
Issue comment event: 1
Issues event: 2
Pull request event: 42
Push event: 40
Watch event: 4
Total: 133

Last Year

Create event: 7
Delete event: 3
Pull request event: 11
Push event: 3
Total: 24

Committers metadata

Last synced: 19 days ago

Total Commits: 589
Total Committers: 3
Avg Commits per committer: 196.333
Development Distribution Score (DDS): 0.124

Commits in past year: 5
Committers in past year: 2
Avg Commits per committer in past year: 2.5
Development Distribution Score (DDS) in past year: 0.2

Name	Email	Commits
YeonwooSung	n**8@g**m	516
dependabot[bot]	4****]	72
TrellixVulnTeam	c**d@t**m	1

Issue and Pull Request metadata

Last synced: about 2 months ago

Total issues: 33
Total pull requests: 129
Average time to close issues: 7 months
Average time to close pull requests: 5 days
Total issue authors: 1
Total pull request authors: 2
Average comments per issue: 0.82
Average comments per pull request: 0.12
Merged pull request: 100
Bot issues: 0
Bot pull requests: 128

Past year issues: 0
Past year pull requests: 21
Past year average time to close issues: N/A
Past year average time to close pull requests: 7 days
Past year issue authors: 0
Past year pull request authors: 1
Past year average comments per issue: 0
Past year average comments per pull request: 0.05
Past year merged pull request: 14
Past year bot issues: 0
Past year bot pull requests: 21

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/YeonwooSung/ai_book

Top Issue Authors

YeonwooSung (33)

Top Pull Request Authors

dependabot[bot] (128)
TrellixVulnTeam (1)

Top Issue Labels

Attention mechanism (5)
Transformer (3)
Data (2)
NMT (2)
RNN (2)
SOTA (1)
CNN (1)
RAG (1)
Regularization (1)

Top Pull Request Labels

dependencies (128)
python (27)

Dependencies

Experiments/CV/object-detection/requirements.txt pypi

matplotlib *
numpy *
opencv-python *
ultralytics *

Experiments/CV/ocr_with_bert/poetry.lock pypi

blis 0.7.9
catalogue 2.0.8
certifi 2023.7.22
charset-normalizer 3.2.0
click 8.1.4
colorama 0.4.6
confection 0.1.0
contextualspellcheck 0.4.3
cymem 2.0.7
editdistance 0.6.0
filelock 3.12.2
fsspec 2023.6.0
huggingface-hub 0.20.1
idna 3.4
jinja2 3.1.3
langcodes 3.3.0
markupsafe 2.1.3
mpmath 1.3.0
murmurhash 1.0.9
networkx 3.1
numpy 1.25.1
opencv-python 4.8.0.74
packaging 23.1
pathy 0.10.2
pillow 10.2.0
preshed 3.0.8
pydantic 1.10.11
pytesseract 0.3.10
pyyaml 6.0
regex 2023.6.3
requests 2.31.0
safetensors 0.4.2
setuptools 68.0.0
smart-open 6.3.0
spacy 3.6.0
spacy-legacy 3.0.12
spacy-loggers 1.0.4
srsly 2.4.6
sympy 1.12
thinc 8.1.10
tokenizers 0.15.0
torch 2.0.1
tqdm 4.65.0
transformers 4.37.2
typer 0.9.0
typing-extensions 4.7.1
urllib3 2.0.7
wasabi 1.1.2

Experiments/CV/ocr_with_bert/pyproject.toml pypi

contextualspellcheck ^0.4.3
numpy ^1.25.1
opencv-python ^4.8.0.74
pytesseract ^0.3.10
python ^3.10
spacy ^3.6.0
torch ^2.0.1
transformers ^4.37.2

LLMs/RAG/llama-index-milvus-example/milvus/docker-compose.yml docker

milvusdb/milvus v2.2.12
minio/minio RELEASE.2023-03-20T20-16-18Z
quay.io/coreos/etcd v3.5.5
zilliz/attu v2.2.7

Experiments/CV/satellite-image-classification/requirements.txt pypi

matplotlib *
numpy *
seaborn *
sklearn *
tensorflow *
tensorflow_addons *
tensorflow_datasets *
tensorflow_hub *

Experiments/huggingface/olm/pyproject.toml pypi

datasets ^2.10.1
python ^3.9
tensorboard ^2.12.0
torch ^1.13.1
transformers ^4.26.1

Experiments/informaton-retrieval/recommender-system-using-association-rules/requirements.txt pypi

matplotlib ==3.2.2
matplotlib-inline ==0.1.3
mlxtend ==0.14.0
numpy ==1.22.0
openpyxl *
pandas ==1.1.5
seaborn ==0.11.1

Experiments/informaton-retrieval/visual-question-answering/requirements.txt pypi

Pillow *
accelerate *
requests *
scipy *
torch *
transformers *

Experiments/speech-ai/speech-emotion-recognition/requirements.txt pypi

librosa ==0.6.3
numpy *
pyaudio ==0.2.11
sklearn *
soundfile ==0.9.0

Experiments/speech-ai/speech-recognition/requirements.txt pypi

pyaudio *
pydub *
speech_recognition *

Experiments/speech-ai/text-to-speech/requirements.txt pypi

datasets *
gTTS *
playsound *
pyttsx3 *
sentencepiece *
soundfile *
transformers *

LLMs/RAG/llama-index-milvus-example/Pipfile pypi

aiofiles ==23.2.1
aiohttp ==3.9.5
aiosignal ==1.3.1
altair ==5.1.1
annotated-types ==0.5.0
anyio ==3.7.1
apify-client ==1.4.1
apify-shared ==1.0.2
async-timeout ==4.0.3
attrs ==23.1.0
beautifulsoup4 ==4.12.2
certifi ==2024.7.4
charset-normalizer ==3.2.0
click ==8.1.7
contourpy ==1.1.0
cycler ==0.11.0
dataclasses-json ==0.5.14
environs ==9.5.0
exceptiongroup ==1.1.3
fastapi ==0.103.1
ffmpy ==0.3.1
filelock ==3.12.3
fonttools ==4.43.0
frozenlist ==1.4.0
fsspec ==2023.9.0
gradio ==3.44.3
gradio-client ==0.5.0
grpcio ==1.56.0
h11 ==0.14.0
httpcore ==0.17.3
httpx ==0.24.1
huggingface-hub ==0.16.4
idna ==3.7
importlib-resources ==6.0.1
jinja2 ==3.1.3
joblib ==1.3.2
jsonschema ==4.19.0
jsonschema-specifications ==2023.7.1
kiwisolver ==1.4.5
langchain ==0.0.283
langsmith ==0.0.33
llama-index ==0.8.21
markupsafe ==2.1.3
marshmallow ==3.20.1
matplotlib ==3.7.2
multidict ==6.0.4
mypy-extensions ==1.0.0
nest-asyncio ==1.5.7
nltk ==3.8.1
numexpr ==2.8.5
numpy ==1.25.2
openai ==0.28.0
orjson ==3.9.5
packaging ==23.1
pandas ==2.1.0
pillow ==10.3.0
protobuf ==4.24.2
pydantic ==2.3.0
pydantic-core ==2.6.3
pydub ==0.25.1
pymilvus ==2.3.0
pyparsing ==3.0.9
python-dateutil ==2.8.2
python-dotenv ==1.0.0
python-multipart ==0.0.7
pytz ==2023.3.post1
pyyaml ==6.0.1
referencing ==0.30.2
regex ==2023.8.8
requests ==2.32.3
rpds-py ==0.10.2
semantic-version ==2.10.0
six ==1.16.0
sniffio ==1.3.0
soupsieve ==2.5
sqlalchemy ==2.0.20
starlette ==0.27.0
tenacity ==8.2.3
tiktoken ==0.4.0
toolz ==0.12.0
tqdm ==4.66.4
typing-extensions ==4.7.1
typing-inspect ==0.9.0
tzdata ==2023.3
ujson ==5.8.0
urllib3 ==1.26.19
uvicorn ==0.23.2
websockets ==11.0.3
yarl ==1.9.2
zipp ==3.19.1

LLMs/RAG/llama-index-milvus-example/Pipfile.lock pypi

aiofiles ==23.2.1
aiohttp ==3.9.5
aiosignal ==1.3.1
altair ==5.1.1
annotated-types ==0.5.0
anyio ==3.7.1
apify-client ==1.4.1
apify-shared ==1.0.2
async-timeout ==4.0.3
attrs ==23.1.0
beautifulsoup4 ==4.12.2
certifi ==2024.7.4
charset-normalizer ==3.2.0
click ==8.1.7
contourpy ==1.1.0
cycler ==0.11.0
dataclasses-json ==0.5.14
environs ==9.5.0
exceptiongroup ==1.1.3
fastapi ==0.103.1
ffmpy ==0.3.1
filelock ==3.12.3
fonttools ==4.43.0
frozenlist ==1.4.0
fsspec ==2023.9.0
gradio ==3.44.3
gradio-client ==0.5.0
grpcio ==1.56.0
h11 ==0.14.0
httpcore ==0.17.3
httpx ==0.24.1
huggingface-hub ==0.16.4
idna ==3.7
importlib-resources ==6.0.1
jinja2 ==3.1.3
joblib ==1.3.2
jsonschema ==4.19.0
jsonschema-specifications ==2023.7.1
kiwisolver ==1.4.5
langchain ==0.0.283
langsmith ==0.0.33
llama-index ==0.8.21
markupsafe ==2.1.3
marshmallow ==3.20.1
matplotlib ==3.7.2
multidict ==6.0.4
mypy-extensions ==1.0.0
nest-asyncio ==1.5.7
nltk ==3.8.1
numexpr ==2.8.5
numpy ==1.25.2
openai ==0.28.0
orjson ==3.9.5
packaging ==23.1
pandas ==2.1.0
pillow ==10.3.0
protobuf ==4.24.2
pydantic ==2.3.0
pydantic-core ==2.6.3
pydub ==0.25.1
pymilvus ==2.3.0
pyparsing ==3.0.9
python-dateutil ==2.8.2
python-dotenv ==1.0.0
python-multipart ==0.0.7
pytz ==2023.3.post1
pyyaml ==6.0.1
referencing ==0.30.2
regex ==2023.8.8
requests ==2.32.3
rpds-py ==0.10.2
semantic-version ==2.10.0
six ==1.16.0
sniffio ==1.3.0
soupsieve ==2.5
sqlalchemy ==2.0.20
starlette ==0.27.0
tenacity ==8.2.3
tiktoken ==0.4.0
toolz ==0.12.0
tqdm ==4.66.4
typing-extensions ==4.7.1
typing-inspect ==0.9.0
tzdata ==2023.3
ujson ==5.8.0
urllib3 ==1.26.19
uvicorn ==0.23.2
websockets ==11.0.3
yarl ==1.9.2
zipp ==3.19.1

LLMs/training/llama_peft_trl/poetry.lock pypi

accelerate 0.24.1
aiohttp 3.9.5
aiosignal 1.3.1
async-timeout 4.0.3
attrs 23.1.0
bitsandbytes 0.40.2
certifi 2024.7.4
charset-normalizer 3.3.2
colorama 0.4.6
datasets 2.14.6
dill 0.3.7
filelock 3.13.1
frozenlist 1.4.0
fsspec 2023.10.0
huggingface-hub 0.19.1
idna 3.7
jinja2 3.1.3
markupsafe 2.1.3
mpmath 1.3.0
multidict 6.0.4
multiprocess 0.70.15
networkx 3.2.1
numpy 1.26.2
packaging 23.2
pandas 2.1.3
peft 0.3.0
psutil 5.9.6
pyarrow 14.0.1
python-dateutil 2.8.2
pytz 2023.3.post1
pyyaml 6.0.1
regex 2023.10.3
requests 2.32.3
safetensors 0.4.0
scipy 1.11.3
six 1.16.0
sympy 1.12
tiktoken 0.4.0
tokenizers 0.13.3
torch 2.1.0
tqdm 4.66.4
transformers 4.33.3
trl 0.4.7
typing-extensions 4.8.0
tzdata 2023.3
urllib3 2.2.2
xxhash 3.4.1
yarl 1.9.2

LLMs/training/llama_peft_trl/pyproject.toml pypi

bitsandbytes ^0.40.0.post4
datasets ^2.13.1
peft ^0.3.0
python >=3.10,<3.13
scipy ^1.11.1
tiktoken ^0.4.0
tokenizers ^0.13.3
torch ^2.0.1
transformers ^4.30.2
trl ^0.4.6

LLMs/training/llama_peft_trl/requirements.txt pypi

accelerate ==0.24.1
aiohttp ==3.8.6
aiosignal ==1.3.1
async-timeout ==4.0.3
attrs ==23.1.0
bitsandbytes ==0.40.2
certifi ==2023.7.22
charset-normalizer ==3.3.2
colorama ==0.4.6
datasets ==2.14.6
dill ==0.3.7
filelock ==3.13.1
frozenlist ==1.4.0
fsspec ==2023.10.0
huggingface-hub ==0.19.1
idna ==3.4
jinja2 ==3.1.2
markupsafe ==2.1.3
mpmath ==1.3.0
multidict ==6.0.4
multiprocess ==0.70.15
networkx ==3.2.1
numpy ==1.26.2
packaging ==23.2
pandas ==2.1.3
peft ==0.3.0
psutil ==5.9.6
pyarrow ==14.0.1
python-dateutil ==2.8.2
pytz ==2023.3.post1
pyyaml ==6.0.1
regex ==2023.10.3
requests ==2.31.0
safetensors ==0.4.0
scipy ==1.11.3
six ==1.16.0
sympy ==1.12
tiktoken ==0.4.0
tokenizers ==0.13.3
torch ==2.1.0
tqdm ==4.66.1
transformers ==4.33.3
trl ==0.4.7
typing-extensions ==4.8.0
tzdata ==2023.3
urllib3 ==2.1.0
xxhash ==3.4.1
yarl ==1.9.2

MLOps/AWS/SageMaker/sagemaker-huggingface-toolkit/notebooks/accelerate_sagemaker/src/seq2seq/requirements.txt pypi

accelerate *
datasets ==2.3.2
deepspeed *
evaluate *
nltk *
protobuf *
py7zr *
sacrebleu >=1.4.12
sentencepiece *
torch >=1.3
transformers ==4.38.0

MLOps/AWS/SageMaker/sagemaker-huggingface-toolkit/notebooks/accelerate_sagemaker/src/text-classification/requirements.txt pypi

accelerate *
datasets ==2.3.2
evaluate *
transformers *

MLOps/AWS/SageMaker/sagemaker-huggingface-toolkit/notebooks/inference/stable_diffusion_inference/code/requirements.txt pypi

diffusers ==0.6.0
transformers ==4.38.0

MachineLearning/GMM/GMM_phones/requirements.txt pypi

numpy ==1.22.0
pandas ==0.22.0
python-speech-features ==0.6
scikit-learn ==1.5.0
scipy ==1.10.0
tables ==3.4.4

MetaLearning/requirements-dev.txt pypi

black ==24.3.0 development
flake8 ==3.8.4 development
isort ==5.10.1 development
nbqa ==1.3.1 development
pylint ==2.7.3 development
pytest ==6.2.2 development
pytest-flake8 ==1.0.6 development
pytest-pylint ==0.18.0 development

MetaLearning/requirements.txt pypi

GPUtil ==1.4.0
autopep8 ==1.5.0
gym ==0.24.1
imageio >=2.1.2
jupyter ==1.0.0
jupyter-contrib-nbextensions ==0.5.1
jupyter-nbextensions-configurator ==0.4.1
matplotlib >=3.5.2
mujoco ==2.2.0
psutil ==5.9.1
setuptools ==71.1.0
torchmeta >=1.8.0
tqdm >=4.62.3

MLOps/serving_patterns/asynchronous_pattern/docker-compose.yml docker

redis latest
shibui/ml-system-in-actions asynchronous_pattern_imagenet_inception_v3_0.0.1
shibui/ml-system-in-actions asynchronous_pattern_asynchronous_proxy_0.0.1
shibui/ml-system-in-actions asynchronous_pattern_asynchronous_backend_0.0.1

MLOps/serving_patterns/asynchronous_pattern/imagenet_inception_v3/Dockerfile docker

tensorflow/serving 2.5.2 build
tensorflow/tensorflow 2.5.1 build

MLOps/serving_patterns/batch_pattern/docker-compose.yml docker

mysql 5.7
shibui/ml-system-in-actions batch_pattern_api_0.0.1
shibui/ml-system-in-actions batch_pattern_batch_0.0.1

MLOps/serving_patterns/data_cache_pattern/docker-compose.yml docker

redis latest
shibui/ml-system-in-actions data_cache_pattern_pred_0.0.1
shibui/ml-system-in-actions data_cache_pattern_proxy_0.0.1

MLOps/serving_patterns/horizontal_microservice_pattern/docker-compose.yml docker

shibui/ml-system-in-actions horizontal_microservice_pattern_proxy_0.0.1
shibui/ml-system-in-actions horizontal_microservice_pattern_setosa_0.0.1
shibui/ml-system-in-actions horizontal_microservice_pattern_versicolor_0.0.1
shibui/ml-system-in-actions horizontal_microservice_pattern_virginica_0.0.1

MLOps/serving_patterns/prediction_cache_pattern/docker-compose.yml docker

redis latest
shibui/ml-system-in-actions prediction_cache_pattern_pred_0.0.1
shibui/ml-system-in-actions prediction_cache_pattern_proxy_0.0.1

MLOps/serving_patterns/prep_pred_pattern/docker-compose.yml docker

shibui/ml-system-in-actions prep_pred_pattern_prep_0.0.1
shibui/ml-system-in-actions prep_pred_pattern_pred_0.0.1

MLOps/serving_patterns/sync_async_pattern/docker-compose.yml docker

redis latest
shibui/ml-system-in-actions sync_async_pattern_imagenet_mobilenet_v2_0.0.1
shibui/ml-system-in-actions sync_async_pattern_sync_async_proxy_0.0.1
shibui/ml-system-in-actions sync_async_pattern_sync_async_backend_0.0.1
shibui/ml-system-in-actions sync_async_pattern_imagenet_inception_v3_0.0.1

MLOps/serving_patterns/sync_async_pattern/imagenet_inception_v3/Dockerfile docker

tensorflow/serving 2.5.2 build
tensorflow/tensorflow 2.5.1 build

MLOps/serving_patterns/sync_async_pattern/imagenet_mobilenet_v2/Dockerfile docker

tensorflow/serving 2.5.2 build
tensorflow/tensorflow 2.5.1 build

MLOps/serving_patterns/synchronous_pattern/imagenet_inception_v3/Dockerfile docker

tensorflow/serving 2.5.2 build
tensorflow/tensorflow 2.5.1 build

MLOps/serving_patterns/template_pattern/sample/Dockerfile docker

python 3.8-slim build

MLOps/serving_patterns/template_pattern/sample/docker-compose.yml docker

shibui/ml-system-in-actions sample_0.0.1

MLOps/serving_patterns/web_single_pattern/Dockerfile docker

python 3.8-slim build

MLOps/serving_patterns/edge_ai_pattern/app/build.gradle maven

androidx.appcompat:appcompat 1.2.0 implementation
androidx.camera:camera-camera2 $camerax_version implementation
androidx.camera:camera-core $camerax_version implementation
androidx.constraintlayout:constraintlayout 2.0.4 implementation
androidx.core:core-ktx 1.3.2 implementation
org.jetbrains.kotlin:kotlin-stdlib-jdk7 $kotlin_version implementation
org.pytorch:pytorch_android 1.4.0 implementation
org.pytorch:pytorch_android_torchvision 1.4.0 implementation
org.tensorflow:tensorflow-lite 2.4.0 implementation
org.tensorflow:tensorflow-lite-gpu 2.4.0 implementation
org.tensorflow:tensorflow-lite-local 0.0.0 implementation
org.tensorflow:tensorflow-lite-support 0.0.0-nightly implementation
junit:junit 4.13.1 testImplementation

MLOps/serving_patterns/edge_ai_pattern/build.gradle maven

Experiments/CV/florence2-finetuning/requirements.txt pypi

accelerate ==0.31.0
aiohttp ==3.11.12
aiosignal ==1.3.1
anyio ==4.4.0
argon2-cffi ==23.1.0
argon2-cffi-bindings ==21.2.0
arrow ==1.3.0
asttokens ==2.4.1
async-lru ==2.0.4
attrs ==23.2.0
babel ==2.15.0
beautifulsoup4 ==4.12.3
bleach ==6.1.0
certifi ==2024.7.4
cffi ==1.16.0
charset-normalizer ==3.3.2
comm ==0.2.2
datasets ==2.20.0
debugpy ==1.8.1
decorator ==5.1.1
defusedxml ==0.7.1
dill ==0.3.8
einops ==0.8.0
executing ==2.0.1
fastjsonschema ==2.20.0
filelock ==3.15.3
flash-attn ==2.5.9.post1
fqdn ==1.5.1
friendlywords ==1.1.3
frozenlist ==1.4.1
fsspec ==2024.6.0
h11 ==0.14.0
httpcore ==1.0.5
httpx ==0.27.0
huggingface-hub ==0.23.4
idna ==3.7
ipykernel ==6.29.4
ipython ==8.25.0
ipywidgets ==8.1.3
isoduration ==20.11.0
jedi ==0.19.1
jinja2 ==3.1.5
json5 ==0.9.25
jsonpointer ==3.0.0
jsonschema ==4.22.0
jsonschema-specifications ==2023.12.1
jupyter ==1.0.0
jupyter-client ==8.6.2
jupyter-console ==6.6.3
jupyter-core ==5.7.2
jupyter-events ==0.10.0
jupyter-lsp ==2.2.5
jupyter-server ==2.14.1
jupyter-server-terminals ==0.5.3
jupyterlab ==4.2.2
jupyterlab-pygments ==0.3.0
jupyterlab-server ==2.27.2
jupyterlab-widgets ==3.0.11
levenshtein ==0.25.1
markupsafe ==2.1.5
matplotlib-inline ==0.1.7
mistune ==3.0.2
mpmath ==1.3.0
multidict ==6.0.5
multiprocess ==0.70.16
nbclient ==0.10.0
nbconvert ==7.16.4
nbformat ==5.10.4
nest-asyncio ==1.6.0
networkx ==3.3
notebook ==7.2.1
notebook-shim ==0.2.4
numpy ==2.0.0
nvidia-cublas-cu12 ==12.1.3.1
nvidia-cuda-cupti-cu12 ==12.1.105
nvidia-cuda-nvrtc-cu12 ==12.1.105
nvidia-cuda-runtime-cu12 ==12.1.105
nvidia-cudnn-cu12 ==8.9.2.26
nvidia-cufft-cu12 ==11.0.2.54
nvidia-curand-cu12 ==10.3.2.106
nvidia-cusolver-cu12 ==11.4.5.107
nvidia-cusparse-cu12 ==12.1.0.106
nvidia-nccl-cu12 ==2.20.5
nvidia-nvjitlink-cu12 ==12.5.40
nvidia-nvtx-cu12 ==12.1.105
overrides ==7.7.0
packaging ==24.1
pandas ==2.2.2
pandocfilters ==1.5.1
parso ==0.8.4
pexpect ==4.9.0
pillow ==10.3.0
pip ==24.0
platformdirs ==4.2.2
prometheus-client ==0.20.0
prompt-toolkit ==3.0.47
psutil ==6.0.0
ptyprocess ==0.7.0
pure-eval ==0.2.2
pyarrow ==16.1.0
pyarrow-hotfix ==0.6
pycparser ==2.22
pygments ==2.18.0
python-dateutil ==2.9.0.post0
python-json-logger ==2.0.7
pytz ==2024.1
pyyaml ==6.0.1
pyzmq ==26.0.3
qtconsole ==5.5.2
qtpy ==2.4.1
rapidfuzz ==3.9.3
referencing ==0.35.1
regex ==2024.5.15
requests ==2.32.3
rfc3339-validator ==0.1.4
rfc3986-validator ==0.1.1
rpds-py ==0.18.1
ruff ==0.4.9
safetensors ==0.4.3
send2trash ==1.8.3
setuptools ==70.1.0
six ==1.16.0
sniffio ==1.3.1
soupsieve ==2.5
stack-data ==0.6.3
sympy ==1.12.1
terminado ==0.18.1
timm ==1.0.7
tinycss2 ==1.3.0
tokenizers ==0.19.1
torch ==2.3.1
torchvision ==0.18.1
tornado ==6.4.2
tqdm ==4.66.4
traitlets ==5.14.3
transformers ==4.51.2
triton ==2.3.1
types-python-dateutil ==2.9.0.20240316
typing-extensions ==4.12.2
tzdata ==2024.1
uri-template ==1.3.0
urllib3 ==2.2.2
wcwidth ==0.2.13
webcolors ==24.6.0
webencodings ==0.5.1
websocket-client ==1.8.0
wheel ==0.43.0
widgetsnbextension ==4.0.11
xxhash ==3.4.1
yarl ==1.9.4

Experiments/NLP/distillation/requirements.txt pypi

gitpython ==3.1.41
psutil ==5.6.6
scipy >=1.4.1
tensorboard >=1.14.0
tensorboardX ==1.8
transformers *

LLMs/RAG/late-chunking/pyproject.toml pypi

click ==8.1.7
datasets ==2.19.1
einops ==0.6.1
jupyterlab ==4.2.5
llama-index ==0.12.9
llama-index-embeddings-huggingface ==0.3.1
mteb ==1.14.20
torch ==2.4.0
transformers ==4.50.3

LLMs/models/llama2/llama2-fine-tune/requirements.txt pypi

accelerate *
bitsandbytes *
datasets *
gradio *
peft *
scipy *
sentencepiece *
transformers *
trl *

LLMs/models/phi3/Finetuning/olive-ort-example/requirements.txt pypi

accelerate ==0.31.0
bitsandbytes ==0.43.1
datasets ==2.19.2
olive-ai >=0.6.0
onnxruntime-genai-cuda *
peft ==0.11.1

LLMs/models/phi3/Finetuning/translations/zh-tw/olive-ort-example/requirements.txt pypi

accelerate ==0.31.0
bitsandbytes ==0.43.1
datasets ==2.19.2
olive-ai >=0.6.0
onnxruntime-genai-cuda *
peft ==0.11.1

LLMs/models/phi3/Finetuning/vision_finetuning/requirements.txt pypi

Levenshtein *
accelerate ==0.30.1
datasets *
deepspeed ==0.13.1
transformers ==4.48.0

MLOps/serving_patterns/asynchronous_pattern/imagenet_inception_v3/requirements.txt pypi

Pillow >=8.3.2
PyYAML >=5.3.1
importlib-metadata >=1.7.0
joblib >=0.15.1
numpy >=1.18.5
psutil ==5.7.0
pydantic >=1.8.2
tensorflow >=2.5.1
tensorflow-hub >=0.10.0
tensorflow-serving-api >=2.5.2
typing >=3.7.4.1

MLOps/serving_patterns/asynchronous_pattern/requirements_backend.txt pypi

Pillow >=8.3.2
PyYAML >=5.3.1
click >=7.1.2
future >=0.18.2
httptools >=0.1.1
importlib-metadata >=1.7.0
joblib >=0.15.1
loguru >=0.5.3
numpy >=1.18.5
psutil >=5.7.0
pydantic >=1.8.2
python-json-logger >=2.0.1
redis >=3.5.3
requests >=2.25.1
tensorflow >=2.5.1
tensorflow-serving-api >=2.5.1
typing >=3.7.4.1

MLOps/serving_patterns/asynchronous_pattern/requirements_proxy.txt pypi

Pillow >=8.3.2
PyYAML >=5.3.1
fastapi >=0.65.2
future >=0.18.2
gunicorn >=20.0.4
httptools >=0.1.1
importlib-metadata >=1.7.0
joblib >=0.15.1
loguru >=0.5.3
numpy >=1.18.5
onnx >=1.7.0
onnxruntime >=1.4.0
psutil >=5.7.0
pydantic >=1.8.2
python-json-logger >=2.0.1
redis >=3.5.3
requests >=2.25.1
scikit-learn >=0.23.1
skl2onnx >=1.7.0
starlette >=0.13.4
typing >=3.7.4.1
uvicorn >=0.11.7
uvloop >=0.14.0

MLOps/serving_patterns/batch_pattern/requirements.txt pypi

Pillow >=8.3.2
PyYAML >=5.3.1
alembic >=1.4.2
fastapi >=0.65.2
future >=0.18.2
gunicorn >=20.0.4
httptools >=0.1.1
importlib-metadata >=1.7.0
joblib >=0.15.1
loguru >=0.5.3
mysqlclient >=2.0.1
numpy >=1.18.5
onnx >=1.7.0
onnxruntime >=1.4.0
psutil >=5.7.0
pydantic >=1.8.2
python-json-logger >=2.0.1
redis >=3.5.3
scikit-learn >=0.23.1
skl2onnx >=1.7.0
sqlalchemy >=1.3.18
starlette >=0.13.4
typing >=3.7.4.1
uvicorn >=0.11.7
uvloop >=0.14.0

MLOps/serving_patterns/data_cache_pattern/requirements.txt pypi

Pillow >=8.3.2
PyYAML >=5.3.1
fastapi >=0.65.2
future >=0.18.2
grpcio >=1.32.0
gunicorn >=20.0.4
httptools >=0.1.1
importlib-metadata >=1.7.0
joblib >=0.15.1
loguru >=0.5.3
numpy >=1.18.5
onnx >=1.7.0
onnxruntime >=1.4.0
psutil >=5.7.0
pydantic >=1.8.2
python-json-logger >=2.0.1
redis >=3.5.3
requests >=2.25.0
scikit-learn >=0.23.1
starlette >=0.13.4
typing >=3.7.4.1
uvicorn >=0.11.7
uvloop >=0.14.0

MLOps/serving_patterns/data_cache_pattern/resnet50_onnx_runtime/requirements.txt pypi

Pillow >=8.3.2
PyYAML >=5.3.1
click >=7.1.2
joblib >=0.15.1
numpy >=1.18.5
onnxruntime >=1.4.0
pydantic >=1.8.2
requests >=2.25.1
scikit-learn ==0.23.1
skl2onnx >=1.7.0
torch >=1.7.0
torchvision >=0.8.1
typing >=3.7.4.1

MLOps/serving_patterns/horizontal_microservice_pattern/requirements.txt pypi

Pillow >=8.3.2
PyYAML >=5.3.1
fastapi >=0.65.2
future >=0.18.2
gunicorn >=20.0.4
httptools >=0.1.1
httpx >=0.16.1
importlib-metadata >=1.7.0
joblib >=0.15.1
loguru >=0.5.3
numpy >=1.18.5
onnx >=1.7.0
onnxruntime >=1.4.0
psutil >=5.7.0
pydantic >=1.8.2
python-json-logger >=2.0.1
redis >=3.5.3
requests >=2.25.0
scikit-learn >=0.23.1
starlette >=0.13.4
typing >=3.7.4.1
uvicorn >=0.11.7
uvloop >=0.14.0

MLOps/serving_patterns/horizontal_microservice_pattern/requirements_proxy.txt pypi

Pillow >=8.3.2
PyYAML >=5.3.1
fastapi >=0.65.2
future >=0.18.2
gunicorn >=20.0.4
httptools >=0.1.1
httpx >=0.16.1
importlib-metadata >=1.7.0
loguru >=0.5.3
numpy >=1.18.5
psutil >=5.7.0
pydantic >=1.8.2
python-json-logger >=2.0.1
requests >=2.25.0
starlette >=0.13.4
typing >=3.7.4.1
uvicorn >=0.11.7
uvloop >=0.14.0

MLOps/serving_patterns/prediction_cache_pattern/requirements.txt pypi

Pillow >=8.3.2
PyYAML >=5.3.1
fastapi >=0.65.2
future >=0.18.2
grpcio >=1.32.0
gunicorn >=20.0.4
httptools >=0.1.1
importlib-metadata >=1.7.0
joblib >=0.15.1
loguru >=0.5.3
numpy >=1.18.5
onnx >=1.7.0
onnxruntime >=1.4.0
psutil >=5.7.0
pydantic >=1.8.2
python-json-logger >=2.0.1
redis >=3.5.3
requests >=2.25.0
scikit-learn >=0.23.1
starlette >=0.13.4
typing >=3.7.4.1
uvicorn >=0.11.7
uvloop >=0.14.0

MLOps/serving_patterns/prediction_cache_pattern/resnet50_onnx_runtime/requirements.txt pypi

Pillow >=8.3.2
PyYAML >=5.3.1
click >=7.1.2
joblib >=0.15.1
numpy >=1.18.5
onnxruntime >=1.4.0
pydantic >=1.8.2
requests >=2.25.1
scikit-learn ==0.23.1
skl2onnx >=1.7.0
torch >=1.7.0
torchvision >=0.8.1
typing >=3.7.4.1

MLOps/serving_patterns/prep_pred_pattern/requirements.txt pypi

Pillow >=8.3.2
PyYAML >=5.3.1
fastapi >=0.65.2
future >=0.18.2
grpcio >=1.32.0
gunicorn >=20.0.4
httptools >=0.1.1
importlib-metadata >=1.7.0
joblib >=0.15.1
loguru >=0.5.3
numpy >=1.18.5
onnx >=1.7.0
onnxruntime >=1.4.0
psutil >=5.7.0
pydantic >=1.8.2
python-json-logger >=2.0.1
redis >=3.5.3
requests >=2.25.0
scikit-learn >=0.23.1
starlette >=0.13.4
typing >=3.7.4.1
uvicorn >=0.11.7
uvloop >=0.14.0

MLOps/serving_patterns/prep_pred_pattern/resnet50_onnx_runtime/requirements.txt pypi

Pillow >=8.3.2
PyYAML >=5.3.1
click >=7.1.2
joblib >=0.15.1
numpy >=1.18.5
onnxruntime >=1.4.0
pydantic >=1.8.2
requests >=2.25.1
scikit-learn ==0.23.1
skl2onnx >=1.7.0
torch >=1.7.0
torchvision >=0.8.1
typing >=3.7.4.1

MLOps/serving_patterns/sync_async_pattern/imagenet_inception_v3/requirements.txt pypi

Pillow >=8.3.2
PyYAML >=5.3.1
importlib-metadata >=1.7.0
joblib >=0.15.1
numpy >=1.18.5
psutil ==5.7.0
pydantic >=1.8.2
tensorflow >=2.5.1
tensorflow-hub >=0.10.0
tensorflow-serving-api >=2.5.2
typing >=3.7.4.1

MLOps/serving_patterns/sync_async_pattern/imagenet_mobilenet_v2/requirements.txt pypi

Pillow >=8.3.2
PyYAML >=5.3.1
importlib-metadata >=1.7.0
joblib >=0.15.1
numpy >=1.18.5
psutil ==5.7.0
pydantic >=1.8.2
tensorflow >=2.5.1
tensorflow-hub >=0.10.0
tensorflow-serving-api >=2.5.2
typing >=3.7.4.1

MLOps/serving_patterns/sync_async_pattern/requirements_backend.txt pypi

Pillow >=8.3.2
PyYAML >=5.3.1
click >=7.1.2
future >=0.18.2
httptools >=0.1.1
importlib-metadata >=1.7.0
joblib >=0.15.1
loguru >=0.5.3
numpy >=1.18.5
psutil >=5.7.0
pydantic >=1.8.2
python-json-logger >=2.0.1
redis >=3.5.3
requests >=2.25.1
tensorflow >=2.5.1
tensorflow-serving-api >=2.5.2
typing >=3.7.4.1

MLOps/serving_patterns/sync_async_pattern/requirements_proxy.txt pypi

Pillow >=8.3.2
PyYAML >=5.3.1
fastapi >=0.65.2
future >=0.18.2
gunicorn >=20.0.4
httptools >=0.1.1
httpx >=0.16.1
importlib-metadata >=1.7.0
joblib >=0.15.1
loguru >=0.5.3
numpy >=1.18.5
psutil >=5.7.0
pydantic >=1.8.2
python-json-logger >=2.0.1
redis >=3.5.3
requests >=2.25.1
scikit-learn >=0.23.1
starlette >=0.13.4
tensorflow >=2.5.1
tensorflow-serving-api >=2.5.2
typing >=3.7.4.1
uvicorn >=0.11.7
uvloop >=0.14.0

MLOps/serving_patterns/synchronous_pattern/client/requirements.txt pypi

Pillow >=8.3.2
click >=7.1.2
importlib-metadata >=1.7.0
numpy >=1.18.5
psutil >=5.7.0
tensorflow >=2.5.1
tensorflow-serving-api >=2.5.2
typing >=3.7.4.1

MLOps/serving_patterns/synchronous_pattern/imagenet_inception_v3/requirements.txt pypi

Pillow >=8.3.2
PyYAML >=5.3.1
importlib-metadata >=1.7.0
joblib >=0.15.1
numpy >=1.18.5
psutil ==5.7.0
pydantic >=1.8.2
tensorflow >=2.5.1
tensorflow-hub >=0.10.0
tensorflow-serving-api >=2.5.2
typing >=3.7.4.1

MLOps/serving_patterns/template_pattern/requirements.txt pypi

Jinja2 >=2.11.2
PyYAML >=5.3.1
click >=7.1.2

MLOps/serving_patterns/template_pattern/sample/requirements.txt pypi

Pillow >=8.3.2
PyYAML >=5.3.1
fastapi >=0.65.2
future >=0.18.2
gunicorn >=20.0.4
httptools >=0.1.1
importlib-metadata >=1.7.0
joblib >=0.15.1
loguru >=0.5.3
numpy >=1.18.5
onnx >=1.7.0
onnxruntime >=1.4.0
psutil >=5.7.0
pydantic >=1.8.2
python-json-logger >=2.0.1
redis >=3.5.3
scikit-learn >=0.23.1
skl2onnx >=1.7.0
starlette >=0.13.4
typing >=3.7.4.1
uvicorn >=0.11.7
uvloop >=0.14.0

MLOps/serving_patterns/template_pattern/template/requirements.txt pypi

Pillow >=8.3.2
PyYAML >=5.3.1
fastapi >=0.65.2
future >=0.18.2
gunicorn >=20.0.4
httptools >=0.1.1
importlib-metadata >=1.7.0
joblib >=0.15.1
loguru >=0.5.3
numpy >=1.18.5
onnx >=1.7.0
onnxruntime >=1.4.0
psutil >=5.7.0
pydantic >=1.8.2
python-json-logger >=2.0.1
redis >=3.5.3
scikit-learn >=0.23.1
skl2onnx >=1.7.0
starlette >=0.13.4
typing >=3.7.4.1
uvicorn >=0.11.7
uvloop >=0.14.0

MLOps/serving_patterns/web_single_pattern/requirements.txt pypi

Pillow >=8.3.2
PyYAML >=5.3.1
fastapi >=0.65.2
future >=0.18.2
gunicorn >=20.0.4
httptools >=0.1.1
importlib-metadata >=1.7.0
joblib >=0.15.1
loguru >=0.5.3
numpy >=1.18.5
onnx >=1.7.0
onnxruntime >=1.4.0
psutil >=5.7.0
pydantic >=1.8.2
python-json-logger >=2.0.1
redis >=3.5.3
scikit-learn >=0.23.1
skl2onnx >=1.7.0
starlette >=0.13.4
typing >=3.7.4.1
uvicorn >=0.11.7
uvloop >=0.14.0

TrainingTricks/KnowledgeDistillation/src/requirements.txt pypi

datasets *
optuna *
tensorboard *
transformers *

books/deeplearning-models/requirements.txt pypi

IPython *
graphviz *
hiddenlayer *
ipykernel *
matplotlib *
pandas *
pydot *
sklearn *
tensorwatch *
torch *
torchvision *
watermark *

books/fastbook/environment.yml pypi

books/fastbook/requirements.txt pypi

azure-cognitiveservices-search-imagesearch *
fastai >=2.0.0
graphviz *
ipywidgets *
matplotlib *
nbdev >=0.2.12
pandas *
scikit_learn *
sentencepiece *

ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Summary