https://github.com/aws/sagemaker-inference-toolkit

aws deep-learning docker inference machine-learning python sagemaker

Score: 22.374094606068

Last synced: about 23 hours ago
JSON representation

Repository metadata:

Serve machine learning models within a 🐳 Docker container using 🧠 Amazon SageMaker.

Host: GitHub
URL: https://github.com/aws/sagemaker-inference-toolkit
Owner: aws
License: apache-2.0
Archived: true
Created: 2019-05-20T23:11:32.000Z (over 7 years ago)
Default Branch: master
Last Pushed: 2023-11-20T20:07:41.000Z (almost 3 years ago)
Last Synced: 2026-09-28T02:25:18.473Z (about 1 month ago)
Topics: aws, deep-learning, docker, inference, machine-learning, python, sagemaker
Language: Python
Homepage:
Size: 667 KB
Stars: 413
Watchers: 5
Forks: 80
Open Issues: 42
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md

Owner metadata:

Name: Amazon Web Services
Login: aws
Email: open-source-github@amazon.com
Kind: organization
Description:
Website: https://amazon.com/aws
Location: United States of America
Twitter:
Company:
Icon url: https://avatars.githubusercontent.com/u/2232217?v=4
Repositories: 559
Last Synced at: 2026-10-27T08:26:47.152Z
Profile URL: https://github.com/aws

GitHub Events

Total

Fork event: 2
Issue comment event: 3
Issues event: 1
Pull request event: 1
Watch event: 26
Total: 33

Last Year

Watch event: 5
Total: 5

Committers metadata

Last synced: 2 days ago

Total Commits: 157
Total Committers: 25
Avg Commits per committer: 6.28
Development Distribution Score (DDS): 0.414

Commits in past year: 0
Committers in past year: 0
Avg Commits per committer in past year: 0.0
Development Distribution Score (DDS) in past year: 0.0

Name	Email	Commits
ci	c****i	92
Ajay Karpur	a**r@a**m	20
Chuyang	c**g@g**m	7
Dan	c**n@a**m	5
David Thomas	d**p@a**m	4
Lauren Yu	6****u	4
Nikhil Kulkarni	k**9@g**m	4
Karim Nakad	k**d@g**m	2
Aaqib	m**b@g**m	2
Qingzi-Lan	8****n	2
Balaji Veeramani	b**m@a**m	1
Abdelrahman Maharek	1****k	1
Ahmed Kamel	h**z@h**m	1
Balaji Veeramani	b**i@b**u	1
Bastian Zimmermann	1****m	1
Jakob Keller	5****r	1
Kanto	3****e	1
Marcio Vinicius dos Santos	m**p@g**m	1
PabloOb	o**i@p**e	1
akulk314	9****4	1
dhanainme	6****e	1
ericangelokim	3****m	1
rohithkrn	r**i@g**m	1
sachanub	1****b	1
waytrue17	5****7	1

Issue and Pull Request metadata

Last synced: 2 days ago

Total issues: 44
Total pull requests: 70
Average time to close issues: 7 months
Average time to close pull requests: 19 days
Total issue authors: 39
Total pull request authors: 33
Average comments per issue: 2.02
Average comments per pull request: 2.87
Merged pull request: 50
Bot issues: 0
Bot pull requests: 0

Past year issues: 0
Past year pull requests: 0
Past year average time to close issues: N/A
Past year average time to close pull requests: N/A
Past year issue authors: 0
Past year pull request authors: 0
Past year average comments per issue: 0
Past year average comments per pull request: 0
Past year merged pull request: 0
Past year bot issues: 0
Past year bot pull requests: 0

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/aws/sagemaker-inference-toolkit

Top Issue Authors

ericangelokim (3)
ehsanmok (2)
BaoshengHeTR (2)
ddluke (2)
l3ku (1)
athewsey (1)
arvarik (1)
joseproura (1)
kastman (1)
oonisim (1)
dean-cpi (1)
AlexRaschl (1)
Olamyy (1)
akulk314 (1)
nvs-abhilash (1)

Top Pull Request Authors

ajaykarpur (20)
davidthomas426 (6)
nskool (4)
laurenyu (2)
maaquib (2)
Qingzi-Lan (2)
jakob-keller (2)
schenqian (2)
ahakanbaba (2)
chuyang-deng (2)
bveeramani (2)
dhanainme (2)
knakad (2)
andre-marcos-perez (1)
waytrue17 (1)

Top Issue Labels

type: enhancement (10)
type: question (6)
type: documentation (3)
status: pending (2)
type: bug (2)
contribution welcomed (2)
type: UX (1)

Top Pull Request Labels

type: maintenance (7)
type: bug (5)
priority: low (3)
priority: high (3)
type: documentation (2)

Package metadata

Total packages: 6
Total downloads:
- pypi: 268,263 last-month
- conda: 189,833 total
Total dependent packages: 4 (may contain duplicates)
Total dependent repositories: 35 (may contain duplicates)
Total versions: 139
Total maintainers: 1

pypi.org: sagemaker-inference

Open source toolkit for helping create serving containers to run on Amazon SageMaker.

Homepage: https://github.com/aws/sagemaker-inference-toolkit/
Documentation: https://sagemaker-inference.readthedocs.io/
Licenses: Apache License 2.0
Latest release: 1.10.1 (published about 3 years ago)
Last Synced: 2026-10-31T15:04:49.560Z (2 days ago)
Versions: 47
Dependent Packages: 1
Dependent Repositories: 35
Downloads: 268,263 Last month
Docker Downloads: 0
Rankings:
- Downloads: 1.485%
- Dependent repos count: 2.472%
- Average: 3.244%
- Dependent packages count: 3.278%
- Stargazers count: 3.531%
- Docker downloads count: 3.774%
- Forks count: 4.924%
Maintainers (1)
- awsml

proxy.golang.org: github.com/aws/sagemaker-inference-toolkit

Homepage:
Documentation: https://pkg.go.dev/github.com/aws/sagemaker-inference-toolkit#section-documentation
Licenses: apache-2.0
Latest release: v1.10.1 (published about 3 years ago)
Last Synced: 2026-10-31T15:04:07.176Z (2 days ago)
Versions: 42
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent packages count: 5.215%
- Average: 5.39%
- Dependent repos count: 5.565%

pypi.org: sagemaker-inference-gpu

(Altered to work with multi-model-server-gpu) Open source toolkit for helping create serving containers to run on Amazon SageMaker.

Homepage: https://github.com/aws/sagemaker-inference-toolkit/
Documentation: https://sagemaker-inference-gpu.readthedocs.io/
Licenses: Apache License 2.0
Latest release: 1.10.2.dev0 (published about 2 years ago)
Last Synced: 2026-10-31T15:04:04.789Z (2 days ago)
Versions: 1
Dependent Packages: 0
Dependent Repositories: 0
Rankings:
- Dependent packages count: 6.698%
- Average: 22.297%
- Dependent repos count: 37.895%

conda-forge.org: sagemaker-inference

Homepage: https://github.com/aws/sagemaker-inference-toolkit/
Licenses: Apache-2.0
Latest release: 1.7.0 (published about 4 years ago)
Last Synced: 2026-03-20T09:07:53.925Z (8 months ago)
Versions: 9
Dependent Packages: 2
Dependent Repositories: 0
Downloads: 44,886 Total
Rankings:
- Dependent packages count: 19.506%
- Forks count: 20.01%
- Stargazers count: 22.521%
- Average: 24.015%
- Dependent repos count: 34.025%

conda-forge.org: sagemaker-inference-toolkit

Homepage: https://github.com/aws/sagemaker-inference-toolkit/
Licenses: Apache-2.0
Latest release: 1.7.0 (published about 4 years ago)
Last Synced: 2026-03-20T09:07:53.211Z (8 months ago)
Versions: 31
Dependent Packages: 1
Dependent Repositories: 0
Downloads: 114,720 Total
Rankings:
- Forks count: 20.01%
- Stargazers count: 22.521%
- Average: 26.344%
- Dependent packages count: 28.82%
- Dependent repos count: 34.025%

conda-forge.org: sagemaker_inference

Homepage: https://github.com/aws/sagemaker-inference-toolkit/
Licenses: Apache-2.0
Latest release: 1.7.0 (published about 4 years ago)
Last Synced: 2026-03-20T09:08:00.900Z (8 months ago)
Versions: 9
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 30,227 Total
Rankings:
- Forks count: 20.01%
- Stargazers count: 22.521%
- Average: 31.933%
- Dependent repos count: 34.025%
- Dependent packages count: 51.175%

Dependencies

test/container/dummy/Dockerfile docker

awsdeeplearningteam/mxnet-model-server base-cpu-py3.6 build

test/container/mxnet/Dockerfile docker

public.ecr.aws/e2s1w5p1/ubuntu 16.04 build

ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Summary