https://github.com/sgl-project/sglang
attention blackwell cuda deepseek diffusion glm gpt-oss inference llama llm minimax moe qwen qwen-image reinforcement-learning transformer vlm wan
Score: 37.64443749461645
Last synced: about 4 hours ago
JSON representation
Repository metadata:
SGLang is a high-performance serving framework for large language models and multimodal models.
- Host: GitHub
- URL: https://github.com/sgl-project/sglang
- Owner: sgl-project
- License: apache-2.0
- Created: 2024-01-08T04:15:52.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2026-08-24T10:02:01.000Z (1 day ago)
- Last Synced: 2026-08-24T10:57:24.509Z (1 day ago)
- Topics: attention, blackwell, cuda, deepseek, diffusion, glm, gpt-oss, inference, llama, llm, minimax, moe, qwen, qwen-image, reinforcement-learning, transformer, vlm, wan
- Language: Python
- Homepage: https://sglang.io
- Size: 285 MB
- Stars: 32,345
- Watchers: 176
- Forks: 8,149
- Open Issues: 4,910
-
Metadata Files:
- Readme: README.md
- Contributing: docs/CONTRIBUTING.md
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md
- Codeowners: .github/CODEOWNERS
- Agents: docs/AGENTS.md
Owner metadata:
- Name: sgl-project
- Login: sgl-project
- Email:
- Kind: organization
- Description:
- Website:
- Location:
- Twitter:
- Company:
- Icon url: https://avatars.githubusercontent.com/u/147780389?v=4
- Repositories: 1
- Last Synced at: 2024-01-16T17:09:39.645Z
- Profile URL: https://github.com/sgl-project
Committers metadata
Last synced: 6 days ago
Total Commits: 16,842
Total Committers: 1,624
Avg Commits per committer: 10.371
Development Distribution Score (DDS): 0.927
Commits in past year: 12,101
Committers in past year: 1,266
Avg Commits per committer in past year: 9.558
Development Distribution Score (DDS) in past year: 0.933
| Name | Commits | |
|---|---|---|
| Lianmin Zheng | l****g@g****m | 1225 |
| Liangsheng Yin | h****2@g****m | 986 |
| fzyzcjy | 5****y | 840 |
| Yineng Zhang | m****e@z****m | 784 |
| Mick | m****9@i****m | 576 |
| Xiaoyu Zhang | 3****f | 513 |
| Simo Lin | l****k@g****m | 455 |
| Baizhou Zhang | s****g@g****m | 406 |
| Ke Bao | i****e@g****m | 321 |
| Cheng Wan | 5****n | 321 |
| Alison Shao | 5****o | 277 |
| Kangyan-Zhou | z****1@g****m | 219 |
| Xinyuan Tong | 1****3 | 214 |
| Chang Su | c****u@o****m | 212 |
| Ying Sheng | s****5@g****m | 188 |
| Brayden Zhong | b****g@u****a | 187 |
| Shangming Cai | c****u@g****m | 185 |
| Mohammad Miadh Angkad | 1****d | 174 |
| Qiaolin Yu | l****1@o****m | 160 |
| YC Yen-Ching Tseng | y****g@a****m | 140 |
| Byron Hsu | b****0@g****m | 140 |
| Yuan Luo | y****o@h****m | 134 |
| Yuhao Yang | 4****1 | 125 |
| Zhangheng | h****5@a****g | 109 |
| sglang-bot | s****t@g****m | 103 |
| Khoa Pham | k****m@r****i | 97 |
| Michael | 1****i | 96 |
| shuwenn | 4****1 | 92 |
| YAMY | 7****4 | 90 |
| zijiexia | 3****a | 87 |
| and 1594 more... | ||
Issue and Pull Request metadata
Last synced: about 6 hours ago
Total issues: 3,055
Total pull requests: 10,512
Average time to close issues: about 1 month
Average time to close pull requests: 6 days
Total issue authors: 1,590
Total pull request authors: 1,362
Average comments per issue: 2.06
Average comments per pull request: 1.43
Merged pull request: 6,070
Bot issues: 0
Bot pull requests: 6
Past year issues: 330
Past year pull requests: 1,853
Past year average time to close issues: 11 days
Past year average time to close pull requests: 22 days
Past year issue authors: 228
Past year pull request authors: 656
Past year average comments per issue: 1.96
Past year average comments per pull request: 2.0
Past year merged pull request: 545
Past year bot issues: 0
Past year bot pull requests: 0
Top Issue Authors
- zhyncs (153)
- zhaochenyang20 (56)
- merrymercy (32)
- CatherineSue (27)
- whybeyoung (26)
- JustinTong0323 (22)
- CSEEduanyu (22)
- lifuhuang (20)
- Fridge003 (20)
- hnyls2002 (19)
- slin1237 (18)
- Swipe4057 (18)
- HaiShaw (17)
- hebiao064 (16)
- fzyzcjy (16)
Top Pull Request Authors
- merrymercy (1,192)
- zhyncs (1,014)
- fzyzcjy (550)
- hnyls2002 (283)
- BBuf (244)
- Ying1123 (231)
- ispobock (221)
- ByronHsu (217)
- mickqian (163)
- zhaochenyang20 (148)
- slin1237 (133)
- Fridge003 (132)
- CatherineSue (128)
- ch-wan (114)
- HaiShaw (109)
Top Issue Labels
- inactive (665)
- high priority (156)
- good first issue (118)
- help wanted (114)
- bug (91)
- deepseek (41)
- enhancement (36)
- documentation (28)
- feature (27)
- lora (25)
- router (20)
- await-response (19)
- amd (18)
- performance (17)
- collaboration (17)
- quant (12)
- speculative-decoding (12)
- visIon-LM (12)
- flashinfer (11)
- RLHF (6)
- backlog (6)
- Multi-modal (6)
- ci (6)
- blackwell (6)
- run-ci (5)
- v100 (3)
- new-model (3)
- unable-reproduce (3)
- low-priority (2)
- Refactor (1)
Top Pull Request Labels
- high priority (707)
- run-ci (624)
- documentation (205)
- ready-to-merge (202)
- jit-kernel (134)
- diffusion (133)
- deepseek (104)
- quant (99)
- router (95)
- run-ci-extra (91)
- npu (88)
- amd (68)
- hicache (57)
- enhancement (56)
- bug (56)
- bypass-fastfail (56)
- dependencies (51)
- intel (48)
- Multi-modal (45)
- blackwell (44)
- sgl-kernel (44)
- speculative-decoding (40)
- lora (39)
- await-response (38)
- cpu (33)
- feature (24)
- apple-silicon (23)
- visIon-LM (21)
- performance (20)
- collaboration (19)
Package metadata
- Total packages: 12
-
Total downloads:
- pypi: 368,978,339 last-month
- Total dependent packages: 0 (may contain duplicates)
- Total dependent repositories: 0 (may contain duplicates)
- Total versions: 413
- Total maintainers: 12
- Total advisories: 10
proxy.golang.org: github.com/sgl-project/sglang
- Homepage:
- Documentation: https://pkg.go.dev/github.com/sgl-project/sglang#section-documentation
- Licenses: apache-2.0
- Latest release: v1.1.1 (published over 1 year ago)
- Last Synced: 2026-08-24T12:16:32.323Z (1 day ago)
- Versions: 72
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent packages count: 6.528%
- Average: 6.747%
- Dependent repos count: 6.966%
pypi.org: sglang-kt
SGLang is a fast serving framework for large language models and vision language models.
- Homepage: https://github.com/sgl-project/sglang
- Documentation: https://sglang-kt.readthedocs.io/
- Licenses: Apache Software License
- Latest release: 0.7.0 (published 7 days ago)
- Last Synced: 2026-08-24T12:12:20.281Z (1 day ago)
- Versions: 15
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 1,723 Last month
-
Rankings:
- Forks count: 0.275%
- Stargazers count: 0.337%
- Dependent packages count: 7.693%
- Downloads: 11.473%
- Average: 12.656%
- Dependent repos count: 43.499%
- Maintainers (1)
pypi.org: sgltmp
SGLang is yet another fast serving framework for large language models and vision language models.
- Homepage: https://github.com/sgl-project/sglang
- Documentation: https://sgltmp.readthedocs.io/
- Licenses: Apache Software License
- Latest release: 0.5.1.post4 (published about 1 year ago)
- Last Synced: 2026-08-24T12:12:03.397Z (1 day ago)
- Versions: 3
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 9 Last month
-
Rankings:
- Stargazers count: 0.507%
- Forks count: 0.547%
- Dependent packages count: 8.64%
- Average: 14.595%
- Dependent repos count: 48.686%
- Maintainers (1)
pypi.org: dblcsgen
DBLC Fast Structured Generation
- Homepage: https://github.com/sgl-project/sglang
- Documentation: https://dblcsgen.readthedocs.io/
- Licenses: Apache Software License
- Latest release: 0.2.11 (published over 2 years ago)
- Last Synced: 2026-08-24T12:12:04.123Z (1 day ago)
- Versions: 17
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 22 Last month
-
Rankings:
- Stargazers count: 2.123%
- Forks count: 5.42%
- Dependent packages count: 9.553%
- Average: 20.031%
- Dependent repos count: 63.026%
- Maintainers (1)
pypi.org: lsglang
SGLang is a fast serving framework for large language models and vision language models.
- Homepage: https://github.com/sgl-project/sglang
- Documentation: https://lsglang.readthedocs.io/
- Licenses: Apache Software License
- Latest release: 1.4.10 (published 3 days ago)
- Last Synced: 2026-08-24T12:12:06.645Z (1 day ago)
- Versions: 13
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 482 Last month
-
Rankings:
- Dependent packages count: 7.082%
- Average: 23.572%
- Dependent repos count: 40.061%
- Maintainers (1)
pypi.org: amd-sglang
SGLang is a fast serving framework for large language models and vision language models.
- Homepage: https://github.com/sgl-project/sglang
- Documentation: https://amd-sglang.readthedocs.io/
- Licenses: Apache Software License
- Latest release: 0.5.6.post1 (published 7 months ago)
- Last Synced: 2026-08-24T12:12:21.953Z (1 day ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 37 Last month
-
Rankings:
- Dependent packages count: 7.828%
- Average: 26.143%
- Downloads: 26.339%
- Dependent repos count: 44.261%
pypi.org: sglang-cpu
SGLang is a fast serving framework for large language models and vision language models.
- Homepage: https://github.com/sgl-project/sglang
- Documentation: https://sglang-cpu.readthedocs.io/
- Licenses: Apache Software License
- Latest release: 0.5.7 (published 7 months ago)
- Last Synced: 2026-08-24T12:12:21.826Z (1 day ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 83 Last month
-
Rankings:
- Dependent packages count: 7.872%
- Average: 26.189%
- Dependent repos count: 44.505%
- Maintainers (1)
pypi.org: sglang-kernel
Kernel Library for SGLang
- Homepage: https://github.com/sgl-project/sglang/tree/main/python/sglang/kernels/aot
- Documentation: https://sglang-kernel.readthedocs.io/
- Licenses: Apache Software License
- Latest release: 0.4.6 (published 20 days ago)
- Last Synced: 2026-08-24T12:14:56.727Z (1 day ago)
- Versions: 18
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 844,986 Last month
-
Rankings:
- Dependent packages count: 8.273%
- Average: 27.516%
- Dependent repos count: 46.76%
- Maintainers (3)
pypi.org: sgl-kernel
Kernel Library for SGLang
- Homepage: https://github.com/sgl-project/sglang/tree/main/sgl-kernel
- Documentation: https://sgl-kernel.readthedocs.io/
- Licenses: Apache Software License
- Latest release: 0.3.21 (published 7 months ago)
- Last Synced: 2026-08-24T12:14:00.623Z (1 day ago)
- Versions: 113
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 122,812 Last month
-
Rankings:
- Dependent packages count: 9.95%
- Average: 32.977%
- Dependent repos count: 56.004%
- Maintainers (1)
pypi.org: mytempsgdepfix
A structured generation langauge for LLMs.
- Homepage: https://github.com/sgl-project/sglang
- Documentation: https://mytempsgdepfix.readthedocs.io/
- Licenses: Apache Software License
- Latest release: 0.1.12 (published over 2 years ago)
- Last Synced: 2026-08-24T12:12:23.502Z (1 day ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 23 Last month
-
Rankings:
- Dependent packages count: 9.728%
- Average: 36.955%
- Dependent repos count: 64.182%
- Maintainers (1)
pypi.org: sgtempdepfix
A structured generation langauge for LLMs.
- Homepage: https://github.com/sgl-project/sglang
- Documentation: https://sgtempdepfix.readthedocs.io/
- Licenses: Apache Software License
- Latest release: 0.1.12 (published over 2 years ago)
- Last Synced: 2026-08-24T12:12:24.131Z (1 day ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent packages count: 9.728%
- Average: 36.955%
- Dependent repos count: 64.182%
- Maintainers (1)
pypi.org: sglang
SGLang is a fast serving framework for large language models and vision language models.
- Homepage: https://github.com/sgl-project/sglang
- Documentation: https://sglang.readthedocs.io/
- Licenses: Apache Software License
- Latest release: 0.5.18 (published 4 days ago)
- Last Synced: 2026-08-24T12:17:18.842Z (1 day ago)
- Versions: 158
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 368,008,162 Last month
-
Rankings:
- Dependent packages count: 10.043%
- Average: 38.169%
- Dependent repos count: 66.295%
- Maintainers (3)
-
Advisories:
- SGLang is Vulnerable to DoS via the data_hash Function
- SGLang: Reachable Assertion via lora_path in LoRAManager enables remote Denial of Dervice
- SGLanG: Multimodal scheduler deserializes untrusted pickle data on 0.0.0.0 ROUTER socket
- SGLang: Unauthenticated RCE via --enable-custom-logit-processor
- SGLang's multimodal generation runtime has an unauthenticated path traversal vulnerability
- SGLang has an Improper Input Validation/Injection Issue
- SGLang's encoder parallel disaggregation system is vulnerable to unauthenticated remote code execution through the disaggregation module
- SGLangs `replay_request_dump.py` contains an insecure pickle.load() without validation and proper deserialization
- SGLang's multimodal generation module is vulnerable to unauthenticated remote code execution through the ZMQ broker
- SGLang Remote Code Execution Vulnerability via Unsafe Deserialization in update_weights_from_tensor
Dependencies
python/pyproject.toml
pypi
- requests *
.github/workflows/close-inactive-issues.yml
actions
- actions/github-script v6 composite
.github/workflows/lint.yml
actions
- actions/checkout v2 composite
- actions/setup-python v4 composite
.github/workflows/pr-test-amd.yml
actions
- actions/checkout v3 composite
.github/workflows/pr-test-rust.yml
actions
- actions/checkout v3 composite
.github/workflows/pr-test.yml
actions
- actions/checkout v3 composite
.github/workflows/release-docker.yml
actions
- actions/checkout v3 composite
- docker/login-action v2 composite
.github/workflows/release-pypi.yml
actions
- actions/checkout v3 composite
- actions/setup-python v4 composite
rust/Cargo.lock
cargo
- 229 dependencies
rust/Cargo.toml
cargo
docker/Dockerfile
docker
- nvidia/cuda ${CUDA_VERSION}-devel-ubuntu20.04 build
examples/frontend_language/usage/triton/Dockerfile
docker
- nvcr.io/nvidia/tritonserver 24.01-py3 build
.github/actions/download-rust-ext/action.yml
actions
- actions/cache/restore v4 composite
- actions/download-artifact v4 composite
.github/actions/wait-for-jobs/action.yml
actions
- actions/github-script v8 composite
.github/workflows/_pr-test-stage.yml
actions
- ./.github/actions/check-maintenance * composite
- ./.github/actions/check-pr-test-health * composite
- ./.github/actions/download-rust-ext * composite
- ./.github/actions/upload-cuda-coredumps * composite
- actions/checkout v4 composite
- actions/download-artifact v4 composite
- actions/download-artifact v6 composite
- actions/upload-artifact v4 composite
.github/workflows/bot-bump-kernel-version.yml
actions
- actions/checkout v4 composite
- actions/setup-python v5 composite
.github/workflows/open-pr-copy-to-oss.yml
actions
- actions/checkout v4 composite
.github/workflows/bot-cherry-pick.yml
actions
- actions/checkout v4 composite
.github/workflows/list-active-pr-runs.yml
actions
.github/workflows/pr-test-sgl-router.yml
actions
- Swatinem/rust-cache v2 composite
- actions/checkout v4 composite
- docker/setup-buildx-action v3 composite
- dorny/paths-filter v3 composite
- mozilla-actions/sccache-action v0.0.9 composite
.github/workflows/release-branch-cut.yml
actions
- actions/checkout v4 composite
experimental/sgl-router/Cargo.toml
cargo
- criterion 0.5 development
- dirs 5 development
- http-body-util 0.1 development
- rand 0.8 development
- rmp 0.8 development
- serde 1 development
- serde_json 1 development
- tempfile 3 development
- tokio 1.42 development
- tower 0.5 development
- anyhow 1
- axum 0.8
- bytes 1
- chrono 0.4
- clap 4
- dashmap 6
- futures 0.3
- hf-hub 0.4
- k8s-openapi 0.23
- kube 0.96
- minijinja 2
- minijinja-contrib 2
- parking_lot 0.12
- rand 0.8
- reqwest 0.12
- rmp-serde 1
- serde 1
- serde_json 1
- sha2 0.10
- thiserror 2
- tokio 1.42
- tokio-stream 0.1
- tokio-util 0.7
- tower 0.5
- tower-http 0.6
- tracing 0.1
- tracing-subscriber 0.3
- url 2
- uuid 1
- zeromq 0.6
.github/actions/upload-cuda-coredumps/action.yml
actions
- actions/upload-artifact v4 composite
.github/workflows/_npu-single-node-test-stage.yml
actions
- actions/checkout v4 composite
- actions/github-script v8 composite
.github/workflows/_pr-test-check-changes.yml
actions
- ./.github/actions/check-maintenance * composite
- actions/checkout v4 composite
- dorny/paths-filter v3 composite
.github/workflows/amd-ci-job-monitor.yml
actions
- actions/checkout v4 composite
- actions/download-artifact v4 composite
- actions/setup-python v5 composite
- actions/upload-artifact v4 composite
.github/workflows/bot-bump-sglang-version.yml
actions
- actions/checkout v4 composite
- actions/setup-python v5 composite
.github/workflows/auto-tune.yml
actions
- actions/checkout v4 composite
.github/workflows/ci-auto-bisect.yml
actions
- actions/checkout v4 composite
- actions/setup-python v5 composite
- actions/upload-artifact v4 composite
.github/workflows/nightly-test-intel.yml
actions
- actions/checkout v4 composite
.github/workflows/cancel-unfinished-pr-tests.yml
actions
.github/workflows/ci-coverage-overview.yml
actions
- actions/checkout v4 composite
- actions/setup-python v5 composite
- actions/upload-artifact v4 composite
.github/workflows/diffusion-ci-gt-gen-npu.yml
actions
- actions/checkout v4 composite
- actions/setup-python v5 composite
- actions/upload-artifact v4 composite
.github/workflows/patch-docker-dev.yml
actions
- actions/checkout v4 composite
- docker/login-action v2 composite
.github/workflows/_pr-test-stage-cpu.yml
actions
- ./.github/actions/check-maintenance * composite
- ./.github/actions/check-pr-test-health * composite
- ./.github/actions/download-rust-ext * composite
- Swatinem/rust-cache v2 composite
- actions/cache/restore v4 composite
- actions/cache/save v4 composite
- actions/checkout v4 composite
- actions/setup-python v5 composite
- astral-sh/setup-uv v5 composite
.github/workflows/pr-test-sgl-kernel.yml
actions
- ./.github/actions/check-maintenance * composite
- ./.github/actions/check-pr-test-health * composite
- ./.github/actions/download-rust-ext * composite
- actions/checkout v4 composite
- actions/download-artifact v4 composite
rust/sglang-grpc/Cargo.toml
cargo
.github/workflows/pr-test-mlx.yml
actions
- actions/checkout v4 composite
- actions/setup-python v5 composite
- astral-sh/setup-uv v5 composite
- dorny/paths-filter v3 composite
.github/workflows/release-docker-amd-miles-rocm720-nightly.yml
actions
- actions/checkout v4 composite
- docker/login-action v2 composite
.github/workflows/release-docker-amd-rocm7_15-nightly.yml
actions
- actions/checkout v4 composite
- actions/setup-python v5 composite
- docker/login-action v2 composite
.github/workflows/release-docker-runtime.yml
actions
.github/workflows/release-pypi-nightly.yml
actions
- actions/checkout v4 composite
- actions/download-artifact v4 composite
- actions/setup-python v5 composite
- actions/upload-artifact v4 composite
- softprops/action-gh-release v2 composite
.github/workflows/release-tag.yml
actions
- actions/checkout v4 composite
.github/workflows/retag-docker.yml
actions
- docker/login-action v2 composite
.github/workflows/cancel-pr-workflows-on-close.yml
actions
.github/workflows/nightly-link-check.yml
actions
- actions/checkout v4 composite
- lycheeverse/lychee-action 8646ba30535128ac92d33dfc9133794bfdd9b411 composite
.github/workflows/release-docker-amd-miles-rocm700-nightly.yml
actions
- actions/checkout v4 composite
- docker/login-action v2 composite
.github/workflows/xpu-ci-job-monitor.yml
actions
- actions/checkout v4 composite
- actions/download-artifact v4 composite
- actions/setup-python v5 composite
- actions/upload-artifact v4 composite
sgl-model-gateway/bindings/golang/Cargo.toml
cargo
python/sglang/kernels/aot/pyproject.toml
pypi
.github/workflows/bot-bump-kernel-version-to-sglang.yml
actions
- actions/checkout v4 composite
- actions/setup-python v5 composite
.github/workflows/ci-model-inventory.yml
actions
- actions/checkout v4 composite
- actions/setup-python v5 composite
- actions/upload-artifact v4 composite
.github/workflows/labeler.yml
actions
- actions/labeler v5 composite
.github/workflows/release-docker-amd.yml
actions
- actions/checkout v4 composite
- docker/login-action v2 composite
.github/workflows/release-docker-gateway.yml
actions
- actions/checkout v4 composite
- docker/login-action v3 composite
- docker/setup-buildx-action v3 composite
- docker/setup-qemu-action v3 composite
.github/workflows/release-pypi-pr.yml
actions
- actions/checkout v4 composite
- actions/download-artifact v4 composite
- actions/setup-python v5 composite
- actions/upload-artifact v4 composite
- softprops/action-gh-release v2 composite
.github/workflows/release-whl-deepep.yml
actions
- actions/checkout v4 composite
- actions/download-artifact v4 composite
- actions/upload-artifact v4 composite
- softprops/action-gh-release v2 composite
.github/workflows/seed-rust-ext-cache.yml
actions
.github/workflows/_npu-pr-test-stage.yml
actions
- actions/checkout v4 composite
- actions/github-script v8 composite
.github/workflows/_pr-test-sgl-kernel-build.yml
actions
- ./.github/actions/check-maintenance * composite
- actions/checkout v4 composite
- actions/setup-python v5 composite
- actions/upload-artifact v4 composite
.github/workflows/nightly-72-gpu-gb200.yml
actions
- actions/checkout v4 composite
- actions/download-artifact v4 composite
- actions/upload-artifact v4 composite
- docker/login-action v3 composite
- docker/setup-buildx-action v3 composite
.github/workflows/pr-test-arm64.yml
actions
- actions/checkout v4 composite
- dorny/paths-filter v3 composite
.github/workflows/pr-test-npu.yml
actions
- actions/checkout v4 composite
- actions/upload-artifact v4 composite
- dorny/paths-filter v3 composite
.github/workflows/pr-test-xeon.yml
actions
- actions/checkout v4 composite
- dorny/paths-filter v3 composite
.github/workflows/_docker-build-and-publish.yml
actions
- actions/checkout v4 composite
- docker/login-action v2 composite
- docker/setup-buildx-action v3 composite
- jlumbroso/free-disk-space main composite
sgl-model-gateway/bindings/python/setup.py
pypi
sgl-model-gateway/e2e_test/pyproject.toml
pypi
- grpcio *
- grpcio-health-checking *
- httpx *
- openai *
- pytest *
- pytest-rerunfailures *
.github/workflows/nightly-test-amd-rocm720.yml
actions
- actions/checkout v4 composite
- actions/upload-artifact v4 composite
.github/workflows/pr-test-xpu.yml
actions
- actions/checkout v4 composite
- dorny/paths-filter v3 composite
sgl-model-gateway/Cargo.toml
cargo
- criterion 0.5 development
- http-body-util 0.1 development
- lazy_static 1.4 development
- npyz 0.8 development
- opentelemetry-proto 0.27 development
- portpicker 0.1 development
- rsa 0.9 development
- serial_test 3.0 development
- tempfile 3.8 development
- tonic-v12 0.12.3 development
- tower 0.5 development
- wasm-encoder 0.242 development
- anyhow 1.0
- arc-swap 1.7.1
- async-trait 0.1
- axum 0.8.6
- axum-server 0.8.0
- base64 0.22
- bitflags 2.10.0
- blake3 1.5
- bytemuck 1.21
- bytes 1.8.0
- chrono 0.4
- clap 4
- crdts 7.3
- dashmap 6.1.0
- data-connector =1.0.0
- futures 0.3
- futures-util 0.3
- http 1.1.0
- http-body 1.0
- jsonwebtoken 9.3
- k8s-openapi 0.25.0
- kube 1.1.0
- llm-tokenizer =1.3.2
- memchr 2.7
- metrics 0.24.2
- metrics-exporter-prometheus 0.17.0
- num-bigint 0.4
- num-traits 0.2
- once_cell 1.21.3
- openai-protocol =1.0.0
- openmetrics-parser 0.4.4
- openssl 0.10.73
- opentelemetry 0.27
- opentelemetry-otlp 0.27
- opentelemetry_sdk 0.27
- parking_lot 0.12.4
- prost 0.14.1
- prost-types 0.14.1
- rand 0.9.2
- reasoning-parser =1.0.0
- redis 0.27.6
- regex 1.10
- reqwest 0.12.8
- rmcp 0.8.3
- rustls 0.23
- rustls-pemfile 2.2
- serde 1.0
- serde_json 1.0
- serde_yaml 0.9
- sha2 0.10
- smg-auth =1.0.0
- smg-grpc-client =1.0.0
- smg-mcp =1.0.0
- smg-mesh =1.0.0
- smg-wasm =1.0.0
- subtle 2.6
- thiserror 2.0.12
- tokio 1.42.0
- tokio-stream 0.1
- tonic 0.14.2
- tonic-prost 0.14.2
- tool-parser =1.0.0
- tower 0.5
- tower-http 0.6
- tracing 0.1
- tracing-appender 0.2.3
- tracing-log 0.2
- tracing-opentelemetry 0.28
- tracing-subscriber 0.3
- url 2.5.4
- uuid 1.10
- validator 0.20.0
- wasmtime 38.0
- wfaas =1.0.0
- xxhash-rust 0.8
sgl-model-gateway/examples/wasm/wasm-guest-auth/Cargo.toml
cargo
experimental/sgl-router/tests/e2e/k8s_integration/requirements.txt
pypi
- httpx ==0.27.2 test
- pytest ==8.3.3 test
.github/actions/check-pr-test-health/action.yml
actions
- actions/github-script v8 composite
.github/workflows/nightly-test-amd.yml
actions
- actions/checkout v4 composite
- actions/upload-artifact v4 composite
sgl-model-gateway/examples/wasm/wasm-guest-ratelimit/Cargo.toml
cargo
.github/workflows/_pr-test-rust-ext-build.yml
actions
- ./.github/actions/check-maintenance * composite
- actions/cache/restore v4 composite
- actions/cache/save v4 composite
- actions/checkout v4 composite
- actions/setup-python v5 composite
- actions/upload-artifact v4 composite
.github/workflows/ci-failure-monitor.yml
actions
- actions/checkout v4 composite
- actions/setup-python v5 composite
- actions/upload-artifact v4 composite
.github/workflows/nightly-amd-mi355x-disagg.yml
actions
.github/workflows/pr-test-amd-extra.yml
actions
- actions/checkout v4 composite
.github/workflows/pr-test-amd-rocm720.yml
actions
- actions/checkout v4 composite
- actions/download-artifact v4 composite
- actions/upload-artifact v4 composite
- dorny/paths-filter v3 composite
.github/workflows/pr-test-jit-kernel.yml
actions
- ./.github/actions/check-maintenance * composite
- ./.github/actions/check-pr-test-health * composite
- ./.github/actions/download-rust-ext * composite
- actions/checkout v4 composite
- actions/download-artifact v4 composite
.github/workflows/pr-test-musa.yml
actions
- actions/checkout v4 composite
- dorny/paths-filter v3 composite
.github/actions/check-maintenance/action.yml
actions
.github/workflows/diffusion-ci-gt-gen.yml
actions
- actions/checkout v4 composite
- actions/download-artifact v4 composite
- actions/setup-python v5 composite
- actions/upload-artifact v4 composite
.github/workflows/full-test-npu.yml
actions
- actions/checkout v4 composite
.github/workflows/nightly-release-gateway.yml
actions
- PyO3/maturin-action v1 composite
- actions/checkout v4 composite
- actions/download-artifact v4 composite
- actions/setup-python v5 composite
- actions/upload-artifact v4 composite
.github/workflows/nightly-test-npu-e2e-single-node.yml
actions
- actions/checkout v4 composite
- actions/upload-artifact v4 composite
.devcontainer/Dockerfile
docker
- lmsysorg/sglang dev build
sgl-model-gateway/bindings/golang/examples/oai_server/go.mod
go
- github.com/andybalholm/brotli v1.1.0
- github.com/klauspost/compress v1.17.9
- github.com/sglang/sglang-go-grpc-sdk v0.0.0-00010101000000-000000000000
- github.com/stretchr/testify v1.10.0
- github.com/valyala/bytebufferpool v1.0.0
- github.com/valyala/fasthttp v1.52.0
- go.uber.org/multierr v1.10.0
- go.uber.org/zap v1.27.0
- golang.org/x/net v0.46.1-0.20251013234738-63d1a5100f82
- golang.org/x/sys v0.37.0
- golang.org/x/text v0.30.0
- google.golang.org/genproto/googleapis/rpc v0.0.0-20251022142026-3a174f9686a8
- google.golang.org/grpc v1.77.0
- google.golang.org/protobuf v1.36.10
- gopkg.in/natefinch/lumberjack.v2 v2.2.1
.github/workflows/_docker-cleanup-nightly.yml
actions
.github/workflows/bot-bump-flashinfer-version.yml
actions
- actions/checkout v4 composite
- actions/setup-python v5 composite
.github/workflows/nightly-test-amd-miles-rocm720.yml
actions
- actions/checkout v4 composite
- docker/login-action v2 composite
.github/workflows/nightly-test-nvidia.yml
actions
- ./.github/actions/upload-cuda-coredumps * composite
- actions/checkout v4 composite
- actions/download-artifact v4 composite
- actions/upload-artifact v4 composite
.github/workflows/pr-states.yml
actions
- actions/github-script v8 composite
.github/workflows/amd-aiter-scout.yml
actions
.github/workflows/bot-bump-docs-version.yml
actions
- actions/checkout v4 composite
- actions/setup-python v5 composite
.github/workflows/nightly-test-musa.yml
actions
- actions/checkout v4 composite
.github/workflows/nightly-test-npu-e2e-multi-node.yml
actions
- actions/checkout v4 composite
- actions/upload-artifact v4 composite
.github/workflows/open-pr-copy-from-oss.yml
actions
- actions/checkout v4 composite
.github/workflows/pr-benchmark-rust.yml
actions
- Swatinem/rust-cache v2 composite
- actions/checkout v4 composite
- actions/download-artifact v4 composite
- actions/upload-artifact v4 composite
- mozilla-actions/sccache-action v0.0.9 composite