nixpkgs-unstable: vllm

High-throughput and memory-efficient inference and serving engine for LLMs

• Homepage: https://github.com/vllm-project/vllm
• Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-unstable/pkgs/development/python-modules/vllm/default.nix#L585
• Licenses: Apache-2.0
• Latest release: 0.15.1 (published 8 months ago)
• Last Synced: 2026-10-12T20:26:30.075Z (14 days ago)
• Versions: 2
• Dependent Packages: 0
• Dependent Repositories: 0
• Rankings:
  • Dependent repos count: 0.0%
  • Dependent packages count: 0.0%
  • Average: 0.034%
  • Forks count: 0.053%
  • Stargazers count: 0.084%
• Maintainers (4)
  • happysalada
  • LunNova
  • daniel-fahey
  • CertainLach

nixpkgs-unstable: python314Packages.vllm

High-throughput and memory-efficient inference and serving engine for LLMs

• Homepage: https://github.com/vllm-project/vllm
• Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-unstable/pkgs/development/python-modules/vllm/default.nix#L585
• Licenses: Apache-2.0
• Latest release: 0.15.1 (published 8 months ago)
• Last Synced: 2026-08-13T15:34:22.598Z (2 months ago)
• Versions: 2
• Dependent Packages: 0
• Dependent Repositories: 0
• Rankings:
  • Dependent repos count: 0.0%
  • Dependent packages count: 0.0%
  • Average: 0.034%
  • Forks count: 0.053%
  • Stargazers count: 0.085%
• Maintainers (4)
  • happysalada
  • LunNova
  • daniel-fahey
  • CertainLach

pypi.org: vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

• Homepage: https://github.com/vllm-project/vllm
• Documentation: https://docs.vllm.ai/en/latest/
• Licenses: Apache-2.0
• Latest release: 0.32.0 (published 8 days ago)
• Last Synced: 2026-10-25T15:15:57.077Z (1 day ago)
• Versions: 100
• Dependent Packages: 46
• Dependent Repositories: 5
• Downloads: 1,857,414 Last month
• Docker Downloads: 16,137
• Rankings:
  • Stargazers count: 0.327%
  • Downloads: 1.489%
  • Forks count: 1.559%
  • Docker downloads count: 3.168%
  • Average: 3.449%
  • Dependent repos count: 6.776%
  • Dependent packages count: 7.373%
• Maintainers (3)
  • youkaichao
  • wskwon
  • zhuohan123
• Advisories:
  • vLLM : DoS via unvalidated mm_processor_kwargs in multimodal image processors (Isaac, InternVL, H2OVL, etc.)
  • vLLM: Forged multimodal UUID + P0/P1 processor-cache eviction drift: unauthenticated remote crash of the whole vLLM engine
  • Duplicate Advisory: vLLM 0.7.3 before 0.31.0 DoS via Unvalidated mm_processor_kwargs
  • Duplicate Advisory: vLLM vulnerable to remote denial of service through forged multimodal UUID cache desynchronization
  • vLLM: Mirrored multimodal IPC caches desync after a rejected request — a later request reusing the same media hash trips a receiver assertion in the engine core
  • vLLM: Harmony tool continuations drop `cache_salt` — restoring a cross-tenant prefix-cache membership oracle
  • vLLM: Qwen2-VL / Qwen3-VL video samplers bound on request-controlled max_frames, which the num_frames ceiling does not reach
  • vLLM: GLMGA video sampling permits request-driven CPU and memory exhaustion
  • vLLM: Scale-out disaggregated multimodal transport trusts caller-supplied features
  • vLLM: Structured-output request errors escape the request boundary and terminate the shared EngineCore — engine-fatal denial of service (3 sites)
  • vLLM: Flash late-interaction scoring caches query embeddings under a caller-controlled request id — cross-request integrity break and induced errors on `/score` and `/rerank`
  • vLLM: Loose `cache_salt` validation lets a single request kill EngineCore on LMCache-MP deployments — uncaught downstream `ValueError` denial of service
  • vLLM: Request-selected PyNvVideoCodec GPU decode bypasses static VRAM reservation
  • vLLM: Unauthenticated audio decompression-bomb DoS in /v1/chat/completions
  • vLLM: SSRF + arbitrary local file read in MiMoV2OmniMultiModalProcessor `_fetch_image` and audio loader bypass MediaConnector protections
  • vLLM: Cross-User Data Leak Vulnerability
  • vLLM: Incomplete CVE-2025-62164 remediation can be bypassed by concurrent prompt parts
  • vLLM: ReDoS via structured_outputs.regex in the lm-format-enforcer backend (no compile timeout) — missed sibling of GHSA-rwxx-mrjm-wc2m
  • vLLM: Unauthenticated Internal Path and Username Disclosure via Validation Error Messages
  • vLLM: Derender endpoints decode caller-supplied GenerateResponse token IDs without output bounds
  • vLLM: Completion prompt lists fan out into unbounded engine requests
  • vLLM denial of service via prompt embeds on M-RoPE models
  • vLLM: Speech-to-text upload size limit is enforced after full UploadFile read
  • vLLM: ReDoS via structured_outputs.regex compiled without timeout in xgrammar and outlines backends
  • vLLM has Remote DoS via Invalid Recovered Token Reinjection
  • vLLM: Processing differential in multi-channel audio downmixing enables hidden-input/moderation bypass for audio models
  • Duplicate Advisory: vLLM introduced enhanced protection for CVE-2025-62164
  • Duplicate Advisory: vLLM Vulnerable to Regular Expression Denial of Service
  • Duplicate Advisory: image EXIF Rotation & PNG tRNS Transparency Not Normalized, Causing Mismatch Between Model Input and Expectations
  • vLLM: OOM Denial of Service via Audio Decompression Bomb
  • vLLM: incomplete CVE-2026-22778 fix leaks PIL repr addresses via Anthropic router
  • vLLM: GGUF dequantize kernel int truncation exposes uninitialized GPU memory in multi-tenant serving
  • vLLM: image EXIF Rotation & PNG tRNS Transparency Not Normalized, Causing Mismatch Between Model Input and Expectations
  • vLLM: temperature=NaN and temperature=Infinity bypass validation and propagate to GPU kernels
  • vLLM: OpenAI auth bypass
  • vLLM: Security Check Bypass via assert Statement in Activation Function Loading Allows Arbitrary Code Execution
  • vLLM is vulnerable to an Out-of-Memory (OOM) Denial of Service (DoS) attack due to unbounded frame count processing in the `VideoMediaIO.load_base64()` method
  • vLLM's Artifact Pin Decay allows pinned deployments to load unpinned code, weights, and processors
  • vllm has Improper Resource Shutdown or Release
  • vLLM: extract_hidden_states speculative decoding crashes server on any request with penalty parameters
  • vLLM Vulnerable to Remote DoS via Special-Token Placeholders
  • vLLM makes Use of Uninitialized Resource
  • vLLM: Denial of Service via Unbounded Frame Count in video/jpeg Base64 Processing
  • vLLM: Server-Side Request Forgery (SSRF) in `download_bytes_from_url `
  • vLLM: Unauthenticated OOM Denial of Service via Unbounded `n` Parameter in OpenAI API Server
  • vLLM has Hardcoded Trust Override in Model Files Enables RCE Despite Explicit User Opt-Out
  • vLLM has SSRF Protection Bypass
  • vLLM has RCE In Video Processing
  • vLLM vulnerable to Server-Side Request Forgery (SSRF) through MediaConnector
  • vLLM affected by RCE via auto_map dynamic module loading during model initialization
  • vLLM is vulnerable to DoS in Idefics3 vision models via image payload with ambiguous dimensions
  • vLLM introduced enhanced protection for CVE-2025-62164
  • vLLM vulnerable to remote code execution via transformers_utils/get_config
  • vLLM vulnerable to DoS via large Chat Completion or Tokenization requests with specially crafted `chat_template_kwargs`
  • vLLM vulnerable to DoS with incorrect shape of multimodal embedding inputs
  • vLLM deserialization vulnerability leading to DoS and potential RCE
  • vLLM is vulnerable to Server-Side Request Forgery (SSRF) through `MediaConnector` class
  • vLLM: Resource-Exhaustion (DoS) through Malicious Jinja Template in OpenAI-Compatible Server
  • vLLM is vulnerable to timing attack at bearer auth
  • vLLM has remote code execution vulnerability in the tool call parser for Qwen3-Coder
  • vllm API endpoints vulnerable to Denial of Service Attacks
  • vLLM Tool Schema allows DoS via Malformed pattern and type Fields
  • vLLM allows clients to crash the openai server with invalid regex
  • vLLM DOS: Remotely kill vllm over http with invalid JSON schema
  • vLLM has a Weakness in MultiModalHasher Image Hashing Implementation
  • Potential Timing Side-Channel Vulnerability in vLLM’s Chunk-Based Prefix Caching
  • vLLM vulnerable to Regular Expression Denial of Service
  • vLLM has a Regular Expression Denial of Service (ReDoS, Exponential Complexity) Vulnerability in `pythonic_tool_parser.py`
  • vLLM Allows Remote Code Execution via PyNcclPipe Communication Service
  • Remote Code Execution Vulnerability in vLLM Multi-Node Cluster Configuration
  • vLLM: Quadratic Time Complexity in Input Token Processing​ leads to denial of service
  • vLLM Vulnerable to Remote Code Execution via Mooncake Integration
  • Data exposure via ZeroMQ on multi-node vLLM deployment
  • CVE-2025-24357 Malicious model remote code execution fix bypass with PyTorch < 2.6.0
  • vLLM vulnerable to Denial of Service by abusing xgrammar cache
  • vLLM deserialization vulnerability in vllm.distributed.GroupCoordinator.recv_object
  • vLLM allows Remote Code Execution by Pickle Deserialization via AsyncEngineRPCServer() RPC server entrypoints
  • vLLM Deserialization of Untrusted Data vulnerability
  • vLLM Allows Remote Code Execution via Mooncake Integration
  • vLLM denial of service via outlines unbounded cache on disk
  • vLLM uses Python 3.12 built-in hash() which leads to predictable hash collisions in prefix cache
  • vllm: Malicious model to RCE by torch.load in hf_model_weights_iterator
  • vLLM denial of service vulnerability
  • vLLM Denial of Service via the best_of parameter

proxy.golang.org: github.com/vllm-project/vllm

• Homepage:
• Documentation: https://pkg.go.dev/github.com/vllm-project/vllm#section-documentation
• Licenses: apache-2.0
• Latest release: v0.32.0 (published 8 days ago)
• Last Synced: 2026-10-25T11:01:01.745Z (1 day ago)
• Versions: 88
• Dependent Packages: 0
• Dependent Repositories: 0
• Rankings:
  • Dependent packages count: 9.069%
  • Average: 9.647%
  • Dependent repos count: 10.226%

pypi.org: personal-test-vllm-tpu

A high-throughput and memory-efficient inference and serving engine for LLMs

• Homepage: https://github.com/vllm-project/vllm
• Documentation: https://docs.vllm.ai/en/latest/
• Licenses: apache-2.0
• Latest release: 0.10.1.1 (published about 1 year ago)
• Last Synced: 2026-10-25T11:01:40.928Z (1 day ago)
• Versions: 1
• Dependent Packages: 0
• Dependent Repositories: 0
• Rankings:
  • Stargazers count: 0.09%
  • Forks count: 0.12%
  • Dependent packages count: 8.583%
  • Average: 14.291%
  • Dependent repos count: 48.372%
• Maintainers (1)
  • jy_google

pypi.org: tmp-test-vllm-tpu

A high-throughput and memory-efficient inference and serving engine for LLMs

• Homepage: https://github.com/vllm-project/vllm
• Documentation: https://docs.vllm.ai/en/latest/
• Licenses: apache-2.0
• Latest release: 0.0.1 (published about 1 year ago)
• Last Synced: 2026-10-25T11:01:09.521Z (1 day ago)
• Versions: 1
• Dependent Packages: 0
• Dependent Repositories: 0
• Downloads: 168 Last month
• Rankings:
  • Stargazers count: 0.09%
  • Forks count: 0.119%
  • Dependent packages count: 8.523%
  • Average: 14.76%
  • Downloads: 17.027%
  • Dependent repos count: 48.039%
• Maintainers (1)
  • jy_google

pypi.org: vllm-test-tpu

A high-throughput and memory-efficient inference and serving engine for LLMs

• Homepage: https://github.com/vllm-project/vllm
• Documentation: https://vllm.readthedocs.io/en/latest/
• Licenses: Apache-2.0
• Latest release: 0.9.1 (published over 1 year ago)
• Last Synced: 2026-10-25T11:02:15.038Z (1 day ago)
• Versions: 2
• Dependent Packages: 0
• Dependent Repositories: 0
• Downloads: 8 Last month
• Rankings:
  • Stargazers count: 0.136%
  • Forks count: 0.166%
  • Dependent packages count: 9.113%
  • Average: 15.191%
  • Dependent repos count: 51.347%
• Maintainers (1)
  • cuiq

pypi.org: vllm-fixed

A high-throughput and memory-efficient inference and serving engine for LLMs

• Homepage: https://github.com/vllm-project/vllm
• Documentation: https://vllm.readthedocs.io/en/latest/
• Licenses: Apache-2.0
• Latest release: 1.0.0 (published about 1 year ago)
• Last Synced: 2026-10-25T11:00:57.050Z (1 day ago)
• Versions: 2
• Dependent Packages: 0
• Dependent Repositories: 0
• Downloads: 10 Last month
• Rankings:
  • Stargazers count: 0.086%
  • Forks count: 0.112%
  • Dependent packages count: 8.46%
  • Average: 15.642%
  • Downloads: 21.732%
  • Dependent repos count: 47.822%
• Maintainers (1)
  • divyanx

pypi.org: vllm-cpu-nightly

A high-throughput and memory-efficient inference and serving engine for LLMs

• Homepage: https://github.com/vllm-project/vllm
• Documentation: https://docs.vllm.ai/en/latest/
• Licenses: Apache-2.0
• Latest release: 0.30.1.dev202609231158 (published about 1 month ago)
• Last Synced: 2026-10-25T11:01:29.380Z (1 day ago)
• Versions: 120
• Dependent Packages: 0
• Dependent Repositories: 0
• Downloads: 20,236 Last month
• Rankings:
  • Dependent packages count: 7.058%
  • Downloads: 14.097%
  • Average: 20.361%
  • Dependent repos count: 39.927%
• Maintainers (1)
  • maobaolong

pypi.org: vllm-hust

A high-throughput and memory-efficient inference and serving engine for LLMs

• Homepage: https://github.com/vllm-project/vllm
• Documentation: https://docs.vllm.ai/en/latest/
• Licenses: Apache-2.0
• Latest release: 0.17.2.post1 (published 6 months ago)
• Last Synced: 2026-10-25T11:01:05.553Z (1 day ago)
• Versions: 4
• Dependent Packages: 0
• Dependent Repositories: 0
• Downloads: 9 Last month
• Rankings:
  • Dependent packages count: 7.609%
  • Average: 25.316%
  • Dependent repos count: 43.024%
• Maintainers (1)
  • shuhao_zhang

pypi.org: vllm-musa

vLLM platform plugin for Moore Threads MUSA GPUs

• Homepage: https://github.com/vllm-project/vllm
• Documentation: https://vllm-musa.readthedocs.io/
• Licenses: Apache-2.0
• Latest release: 0.1.1 (published 10 months ago)
• Last Synced: 2026-10-25T11:02:01.334Z (1 day ago)
• Versions: 3
• Dependent Packages: 0
• Dependent Repositories: 0
• Downloads: 33 Last month
• Rankings:
  • Dependent packages count: 8.356%
  • Average: 27.794%
  • Dependent repos count: 47.231%
• Maintainers (1)
  • yeahdongcn

pypi.org: vllm-usf

vLLM-USF: A high-throughput and memory-efficient inference engine for LLMs (USF Custom Build)

• Homepage: https://github.com/vllm-project/vllm
• Documentation: https://docs.vllm.ai
• Licenses: Apache-2.0
• Latest release: 0.0.2 (published about 1 year ago)
• Last Synced: 2026-10-25T11:01:34.447Z (1 day ago)
• Versions: 2
• Dependent Packages: 0
• Dependent Repositories: 0
• Downloads: 11 Last month
• Rankings:
  • Dependent packages count: 8.449%
  • Average: 28.103%
  • Dependent repos count: 47.757%
• Maintainers (1)
  • aptsh018

anaconda.org: vllm

vLLM is a fast and easy-to-use library for LLM inference and serving.

• Homepage: https://vllm.ai/
• Licenses: Apache-2.0
• Latest release: 0.21.0 (published 3 months ago)
• Last Synced: 2026-07-23T09:43:58.382Z (3 months ago)
• Versions: 2
• Dependent Packages: 0
• Dependent Repositories: 0
• Downloads: 110 Total
• Rankings:
  • Stargazers count: 1.022%
  • Forks count: 2.486%
  • Average: 29.538%
  • Dependent packages count: 36.615%
  • Dependent repos count: 39.924%
  • Downloads: 67.642%

pypi.org: vllm-tpu

A high-throughput and memory-efficient inference and serving engine for LLMs

• Homepage: https://github.com/vllm-project/vllm
• Documentation: https://docs.vllm.ai/en/latest/
• Licenses: Apache-2.0
• Latest release: 0.32.0 (published 4 days ago)
• Last Synced: 2026-10-25T11:00:56.776Z (1 day ago)
• Versions: 33
• Dependent Packages: 0
• Dependent Repositories: 0
• Downloads: 15,254 Last month
• Rankings:
  • Dependent packages count: 9.078%
  • Average: 30.114%
  • Dependent repos count: 51.149%
• Maintainers (2)
  • cuiq
  • StingLin

pypi.org: vllm-emissary

A high-throughput and memory-efficient inference and serving engine for LLMs

• Homepage: https://github.com/vllm-project/vllm
• Documentation: https://vllm.readthedocs.io/en/latest/
• Licenses: Apache Software License
• Latest release: 0.1.0 (published over 1 year ago)
• Last Synced: 2026-10-25T11:01:39.689Z (1 day ago)
• Versions: 2
• Dependent Packages: 0
• Dependent Repositories: 0
• Downloads: 7 Last month
• Rankings:
  • Dependent packages count: 9.343%
  • Average: 30.984%
  • Dependent repos count: 52.625%
• Maintainers (1)
  • sachin2000k

pypi.org: ai-dynamo-vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

• Homepage: https://github.com/vllm-project/vllm
• Documentation: https://vllm.readthedocs.io/en/latest/
• Licenses: Apache Software License
• Latest release: 0.8.4 (published over 1 year ago)
• Last Synced: 2026-10-25T11:01:16.484Z (1 day ago)
• Versions: 7
• Dependent Packages: 0
• Dependent Repositories: 0
• Downloads: 65 Last month
• Rankings:
  • Dependent packages count: 9.463%
  • Average: 31.377%
  • Dependent repos count: 53.292%
• Maintainers (1)
  • nvidia

pypi.org: wxy-test

A high-throughput and memory-efficient inference and serving engine for LLMs

• Homepage: https://github.com/vllm-project/vllm
• Documentation: https://docs.vllm.ai/en/latest/
• Licenses: Apache-2.0
• Latest release: 0.19.0 (published 6 months ago)
• Last Synced: 2026-10-25T11:02:03.870Z (1 day ago)
• Versions: 3
• Dependent Packages: 0
• Dependent Repositories: 0
• Downloads: 8 Last month
• Rankings:
  • Dependent packages count: 9.652%
  • Average: 31.999%
  • Dependent repos count: 54.345%
• Maintainers (1)
  • wangxiyuan

pypi.org: vllm-npu

A high-throughput and memory-efficient inference and serving engine for LLMs

• Homepage: https://github.com/vllm-project/vllm
• Documentation: https://vllm.readthedocs.io/en/latest/
• Licenses: Apache 2.0
• Latest release: 0.4.2 (published almost 2 years ago)
• Last Synced: 2026-10-25T11:01:08.078Z (1 day ago)
• Versions: 3
• Dependent Packages: 0
• Dependent Repositories: 0
• Downloads: 13 Last month
• Rankings:
  • Dependent packages count: 9.761%
  • Average: 32.353%
  • Dependent repos count: 54.946%
• Maintainers (1)
  • Rvelamen

pypi.org: vllm-rocm

A high-throughput and memory-efficient inference and serving engine for LLMs with AMD GPU support

• Homepage: https://github.com/vllm-project/vllm
• Documentation: https://vllm.readthedocs.io/en/latest/
• Licenses: Apache 2.0
• Latest release: 0.6.3 (published about 2 years ago)
• Last Synced: 2026-10-25T11:01:09.533Z (1 day ago)
• Versions: 1
• Dependent Packages: 0
• Dependent Repositories: 0
• Downloads: 14 Last month
• Rankings:
  • Dependent packages count: 10.195%
  • Average: 33.788%
  • Dependent repos count: 57.381%
• Maintainers (1)
  • vlovich

pypi.org: vllm-acc

A high-throughput and memory-efficient inference and serving engine for LLMs

• Homepage: https://github.com/vllm-project/vllm
• Documentation: https://vllm.readthedocs.io/en/latest/
• Licenses: Apache 2.0
• Latest release: 0.4.1 (published over 2 years ago)
• Last Synced: 2026-10-25T11:01:40.032Z (1 day ago)
• Versions: 8
• Dependent Packages: 0
• Dependent Repositories: 0
• Downloads: 36 Last month
• Rankings:
  • Dependent packages count: 9.449%
  • Average: 35.896%
  • Dependent repos count: 62.342%
• Maintainers (1)
  • dengpanyin

pypi.org: vllm-online

A high-throughput and memory-efficient inference and serving engine for LLMs

• Homepage: https://github.com/vllm-project/vllm
• Documentation: https://vllm.readthedocs.io/en/latest/
• Licenses: Apache 2.0
• Latest release: 0.4.2 (published over 2 years ago)
• Last Synced: 2026-10-25T11:01:02.967Z (1 day ago)
• Versions: 2
• Dependent Packages: 0
• Dependent Repositories: 0
• Downloads: 8 Last month
• Rankings:
  • Dependent packages count: 9.472%
  • Average: 35.984%
  • Dependent repos count: 62.495%
• Maintainers (1)
  • vwxyzjn

pypi.org: tilearn-infer

A high-throughput and memory-efficient inference and serving engine for LLMs

• Homepage: https://github.com/vllm-project/vllm
• Documentation: https://vllm.readthedocs.io/en/latest/
• Licenses: Apache 2.0
• Latest release: 0.3.3 (published over 2 years ago)
• Last Synced: 2026-10-25T11:01:42.689Z (1 day ago)
• Versions: 3
• Dependent Packages: 0
• Dependent Repositories: 0
• Downloads: 4 Last month
• Rankings:
  • Dependent packages count: 9.569%
  • Average: 36.35%
  • Dependent repos count: 63.131%
• Maintainers (1)
  • mpustc

pypi.org: tilearn-test01

A high-throughput and memory-efficient inference and serving engine for LLMs

• Homepage: https://github.com/vllm-project/vllm
• Documentation: https://vllm.readthedocs.io/en/latest/
• Licenses: Apache 2.0
• Latest release: 0.1 (published over 2 years ago)
• Last Synced: 2026-10-25T11:01:09.884Z (1 day ago)
• Versions: 1
• Dependent Packages: 0
• Dependent Repositories: 0
• Downloads: 2 Last month
• Rankings:
  • Dependent packages count: 9.585%
  • Average: 36.409%
  • Dependent repos count: 63.233%
• Maintainers (1)
  • mpustc

pypi.org: vllm-xft

A high-throughput and memory-efficient inference and serving engine for LLMs

• Homepage: https://github.com/vllm-project/vllm
• Documentation: https://vllm.readthedocs.io/en/latest/
• Licenses: Apache 2.0
• Latest release: 0.5.5.4 (published over 1 year ago)
• Last Synced: 2026-10-25T11:01:33.086Z (1 day ago)
• Versions: 12
• Dependent Packages: 0
• Dependent Repositories: 0
• Downloads: 175 Last month
• Rankings:
  • Dependent packages count: 9.629%
  • Average: 36.582%
  • Dependent repos count: 63.535%
• Maintainers (4)
  • pujiang
  • wangduyi
  • abenmao
  • zhoushan2186

pypi.org: hive-vllm

a

• Homepage: https://github.com/vllm-project/vllm
• Documentation: https://vllm.readthedocs.io/en/latest/
• Licenses: Apache 2.0
• Latest release: 0.0.1 (published over 2 years ago)
• Last Synced: 2026-10-25T11:01:30.512Z (1 day ago)
• Versions: 1
• Dependent Packages: 0
• Dependent Repositories: 0
• Downloads: 9 Last month
• Rankings:
  • Dependent packages count: 9.784%
  • Average: 37.172%
  • Dependent repos count: 64.559%
• Maintainers (1)
  • windap

pypi.org: nextai-vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

• Homepage: https://github.com/vllm-project/vllm
• Documentation: https://vllm.readthedocs.io/en/latest/
• Licenses: Apache 2.0
• Latest release: 0.0.7 (published over 2 years ago)
• Last Synced: 2026-10-25T11:02:11.098Z (1 day ago)
• Versions: 6
• Dependent Packages: 0
• Dependent Repositories: 0
• Downloads: 29 Last month
• Rankings:
  • Dependent packages count: 9.941%
  • Average: 37.779%
  • Dependent repos count: 65.617%
• Maintainers (1)
  • raochetanj

pypi.org: vllm-consul

A high-throughput and memory-efficient inference and serving engine for LLMs

• Homepage: https://github.com/vllm-project/vllm
• Documentation: https://vllm.readthedocs.io/en/latest/
• Licenses: Apache 2.0
• Latest release: 0.2.1 (published about 3 years ago)
• Last Synced: 2026-10-25T11:00:55.360Z (1 day ago)
• Versions: 5
• Dependent Packages: 0
• Dependent Repositories: 0
• Downloads: 21 Last month
• Rankings:
  • Dependent packages count: 9.355%
  • Average: 38.747%
  • Dependent repos count: 68.139%
• Maintainers (1)
  • liuxiong332

crates.io: vllm-proto

Protobuf messages and gRPC bindings for the vLLM Rust frontend

• Homepage:
• Documentation: https://docs.rs/vllm-proto/
• Licenses: Apache-2.0
• Latest release: 0.6.0 (published 12 days ago)
• Last Synced: 2026-10-25T11:01:12.560Z (1 day ago)
• Versions: 7
• Dependent Packages: 0
• Dependent Repositories: 0
• Downloads: 111,664 Total
• Rankings:
  • Dependent repos count: 12.097%
  • Dependent packages count: 15.977%
  • Average: 39.11%
  • Downloads: 89.255%
• Maintainers (1)
  • BugenZhao

nixpkgs-24.11: python311Packages.vllm

High-throughput and memory-efficient inference and serving engine for LLMs

• Homepage: https://github.com/vllm-project/vllm
• Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-24.11/pkgs/development/python-modules/vllm/default.nix#L171
• Licenses: Apache-2.0
• Latest release: 0.6.2 (published 9 months ago)
• Last Synced: 2026-09-16T07:27:40.483Z (about 1 month ago)
• Versions: 1
• Dependent Packages: 0
• Dependent Repositories: 0
• Rankings:
  • Dependent repos count: 0.0%
  • Dependent packages count: 0.0%
  • Average: 100%
• Maintainers (2)
  • happysalada
  • CertainLach

nixpkgs-24.05: python312Packages.vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

• Homepage: https://github.com/vllm-project/vllm
• Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-24.05/pkgs/development/python-modules/vllm/default.nix#L148
• Licenses: Apache-2.0
• Latest release: 0.3.3 (published 9 months ago)
• Last Synced: 2026-03-09T05:10:24.804Z (8 months ago)
• Versions: 1
• Dependent Packages: 0
• Dependent Repositories: 0
• Rankings:
  • Dependent repos count: 0.0%
  • Dependent packages count: 0.0%
  • Average: 100%
• Maintainers (2)
  • happysalada
  • CertainLach

artifacthub.io: kubeblocks/vllm-chat

Self-hosted chat/agent LLM on vLLM for ApeMind private deployment ("instance A" in the MinerU-3.x + vLLM design). Serves an OpenAI-compatible endpoint with tool-calling enabled. Default model pin: Qwen/Qwen3.6-27B-FP8 (single 80G card recommended; 40G minimum per vLLM official recipes). The MinerU document-parsing VLM ("instance B") is NOT this chart — enable deploy/mineru's openaiServer service for that.

• Homepage: https://docs.vllm.ai/
• Documentation: https://artifacthub.io/packages/helm/kubeblocks/vllm-chat
• Licenses: Unknown
• Latest release: 0.1.0 (published 3 months ago)
• Last Synced: 2026-10-25T11:00:57.225Z (1 day ago)
• Versions: 1
• Dependent Packages: 0
• Dependent Repositories: 0
• Downloads: 0 Total
• Rankings:
  • Downloads: 0.0%
  • Dependent repos count: 0.0%
  • Dependent packages count: 0.0%
  • Average: 100%

nixpkgs-24.05: python311Packages.vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

• Homepage: https://github.com/vllm-project/vllm
• Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-24.05/pkgs/development/python-modules/vllm/default.nix#L148
• Licenses: Apache-2.0
• Latest release: 0.3.3 (published 9 months ago)
• Last Synced: 2026-05-13T01:07:46.485Z (6 months ago)
• Versions: 1
• Dependent Packages: 0
• Dependent Repositories: 0
• Rankings:
  • Dependent repos count: 0.0%
  • Dependent packages count: 0.0%
  • Average: 100%
• Maintainers (2)
  • happysalada
  • CertainLach

nixpkgs-unstable: python313Packages.vllm

High-throughput and memory-efficient inference and serving engine for LLMs

• Homepage: https://github.com/vllm-project/vllm
• Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-unstable/pkgs/development/python-modules/vllm/default.nix#L585
• Licenses: Apache-2.0
• Latest release: 0.15.1 (published 8 months ago)
• Last Synced: 2026-05-14T17:14:40.043Z (5 months ago)
• Versions: 2
• Dependent Packages: 0
• Dependent Repositories: 0
• Rankings:
  • Dependent repos count: 0.0%
  • Dependent packages count: 0.0%
  • Average: 100%
• Maintainers (4)
  • happysalada
  • LunNova
  • daniel-fahey
  • CertainLach

nixpkgs-24.11: python312Packages.vllm

High-throughput and memory-efficient inference and serving engine for LLMs

• Homepage: https://github.com/vllm-project/vllm
• Documentation: https://github.com/NixOS/nixpkgs/blob/nixos-24.11/pkgs/development/python-modules/vllm/default.nix#L171
• Licenses: Apache-2.0
• Latest release: 0.6.2 (published 9 months ago)
• Last Synced: 2026-04-10T14:01:38.971Z (7 months ago)
• Versions: 1
• Dependent Packages: 0
• Dependent Repositories: 0
• Rankings:
  • Dependent repos count: 0.0%
  • Dependent packages count: 0.0%
  • Average: 100%
• Maintainers (2)
  • happysalada
  • CertainLach

artifacthub.io: infracloud-charts/vllm

A Helm chart for deploying models with vLLM

• Homepage: https://docs.vllm.ai
• Documentation: https://artifacthub.io/packages/helm/infracloud-charts/vllm
• Licenses: Unknown
• Latest release: 0.4.1 (published about 1 month ago)
• Last Synced: 2026-10-25T11:00:59.993Z (1 day ago)
• Versions: 6
• Dependent Packages: 0
• Dependent Repositories: 0
• Downloads: 0 Total
• Rankings:
  • Downloads: 0.0%
  • Dependent repos count: 0.0%
  • Dependent packages count: 0.0%
  • Average: 100%

artifacthub.io: kubeblocks/vllm-embedding

Self-hosted multimodal embedding service on vLLM for ApeMind private deployment. Serves an OpenAI-compatible /v1/embeddings endpoint (vLLM --runner pooling). Default model pin: Qwen/Qwen3-VL-Embedding-2B (2026-01, Apache-2.0, SOTA multimodal embeddings, MRL dims 64..2048, ~6G VRAM — fits beside other services on a 24G card). Chat/agent LLM is deploy/vllm-chat; the MinerU document-parsing VLM is deploy/mineru openaiServer.

• Homepage: https://docs.vllm.ai/
• Documentation: https://artifacthub.io/packages/helm/kubeblocks/vllm-embedding
• Licenses: Unknown
• Latest release: 0.1.0 (published 3 months ago)
• Last Synced: 2026-10-25T11:00:52.386Z (1 day ago)
• Versions: 1
• Dependent Packages: 0
• Dependent Repositories: 0
• Downloads: 0 Total
• Rankings:
  • Downloads: 0.0%
  • Dependent repos count: 0.0%
  • Dependent packages count: 0.0%
  • Average: 100%