Skip to content

[CI] Renovation of nightly wheel build & generation #29690

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 16 commits into from
Dec 1, 2025
+568 −181
Merged

[CI] Renovation of nightly wheel build & generation #29690

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
16 commits
Select commit Hold shift + click to select a range
a5a4ca8
ci: rewrite script to generate index and metadata for nightly build
Harry-Chen Nov 28, 2025
67f6bb7
build: set VLLM_MAIN_CUDA_VERSION to 12.9
Harry-Chen Nov 28, 2025
783b7bd
ci: remove build-wheel-cuda-12-8 in release-pipeline
Harry-Chen Nov 28, 2025
b6c1cf4
ci: set DEFAULT_VARIANT_ALIAS=cu129 in upload-wheels.sh
Harry-Chen Nov 28, 2025
e10c424
build: use newly added metadata.json instead of hardcoded version to …
Harry-Chen Nov 28, 2025
fa2a0ad
chore: fix ruff linting issues
Harry-Chen Nov 28, 2025
5f40a2f
ci: fix errors in upload-wheels.sh
Harry-Chen Nov 29, 2025
b8741bf
ci: fix legacy python supoprt in generate-nightly-index.py
Harry-Chen Nov 29, 2025
39e4fe2
ci: do not throw error when alias-to-default is specified but no defa…
Harry-Chen Nov 29, 2025
d51da1d
ci: ensure enerate-nightly-index.py is run with at least python3.10
Harry-Chen Nov 29, 2025
14d2952
ci: add more comments in upload-wheels.sh, ensure no race in index up…
Harry-Chen Nov 29, 2025
db2c76c
build: more elegant exception handling in setup.py to download precom…
Harry-Chen Nov 29, 2025
fcf323d
build: add VLLM_PRECOMPILED_WHEEL_VARIANT support in setup.py to repl…
Harry-Chen Dec 1, 2025
3108287
doc: update instructions on installing from renovated nightly index
Harry-Chen Dec 1, 2025
26de25d
build: add VLLM_PRECOMPILED_WHEEL_COMMIT env
Harry-Chen Dec 1, 2025
73488d2
doc: clarify new python-only build options
Harry-Chen Dec 1, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
46 changes: 0 additions & 46 deletions .buildkite/generate_index.py
View file
Open in desktop

This file was deleted.

16 changes: 1 addition & 15 deletions .buildkite/release-pipeline.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ steps:
commands:
# #NOTE: torch_cuda_arch_list is derived from upstream PyTorch build files here:
# https://github.com/pytorch/pytorch/blob/main/.ci/aarch64_linux/aarch64_ci_build.sh#L7
- "DOCKER_BUILDKIT=1 docker build --build-arg max_jobs=16 --build-arg USE_SCCACHE=1 --build-arg GIT_REPO_CHECK=1 --build-arg CUDA_VERSION=12.9.1 --build-arg VLLM_MAIN_CUDA_VERSION=12.9 --build-arg torch_cuda_arch_list='8.7 8.9 9.0 10.0+PTX 12.0' --tag vllm-ci:build-image --target build --progress plain -f docker/Dockerfile ."
- "DOCKER_BUILDKIT=1 docker build --build-arg max_jobs=16 --build-arg USE_SCCACHE=1 --build-arg GIT_REPO_CHECK=1 --build-arg CUDA_VERSION=12.9.1 --build-arg torch_cuda_arch_list='8.7 8.9 9.0 10.0+PTX 12.0' --tag vllm-ci:build-image --target build --progress plain -f docker/Dockerfile ."
- "mkdir artifacts"
- "docker run --rm -v $(pwd)/artifacts:/artifacts_host vllm-ci:build-image bash -c 'cp -r dist /artifacts_host && chmod -R a+rw /artifacts_host'"
- "bash .buildkite/scripts/upload-wheels.sh"
Expand All @@ -30,19 +30,6 @@ steps:
DOCKER_BUILDKIT: "1"

# x86 + CUDA builds
- label: "Build wheel - CUDA 12.8"
depends_on: ~
id: build-wheel-cuda-12-8
agents:
queue: cpu_queue_postmerge
commands:
- "DOCKER_BUILDKIT=1 docker build --build-arg max_jobs=16 --build-arg USE_SCCACHE=1 --build-arg GIT_REPO_CHECK=1 --build-arg CUDA_VERSION=12.8.1 --tag vllm-ci:build-image --target build --progress plain -f docker/Dockerfile ."
- "mkdir artifacts"
- "docker run --rm -v $(pwd)/artifacts:/artifacts_host vllm-ci:build-image bash -c 'cp -r dist /artifacts_host && chmod -R a+rw /artifacts_host'"
- "bash .buildkite/scripts/upload-wheels.sh"
env:
DOCKER_BUILDKIT: "1"

- label: "Build wheel - CUDA 12.9"
depends_on: ~
id: build-wheel-cuda-12-9
Expand Down Expand Up @@ -109,7 +96,6 @@ steps:
- label: "Annotate release workflow"
depends_on:
- create-multi-arch-manifest
- build-wheel-cuda-12-8
id: annotate-release-workflow
agents:
queue: cpu_queue_postmerge
Expand Down
Loading