Skip to content

Commit 6db2c44

Browse files
authored
Update Dockerfile
1 parent 9b7ca4d commit 6db2c44

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

Dockerfile

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -12,7 +12,7 @@ RUN --mount=type=cache,target=/root/.cache/pip \
1212
python3 -m pip install --upgrade -r /requirements.txt
1313

1414
# Install vLLM (switching back to pip installs since issues that required building fork are fixed and space optimization is not as important since caching) and FlashInfer
15-
RUN python3 -m pip install vllm==0.8.4 && \
15+
RUN python3 -m pip install vllm==0.8.5 && \
1616
python3 -m pip install flashinfer -i https://flashinfer.ai/whl/cu121/torch2.3
1717

1818
# Setup for Option 2: Building the Image with the Model included
@@ -47,4 +47,4 @@ RUN --mount=type=secret,id=HF_TOKEN,required=false \
4747
fi
4848

4949
# Start the handler
50-
CMD ["python3", "/src/handler.py"]
50+
CMD ["python3", "/src/handler.py"]

0 commit comments

Comments
 (0)