Skip to content

Commit 35bc079

Browse files
authored
Add Doc: Mapping a Single GPU (#33)
1 parent 61bd4be commit 35bc079

File tree

1 file changed

+14
-0
lines changed

1 file changed

+14
-0
lines changed

vllm/README.md

Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -179,6 +179,20 @@ docker exec -it lsv-container bash
179179

180180
---
181181

182+
**Note — Mapping a Single GPU**
183+
> If you need to map only a specific GPU into the container, remove both `--privileged` and `--device=/dev/dri` from the `docker run` command, and replace them with the following device and mount options (example for the first GPU):
184+
185+
```bash
186+
--device /dev/dri/renderD128:/dev/dri/renderD128 \
187+
--mount type=bind,source="/dev/dri/by-path/pci-0000:18:00.0-card",target="/dev/dri/by-path/pci-0000:18:00.0-card" \
188+
--mount type=bind,source="/dev/dri/by-path/pci-0000:18:00.0-render",target="/dev/dri/by-path/pci-0000:18:00.0-render" \
189+
-v /dev/dri/card0:/dev/dri/card0 \
190+
```
191+
192+
This way, only the first GPU will be mapped into the Docker container.
193+
194+
---
195+
182196
### 1.4 Launching the Serving Service
183197

184198
```bash

0 commit comments

Comments
 (0)