fix readme

MeetKai · Aug 23, 2024 · 9755af1 · 9755af1
1 parent 5644454
commit 9755af1
Showing 1 changed file with 2 additions and 0 deletions.
diff --git a/README.md b/README.md
@@ -125,6 +125,8 @@ python3 server_vllm.py --model "meetkai/functionary-vision-small-v0.1" --max-mod
 
 **Medium Model:**
 ```shell
+# vllm requires to run this first: https://github.com/vllm-project/vllm/issues/6152
+export VLLM_WORKER_MULTIPROC_METHOD=spawn
 python server_vllm.py --model "meetkai/functionary-vision-medium-v0.1" --max-model-len 8192 --tensor-parallel-size 2
 ```