Update README.md
Browse files
README.md
CHANGED
|
@@ -141,7 +141,8 @@ Expected output:
|
|
| 141 |
|
| 142 |
```bash
|
| 143 |
# Launch the vLLM server
|
| 144 |
-
|
|
|
|
| 145 |
```
|
| 146 |
|
| 147 |
```python
|
|
|
|
| 141 |
|
| 142 |
```bash
|
| 143 |
# Launch the vLLM server
|
| 144 |
+
# If run out of VRAM, try add --max_model_len 2048
|
| 145 |
+
vllm serve model/AgentCPM-GUI --served-model-name AgentCPM-GUI --tensor_parallel_size 1 --trust-remote-code --limit-mm-per-prompt image=10
|
| 146 |
```
|
| 147 |
|
| 148 |
```python
|