Update README.md
Browse files
README.md
CHANGED
|
@@ -277,7 +277,7 @@ CUDA_VISIBLE_DEVICES=0 python demo/text_generation_base.py --model OrionStarAI/O
|
|
| 277 |
CUDA_VISIBLE_DEVICES=0 python demo/text_generation.py --model OrionStarAI/Orion-14B-Chat --tokenizer OrionStarAI/Orion-14B-Chat --prompt hi
|
| 278 |
|
| 279 |
```
|
| 280 |
-
|
| 281 |
## 4.4. Inference by vllm
|
| 282 |
|
| 283 |
- Project URL<br>
|
|
|
|
| 277 |
CUDA_VISIBLE_DEVICES=0 python demo/text_generation.py --model OrionStarAI/Orion-14B-Chat --tokenizer OrionStarAI/Orion-14B-Chat --prompt hi
|
| 278 |
|
| 279 |
```
|
| 280 |
+
<a name="vllm"></a><br>
|
| 281 |
## 4.4. Inference by vllm
|
| 282 |
|
| 283 |
- Project URL<br>
|