Update README.md
Browse files
README.md
CHANGED
|
@@ -67,7 +67,7 @@ for output in outputs:
|
|
| 67 |
|
| 68 |
## Usage
|
| 69 |
|
| 70 |
-
We demonstrated how to use 'vllm' to run the XVERSE-7B-Chat
|
| 71 |
|
| 72 |
```python
|
| 73 |
from vllm import LLM, SamplingParams
|
|
|
|
| 67 |
|
| 68 |
## Usage
|
| 69 |
|
| 70 |
+
We demonstrated how to use 'vllm' to run the XVERSE-7B-Chat-GPTQ-Int4 quantization model:
|
| 71 |
|
| 72 |
```python
|
| 73 |
from vllm import LLM, SamplingParams
|