update cpu requirement
Browse files
README.md
CHANGED
|
@@ -164,19 +164,14 @@ Generated: Hello! How can I assist you today? 😊
|
|
| 164 |
"""
|
| 165 |
~~~
|
| 166 |
|
| 167 |
-
|
| 168 |
-
|
| 169 |
-
|
| 170 |
-
|
| 171 |
### INT4 Inference on CPU with ITREX(Recommended)
|
| 172 |
|
| 173 |
-
|
| 174 |
|
| 175 |
-
|
| 176 |
-
|
| 177 |
-
intel-extension-for-transformers
|
| 178 |
-
|
| 179 |
-
intel-extension-for-pytorch: much slower repacking, faster inference, lower accuracy
|
| 180 |
|
| 181 |
~~~python
|
| 182 |
from auto_round import AutoRoundConfig ##must import for autoround format
|
|
|
|
| 164 |
"""
|
| 165 |
~~~
|
| 166 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 167 |
### INT4 Inference on CPU with ITREX(Recommended)
|
| 168 |
|
| 169 |
+
Requirements
|
| 170 |
|
| 171 |
+
~~~bash
|
| 172 |
+
pip install auto-round
|
| 173 |
+
pip install intel-extension-for-transformers
|
| 174 |
+
~~~
|
|
|
|
| 175 |
|
| 176 |
~~~python
|
| 177 |
from auto_round import AutoRoundConfig ##must import for autoround format
|