sellep commited on
Commit
03cdbb7
·
verified ·
1 Parent(s): bfe369d

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +35 -0
README.md ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ inference:
4
+ parameters:
5
+ temperature: 1
6
+ top_p: 0.95
7
+ top_k: 40
8
+ repetition_penalty: 1.2
9
+ license: apache-2.0
10
+ language:
11
+ - en
12
+ pipeline_tag: text-generation
13
+ base_model: ministral/Ministral-3b-instruct
14
+ tags:
15
+ - openvino
16
+ - openvino-export
17
+ ---
18
+
19
+ This model was converted to OpenVINO from [`ministral/Ministral-3b-instruct`](https://huggingface.co/ministral/Ministral-3b-instruct) using [optimum-intel](https://github.com/huggingface/optimum-intel)
20
+ via the [export](https://huggingface.co/spaces/echarlaix/openvino-export) space.
21
+
22
+ First make sure you have optimum-intel installed:
23
+
24
+ ```bash
25
+ pip install optimum[openvino]
26
+ ```
27
+
28
+ To load your model you can do as follows:
29
+
30
+ ```python
31
+ from optimum.intel import OVModelForCausalLM
32
+
33
+ model_id = "sellep/Ministral-3b-instruct-openvino"
34
+ model = OVModelForCausalLM.from_pretrained(model_id)
35
+ ```