Commit
·
e3b531c
1
Parent(s):
15db328
Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,25 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: other
|
| 3 |
+
language:
|
| 4 |
+
- en
|
| 5 |
+
- fr
|
| 6 |
+
- es
|
| 7 |
+
- hi
|
| 8 |
+
- zh
|
| 9 |
+
- code
|
| 10 |
+
base_model: microsoft/Orca-2-13b
|
| 11 |
+
datasets:
|
| 12 |
+
- HuggingFaceH4/no_robots
|
| 13 |
+
- mlabonne/guanaco-llama2-1k
|
| 14 |
+
- OpenAssistant/oasst_top1_2023-08-25
|
| 15 |
+
- totally-not-an-llm/EverythingLM-data-V3
|
| 16 |
+
- LDJnr/Pure-Dove
|
| 17 |
+
- LDJnr/Capybara
|
| 18 |
+
- LDJnr/LessWrong-Amplify-Instruct
|
| 19 |
+
- LDJnr/Verified-Camel
|
| 20 |
+
---
|
| 21 |
+
The "microsoft/Orca-2-13b" model fully fine-tuned on HuggingFaceH4/no_robots, totally-not-an-llm/EverythingLM-data-V3, LDJnr/Capybara, LDJnr/Pure-Dove, LDJnr/LessWrong-Amplify-Instruct, LDJnr/Verified-Camel, mlabonne/guanaco-llama2-1k, and OpenAssistant/oasst_top1_2023-08-25. This model achieved a test loss of 0.18.
|
| 22 |
+
|
| 23 |
+
Make sure to comply with the microsoft research license. Please read it before using this model.
|
| 24 |
+
|
| 25 |
+
This model was trained on the ChatML prompt template.
|