Hugging Face's logo

RDson
/
Llama-3-Teal-Instruct-2x8B-MoE

Text Generation
Transformers
Safetensors
mixtral
Mixture of Experts
llama
3
llama 3
2x8b
conversational
text-generation-inference
Model card Files
xet
Community
RDson commited on
Commit
4ab20e1
·
verified ·
1 Parent(s): 0052f35

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -9,6 +9,8 @@ tags:
9
  # Llama-3-Teal-Instruct-2x8B-MoE
10
  This is a experimental MoE created from [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) and [nvidia/Llama3-ChatQA-1.5-8B](https://huggingface.co/nvidia/Llama3-ChatQA-1.5-8B) using Mergekit.
11
 
 
 
12
  Mergekit yaml file:
13
  ```
14
  base_model: Meta-Llama-3-8B-Instruct
 
9
  # Llama-3-Teal-Instruct-2x8B-MoE
10
  This is a experimental MoE created from [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) and [nvidia/Llama3-ChatQA-1.5-8B](https://huggingface.co/nvidia/Llama3-ChatQA-1.5-8B) using Mergekit.
11
 
12
+ Green + Blue = Teal.
13
+
14
  Mergekit yaml file:
15
  ```
16
  base_model: Meta-Llama-3-8B-Instruct