Update README.md

README.md

@@ -20,4 +20,10 @@ datasets:
 
 Wordcel is a Llama3 fine-tune intended to be used as a mid-training checkpoint for more specific chat/RP/storywriting applications.
 
-It has been trained from Llama3 8B Base on a composite dataset that highlights reasoning, (uncensored) stories, classic literature, and assorted interpersonal intelligence tasks.
+It has been trained from Llama3 8B Base on a composite dataset that highlights reasoning, (uncensored) stories, classic literature, and assorted interpersonal intelligence tasks.
+
+Components of the composite dataset include [OpenHermes-2.5](https://huggingface.co/datasets/teknium/OpenHermes-2.5), and [Grimulkan](https://huggingface.co/grimulkan)'s [Theory of Mind](https://huggingface.co/datasets/grimulkan/theory-of-mind) and [Physical Reasoning](https://huggingface.co/datasets/grimulkan/physical-reasoning) datasets.
+
+It is trained at a context length of 32k tokens, using linear RoPE scaling with a factor of 4.0. Derivative models should be capable of generalizing to 32k tokens as a result.
+
+If you train a model using this checkpoint, please give clear attribution! The Llama 3 base license likely applies.