Add ExLlamaV2 quant link (#2)

- Add ExLlamaV2 quant link (b6758f74b312c71635861c52b0df7d534af6e30a)


Co-authored-by: Bartowski <[email protected]>

README.md

@@ -78,4 +78,8 @@ The bluemoon dataset was filtered from the training data as it showed to cause p
 - No model parameters were frozen.
 - This model was trained on OpenAI's ChatML prompt format. Because this model has function calling capabilities, the prompt format is slightly different, here's what it would look like: ```<|im_start|>system\n{message}<|im_end|>\n<|im_start|>user\n{user message}<|im_end|>\n<|im_start|>call\n{function call message}<|im_end|>\n<|im_start|>function\n{function response message}<|im_end|>\n<|im_start|>assistant\n{assistant message}</s>```
 
-This model was fine-tuned using the TPU-Alignment repository. https://github.com/Locutusque/TPU-Alignment
+This model was fine-tuned using the TPU-Alignment repository. https://github.com/Locutusque/TPU-Alignment
+
+# Quants
+
+ExLlamaV2 by bartowski https://huggingface.co/bartowski/Hercules-3.1-Mistral-7B-exl2