tugstugi
/

Qwen2.5-7B-Instruct-QwQ-v0.1

Text Generation

text-generation-inference

Model card Files Files and versions

Qwen2.5-7B-Instruct-QwQ

A QwQ style model trained from Qwen/Qwen2.5-7B-Instruct

1.7 epoch on PowerInfer/QWQ-LONGCOT-500K and PowerInfer/LONGCOT-Refine-500K
recommended parameters: temperature=0.7 top_p=0.8 repetition_penalty=1.1 max_tokens=16384
AIME24: 35.33% (average of 5 runs)

Downloads last month: 2

Safetensors

Model size

8B params

Tensor type

F32

·

Model tree for tugstugi/Qwen2.5-7B-Instruct-QwQ-v0.1

Base model

Qwen/Qwen2.5-7B

Finetuned

Qwen/Qwen2.5-7B-Instruct

Finetuned

(2800)

this model

Quantizations

1 model

Datasets used to train tugstugi/Qwen2.5-7B-Instruct-QwQ-v0.1