exllamav3 quantizations of ArliAI's DS-R1-Distill-70B-ArliAI-RpR-v4-Large
2.25bpw h6 (20.661 GiB)
4.25bpw h6 (36.598 GiB)
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
๐
Ask for provider support
Model tree for MikeRoz/DS-R1-Distill-70B-ArliAI-RpR-v4-Large-exl3
Base model
deepseek-ai/DeepSeek-R1-Distill-Llama-70B