metadata
base_model:
- FlareRebellion/WeirdCompound-v1.5-24b
base_model_relation: quantized
tags:
- exl3
Quantized using exllamav3 (0.0.5) quantization process.
- Original model:
FlareRebellion/WeirdCompound-v1.5-24b- refer for more details on the model. - exllamav3: https://github.com/turboderp-org/exllamav3
EXL3 quants available:
- 5.0bpw, 3.5bpw (for other bpw open request in 'community' section)
- Go to "Files and versions", then click on "Main" to choose your quant