BioMistral/BioMistral-7B-AWQ-QGS128-W4-GEMM
Text Generation • 7B • Updated • 401 • 6
Models Quantization
-
-
BioMistral/BioMistral-7B-AWQ-QGS128-W4-GEMV
Text Generation • 7B • Updated • 17 • 1 -
BioMistral/BioMistral-7B-SLERP-AWQ-QGS128-W4-GEMM
Text Generation • 7B • Updated • 10 • 1 -
BioMistral/BioMistral-7B-TIES-AWQ-QGS128-W4-GEMM
Text Generation • 7B • Updated • 7 -
BioMistral/BioMistral-7B-DARE-AWQ-QGS128-W4-GEMM
Text Generation • 7B • Updated • 111 • 3 -
BioMistral/BioMistral-7B-BnB.8
Text Generation • 7B • Updated • 8 -
BioMistral/BioMistral-7B-BnB.4
Text Generation • 7B • Updated • 12 • 1 -
BioMistral/BioMistral-7B-Zephyr-Beta-SLERP-AWQ-QGS128-W4-GEMM
Text Generation • 7B • Updated • 4 -
BioMistral/BioMistral-7B-GGUF
Text Generation • 7B • Updated • 897 • 22 -
BioMistral/BioMistral-7B-DARE-GGUF
Text Generation • 7B • Updated • 442 • 10