Experimental versions of FP-Quant models
-
daslab-testing/Llama-3.1-8B-Instruct-mxfp-w4-a4-MicroQAT-hadamard-transform
5B • Updated • 37 -
daslab-testing/Llama-3.1-8B-Instruct-nvfp-w4-a4-MicroQAT-hadamard-transform
5B • Updated • 29 -
daslab-testing/Llama-3.2-3B-Instruct-nvfp-w4-a4-MicroQAT-hadamard-transform
2B • Updated • 25 -
daslab-testing/Llama-3.2-3B-Instruct-mxfp-w4-a4-MicroQAT-hadamard-transform
2B • Updated • 28