Quantization config?
#1
by
kmouratidis
- opened
Hi, thanks for the quants! Could you share your quantization config? Dataset, number of calibration samples, max lengths? and if you have any quality comparison benchmarks? Maybe perplexity or on some of the benchmarks you used for the unquantized model? I see the AIME24 numbers, thanks.