RedHatAI
/

quantization

Model card Files Files and versions Community

quantization / compressed_tensors

10.4 kB

2 contributors

History: 2 commits

danieldk's picture

danieldk HF Staff

Sync with vLLM

0da5bf5 8 months ago

int8_quant_kernels.cu

10.4 kB

Sync with vLLM 8 months ago