File size: 143 Bytes
f6167be |
1 2 3 4 5 6 7 |
DEFAULT_stage:
DEFAULT_modifiers:
QuantizationModifier:
ignore: ['re:.*lm_head']
targets: [Linear]
scheme: FP8_DYNAMIC
|
f6167be |
1 2 3 4 5 6 7 |
DEFAULT_stage:
DEFAULT_modifiers:
QuantizationModifier:
ignore: ['re:.*lm_head']
targets: [Linear]
scheme: FP8_DYNAMIC
|