allenai
/

olmOCR-7B-0225-preview-FP8

text-generation-inference

compressed-tensors

Model card Files Files and versions

olmOCR-7B-0225-preview-FP8 / recipe.yaml

jakep-allenai's picture

Upload folder using huggingface_hub

89ff6c1 verified about 1 month ago

history blame contribute delete

158 Bytes

	default_stage:
	default_modifiers:
	QuantizationModifier:
	ignore: ['re:.lm_head', 're:visual.']
	targets: [Linear]
	scheme: FP8_DYNAMIC