OPTs models allow quantization????

#35

by ppinedo - opened May 26

May 26

quantization for running on low resources ia allowed in OPT models??7

Thanks in advance,

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment