hfendpoints-images
/

asr-multilingual-whisper

Morgan Funtowicz commited on Apr 17

Commit

f07694e

1 Parent(s): 9cbf886

misc(whisper): disable vllm request logging

Files changed (1) hide show

handler.py CHANGED Viewed

@@ -258,6 +258,7 @@ class WhisperHandler(Handler[TranscriptionRequest, TranscriptionResponse]):
                 enforce_eager=False,
                 enable_prefix_caching=True,
                 max_logprobs=1,  # TODO(mfuntowicz) : Set from config?
             )
         )

                 enforce_eager=False,
                 enable_prefix_caching=True,
                 max_logprobs=1,  # TODO(mfuntowicz) : Set from config?
+                disable_log_requests=True
             )
         )