RedHatAI
/

gemma-4-31B-it-FP8-block

Image-Text-to-Text

compressed-tensors

Model card Files Files and versions

Update README.md

#2

by bullerwins - opened 21 days ago

base: refs/heads/main

←

from: refs/pr/2

Discussion Files changed

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -204,7 +204,7 @@ lm_eval --model local-chat-completions \
 #### MMLU-Pro (lm-eval, 5-shot, 3 repetitions)
 ```
 lm_eval --model local-chat-completions \
-  --tasks mmlu_pro_chat \
   --model_args "model=RedHatAI/gemma-4-31B-it-FP8-block,max_length=96000,base_url=http://0.0.0.0:8000/v1/chat/completions,num_concurrent=128,max_retries=3,tokenized_requests=False,tokenizer_backend=None,timeout=2400" \
   --num_fewshot 5 \
   --apply_chat_template \

 #### MMLU-Pro (lm-eval, 5-shot, 3 repetitions)
 ```
 lm_eval --model local-chat-completions \
+  --tasks mmlu_pro \
   --model_args "model=RedHatAI/gemma-4-31B-it-FP8-block,max_length=96000,base_url=http://0.0.0.0:8000/v1/chat/completions,num_concurrent=128,max_retries=3,tokenized_requests=False,tokenizer_backend=None,timeout=2400" \
   --num_fewshot 5 \
   --apply_chat_template \