Michael Goin

mgoin's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in RedHatAI/Mistral-Small-3.2-24B-Instruct-2506-FP8 17 days ago

Quantization recipe?

2

#3 opened 19 days ago by

veden

New activity in RedHatAI/Mistral-Small-3.2-24B-Instruct-2506-FP8 19 days ago

Not working with vLLM 0.9.1

5

#1 opened 28 days ago by

zacksiri

New activity in RedHatAI/Llama-3.2-3B-Instruct-quantized.w8a8 21 days ago

Update config.json with the correct state

#1 opened 21 days ago by

dsikka

New activity in MiniMaxAI/MiniMax-Text-01 about 1 month ago

Make model config compatible with Hugging Face MiniMax implementation

5

#39 opened about 1 month ago by

geetu040

New activity in mistralai/Magistral-Small-2506 about 2 months ago

Missing Tokenizer/Processor for use with Transformers

👍 1

5

#3 opened about 2 months ago by

mgoin

New activity in RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-FP8-dynamic 3 months ago

How should I input the image?

1

#3 opened 3 months ago by

CyberWolf0

New activity in RedHatAI/Qwen2.5-VL-72B-Instruct-quantized.w8a8 3 months ago

用vllm serve启动不了

1

#2 opened 4 months ago by

VenomEY

New activity in RedHatAI/Qwen2.5-VL-72B-Instruct-FP8-Dynamic 3 months ago

Fix processor_class to match upstream

#4 opened 3 months ago by

zifeitong

New activity in RedHatAI/Qwen2.5-VL-3B-Instruct-FP8-Dynamic 3 months ago

Remove image_processor_type

#1 opened 4 months ago by

pooya-davoodi-parasail

New activity in nm-testing/Llama-3_1-Nemotron-Ultra-253B-v1-FP8-dynamic 3 months ago

OSError: nm-testing/Llama-3_1-Nemotron-Ultra-253B-v1-FP8-dynamic does not appear to have a file named decilm.py

2

#2 opened 3 months ago by

TheDrummer

how to deploy this model without internet connection

1

#1 opened 4 months ago by

superahn

New activity in RedHatAI/Llama-4-Scout-17B-16E-Instruct-FP8-dynamic 4 months ago

Why not FP8 with static and per-tensor quantization?

👍 1

2

#2 opened 4 months ago by

wanzhenchn

New activity in mistralai/Mistral-Small-3.1-24B-Instruct-2503 4 months ago

Address discrepancies in the languages supported by the Mistral Small 3.1 2503

🔥 1

3

#54 opened 4 months ago by

fpaupier

New activity in RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-FP8-dynamic 4 months ago

Please update the chat template

1

#1 opened 4 months ago by

stelterlab

New activity in mistralai/Mistral-Small-3.1-24B-Instruct-2503 4 months ago

FP8 Dynamic/W8A16 Quants Please

4

#44 opened 4 months ago by

rjmehta

Problem hosting the model using vllm

➕ 3

4

#45 opened 4 months ago by

ShaoServient

New activity in RedHatAI/Qwen2.5-VL-72B-Instruct-quantized.w8a8 5 months ago

Remove image_processor_type

#1 opened 5 months ago by

pooya-davoodi-parasail

New activity in RedHatAI/Qwen2.5-VL-7B-Instruct-quantized.w8a8 5 months ago

Remove image_processor_type

1

#1 opened 5 months ago by

pooya-davoodi-parasail

New activity in RedHatAI/Qwen2.5-VL-72B-Instruct-FP8-Dynamic 5 months ago

Remove image_processor_type

#2 opened 5 months ago by

pooya-davoodi-parasail

New activity in RedHatAI/Qwen2.5-VL-7B-Instruct-FP8-Dynamic 5 months ago

Use Qwen2VLImageProcessor for image_processor_type

5

#2 opened 5 months ago by

pooya-davoodi-parasail