nvidia
/

DeepSeek-V3-0324-FP4

Text Generation

Model Optimizer

Model card Files Files and versions Community

Resources

View closed (0)

The given huggingface model architecture DeepseekV3ForCausalLM is not supported in TRT-LLM yet

#3 opened 4 days ago by

How to run model on 8xH200

#2 opened about 1 month ago by

Remove quantization_config from config.json

#1 opened about 1 month ago by