Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
amd
/
Mixtral-8x7B-Instruct-v0.1-WMXFP4FP8-AMXFP4FP8-AMP-KVFP8
like
0
Follow
AMD
2.07k
Safetensors
mixtral
quark
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
5
main
Mixtral-8x7B-Instruct-v0.1-WMXFP4FP8-AMXFP4FP8-AMP-KVFP8
38.2 GB
2 contributors
History:
13 commits
XuebinWang
remove unused weight file model-00007-of-00007.safetensors
72bb4a6
verified
10 days ago
.gitattributes
Safe
1.52 kB
initial commit
3 months ago
README.md
Safe
3.18 kB
update model with several fixings (#5)
11 days ago
chat_template.jinja
Safe
1.06 kB
upload model (#1)
3 months ago
config.json
Safe
1.13 MB
update Quark quantized Mixtral-8x7B-Instruct-v0.1 AMP model with better accuracies (#3)
about 2 months ago
generation_config.json
Safe
111 Bytes
update Quark quantized Mixtral-8x7B-Instruct-v0.1 AMP model with better accuracies (#3)
about 2 months ago
model-00001-of-00008.safetensors
Safe
4.98 GB
xet
update Quark quantized Mixtral-8x7B-Instruct-v0.1 AMP model with better accuracies (#3)
about 2 months ago
model-00002-of-00008.safetensors
Safe
4.98 GB
xet
update Quark quantized Mixtral-8x7B-Instruct-v0.1 AMP model with better accuracies (#3)
about 2 months ago
model-00003-of-00008.safetensors
Safe
4.99 GB
xet
update Quark quantized Mixtral-8x7B-Instruct-v0.1 AMP model with better accuracies (#3)
about 2 months ago
model-00004-of-00008.safetensors
Safe
4.97 GB
xet
update Quark quantized Mixtral-8x7B-Instruct-v0.1 AMP model with better accuracies (#3)
about 2 months ago
model-00005-of-00008.safetensors
Safe
5 GB
xet
update Quark quantized Mixtral-8x7B-Instruct-v0.1 AMP model with better accuracies (#3)
about 2 months ago
model-00006-of-00008.safetensors
Safe
4.95 GB
xet
update Quark quantized Mixtral-8x7B-Instruct-v0.1 AMP model with better accuracies (#3)
about 2 months ago
model-00007-of-00008.safetensors
Safe
4.94 GB
xet
update Quark quantized Mixtral-8x7B-Instruct-v0.1 AMP model with better accuracies (#3)
about 2 months ago
model-00008-of-00008.safetensors
Safe
3.44 GB
xet
update Quark quantized Mixtral-8x7B-Instruct-v0.1 AMP model with better accuracies (#3)
about 2 months ago
model.safetensors.index.json
Safe
243 kB
update Quark quantized Mixtral-8x7B-Instruct-v0.1 AMP model with better accuracies (#3)
about 2 months ago
special_tokens_map.json
Safe
437 Bytes
upload model (#1)
3 months ago
tokenizer.json
Safe
3.51 MB
update the AMP model with better accuracy numbers and lower effective bitwidth (5.6) (#2)
about 2 months ago
tokenizer.model
Safe
493 kB
xet
upload model (#1)
3 months ago
tokenizer_config.json
Safe
1.05 kB
update the AMP model with better accuracy numbers and lower effective bitwidth (5.6) (#2)
about 2 months ago