kylesayrs/Meta-Llama-3-8B-Instruct-FP8-yes_quant-layer-sequential-noprop
8B
•
Updated
•
1
Kyle Sayers
kylesayrs
AI & ML interests
Accelerating ML inference @ Red Hat
Recent Activity
updated
a model
38 minutes ago
nm-testing/granite-20b-code-instruct-8k-quantized.w4a16
published
a model
39 minutes ago
nm-testing/granite-20b-code-instruct-8k-quantized.w4a16
updated
a model
4 days ago
nm-testing/Llama-3.1-8B-Instruct-bearester-quant
Organizations
kylesayrs/Meta-Llama-3-8B-Instruct-FP8-no_quant-layer-sequential-noprop
8B
•
Updated
•
1
kylesayrs/Meta-Llama-3-8B-Instruct-FP8-no_quant-linear
8B
•
Updated
•
2
kylesayrs/Meta-Llama-3-8B-Instruct-FP8-yes_quant-linear
8B
•
Updated
•
1
kylesayrs/Meta-Llama-3-8B-Instruct-FP8-yes_quant-layer
8B
•
Updated
•
2
kylesayrs/Meta-Llama-3-8B-Instruct-FP8-no_quant-layer
8B
•
Updated
•
1