AmpereComputing/phi-4-mini-instruct-gguf
4B
•
Updated
•
19
Phi 4
Ampere's quantization formats (Q4_K_4 / Q8R16) require Ampere optimized llama.cpp available here: https://hub.docker.com/r/amperecomputingai/llama.cpp