microsoft
/

phi-4-gguf

Text Generation

Model card Files Files and versions

211 GB

2 contributors

History: 4 commits

gugarosa's picture

Delete phi-4-IQ2_M.gguf due to poor quantization expectation.

14bdc19 verified 4 days ago

.gitattributes

1.56 kB

chore(root): Initial files upload. 11 months ago
CODE_OF_CONDUCT.md

453 Bytes

chore(root): Initial files upload. 11 months ago
LICENSE

1.11 kB

chore(root): Initial files upload. 11 months ago
README.md

13.5 kB

chore(root): Initial files upload. 11 months ago
SECURITY.md

2.7 kB

chore(root): Initial files upload. 11 months ago
phi-4-IQ3_M.gguf

6.91 GB
xet

chore(root): Re-convert and re-quantize files. 7 months ago
phi-4-IQ3_S.gguf

6.5 GB
xet

chore(root): Re-convert and re-quantize files. 7 months ago
phi-4-IQ3_XS.gguf

6.25 GB
xet

chore(root): Re-convert and re-quantize files. 7 months ago
phi-4-IQ3_XXS.gguf

6.08 GB
xet

chore(root): Re-convert and re-quantize files. 7 months ago
phi-4-IQ4_NL.gguf

8.44 GB
xet

chore(root): Re-convert and re-quantize files. 7 months ago
phi-4-IQ4_XS.gguf

8.01 GB
xet

chore(root): Re-convert and re-quantize files. 7 months ago
phi-4-Q2_K.gguf

5.55 GB
xet

chore(root): Re-convert and re-quantize files. 7 months ago
phi-4-Q3_K.gguf

7.36 GB
xet

chore(root): Re-convert and re-quantize files. 7 months ago
phi-4-Q3_K_L.gguf

7.93 GB
xet

chore(root): Re-convert and re-quantize files. 7 months ago
phi-4-Q3_K_S.gguf

6.5 GB
xet

chore(root): Re-convert and re-quantize files. 7 months ago
phi-4-Q4_0.gguf

8.38 GB
xet

chore(root): Re-convert and re-quantize files. 7 months ago
phi-4-Q4_1.gguf

9.27 GB
xet

chore(root): Re-convert and re-quantize files. 7 months ago
phi-4-Q4_K.gguf

9.05 GB
xet

chore(root): Re-convert and re-quantize files. 7 months ago
phi-4-Q4_K_S.gguf

8.44 GB
xet

chore(root): Re-convert and re-quantize files. 7 months ago
phi-4-Q5_0.gguf

10.2 GB
xet

chore(root): Re-convert and re-quantize files. 7 months ago
phi-4-Q5_1.gguf

11 GB
xet

chore(root): Re-convert and re-quantize files. 7 months ago
phi-4-Q5_K.gguf

10.6 GB
xet

chore(root): Re-convert and re-quantize files. 7 months ago
phi-4-Q5_K_S.gguf

10.2 GB
xet

chore(root): Re-convert and re-quantize files. 7 months ago
phi-4-Q6_K.gguf

12 GB
xet

chore(root): Re-convert and re-quantize files. 7 months ago
phi-4-Q8_0.gguf

15.6 GB
xet

chore(root): Re-convert and re-quantize files. 7 months ago
phi-4-TQ1_0.gguf

3.59 GB
xet

chore(root): Re-convert and re-quantize files. 7 months ago
phi-4-TQ2_0.gguf

4.23 GB
xet

chore(root): Re-convert and re-quantize files. 7 months ago
phi-4-bf16.gguf

29.3 GB
xet

chore(root): Re-convert and re-quantize files. 7 months ago