bobchenyx
/

DeepSeek-V3-0324-MLA-GGUF

Text Generation

Model card Files Files and versions

bobchenyx commited on 3 days ago

Commit

f63560d

·

verified ·

1 Parent(s): 4b0e7cc

Update README.md

Files changed (1) hide show

README.md +4 -4

README.md CHANGED Viewed

@@ -18,10 +18,10 @@ Original model: Adopting **BF16** & **Imatrix** from [unsloth/DeepSeek-V3-0324-G
 All quants made with modification of llama.cpp based on [bartowski1182-llama.cpp](https://github.com/bartowski1182/llama.cpp).
-IQ1_M / Q4_K / Q8_0 : 144.24 GiB (1.85 BPW)
-IQ1_S / Q4_K / Q8_0 : 129.94 GiB (1.66 BPW)
-Q2_K : 222.01 GiB (2.84 BPW)
-Q4_K_M : 381.64 GiB (4.89 BPW)

 All quants made with modification of llama.cpp based on [bartowski1182-llama.cpp](https://github.com/bartowski1182/llama.cpp).
+- **IQ1_M / Q4_K / Q8_0 : 144.24 GiB (1.85 BPW)**
+- **IQ1_S / Q4_K / Q8_0 : 129.94 GiB (1.66 BPW)**
+- **Q2_K : 222.01 GiB (2.84 BPW)**
+- **Q4_K_M : 381.64 GiB (4.89 BPW)**