PrunaAI
/

Mistral-7B-v0.3-GGUF-smashed

Model card Files Files and versions

Mistral-7B-v0.3-GGUF-smashed

40.9 GB

1 contributor

History: 11 commits

sharpenb's picture

c8b84ac7ff23f60c41af079f0f6d0f1d9710aad3532b6b7a23db7e83548f6922

188ddcd verified over 1 year ago

.gitattributes

2.15 kB

c8b84ac7ff23f60c41af079f0f6d0f1d9710aad3532b6b7a23db7e83548f6922 over 1 year ago
Mistral-7B-v0.3.Q2_K.gguf

2.72 GB
xet

aaa3bb923616c74715ff8a76cd57ab1519a1df9236aa74a38764326ed354d963 over 1 year ago
Mistral-7B-v0.3.Q3_K_L.gguf

3.83 GB
xet

8731a6444d2666f9773a9fa1129f420d3ffaf35f0fad3a67e092a4f062d8983c over 1 year ago
Mistral-7B-v0.3.Q3_K_M.gguf

3.52 GB
xet

845093f7606d39bb377262f6e5b4ef7d360012c8ff0d3769c9b10106550cb6ab over 1 year ago
Mistral-7B-v0.3.Q3_K_S.gguf

3.17 GB
xet

0d2d8882ae926518a85238dc410115e3c27fad802158dee2012dc7cbd99ec7cf over 1 year ago
Mistral-7B-v0.3.Q4_0.gguf

4.11 GB
xet

2e336953c69f4fa405a64198f1c63a56c3cd7cff4cf0135fc3f4ddf80744d821 over 1 year ago
Mistral-7B-v0.3.Q4_1.gguf

4.56 GB
xet

ae1cf07e8f4bb824e03b33317d0eee208972f96e6e57de05b143f6d95fa5c22c over 1 year ago
Mistral-7B-v0.3.Q4_K_M.gguf

4.37 GB
xet

b75454292dd500fce975d0113f7515833d5f3f3a6769bb6c217f00501a50702d over 1 year ago
Mistral-7B-v0.3.Q4_K_S.gguf

4.14 GB
xet

94fb4d677ad25ee8a8d63673793a304d24ee9eefb4308445d1933399679c0f81 over 1 year ago
Mistral-7B-v0.3.Q5_0.gguf

5 GB
xet

2cc62364fc8d9c2babcace66d59100e2cace3ca64475da0ab05b3e9910157b14 over 1 year ago
Mistral-7B-v0.3.Q5_1.gguf

5.45 GB
xet

c8b84ac7ff23f60c41af079f0f6d0f1d9710aad3532b6b7a23db7e83548f6922 over 1 year ago