John6666
/

Llama-3.2-3B-Instruct-bnb-4bit

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Quants of unsloth/Llama-3.2-3B-Instruct.

Downloads last month: 5

Safetensors

Model size

1.14B params

Tensor type

F32

·

BF16

·

U8

·

Inference Providers NEW

Text Generation

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for John6666/Llama-3.2-3B-Instruct-bnb-4bit

Base model

meta-llama/Llama-3.2-3B-Instruct

Finetuned

unsloth/Llama-3.2-3B-Instruct

Quantized

(99)

this model