Hugging Face's logo

mahihossain666
/
llama-2-70b-hf-quantized-4bits-GPTQ

Text Generation
Transformers
Safetensors
llama
text-generation-inference
4-bit precision
gptq
Model card Files
xet
Community

Quantized to 4bit precision using AutoGPTQ

Downloads last month
1
Safetensors
Model size
69B params
Tensor type
I32
·
F16
·
Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Dataset used to train mahihossain666/llama-2-70b-hf-quantized-4bits-GPTQ