Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
TheBloke
/
KAI-7B-Instruct-GPTQ
like
3
Text Generation
Transformers
Safetensors
mistral
finetuned
Instruct
code
conversational
text-generation-inference
4-bit precision
gptq
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
Can you please help me quantize vivo-ai/BlueLM-7B-Chat to int8?
#1
by
dafen
- opened
Nov 9, 2023
Discussion
dafen
Nov 9, 2023
vivo-ai/BlueLM-7B-Chat
https://huggingface.co/vivo-ai/BlueLM-7B-Chat
See translation
Edit
Preview
Upload images, audio, and videos by dragging in the text input, pasting, or
clicking here
.
Tap or paste here to upload images
Comment
·
Sign up
or
log in
to comment
