How to use nesty/sg-bart-large-4096-gptq-2bit with Transformers:
# Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("nesty/sg-bart-large-4096-gptq-2bit", trust_remote_code=True) model = AutoModelForSeq2SeqLM.from_pretrained("nesty/sg-bart-large-4096-gptq-2bit", trust_remote_code=True)
The community tab is the place to discuss and collaborate with the HF community!
