Please Explain

by PlayAI - opened Jun 21

Jun 21

Hi there—could you walk me through how you converted the joycaption-beta-one model to GGUF format and got it working in Ollama? I’ve tried using other users quantized versions myself, but none of them seem to run in ollama—what are you doing differently?

concedo

Owner Jun 21

First, I'd recommend not using Ollama and switching to KoboldCpp instead, you'll have better support.

Secondly, here's a guide I wrote on how I converted it.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment