Use with other model?

#3
by JermemyHaschal - opened

Hello,

Can the vision adapter be used with another text-only LLM, e.g. Mistral Nemo? And is there any quality loss compared to using the official Joycaption LLM with the vision adapter?

Yes, It's a llama3 projector so it will work with any llama3 model. However it will not be very good as it's not finetuned for it.

Yes, It's a llama3 projector so it will work with any llama3 model. However it will not be very good as it's not finetuned for it.

Great, thank you!

JermemyHaschal changed discussion status to closed

Sign up or log in to comment