Instability, some issues, could you please help?
Hi. You did an excellent fine-tune. Just to be sure, I'll mention the model name: Magnum Mistral Small 3.2 24B. But there's one problem - during roleplay, it doesn't wrap actions, descriptions, and emotions in asterisks like this. Or it might suddenly write something off-topic from the roleplay, which is rare but still affects stability. Sometimes it wraps dialogue in asterisks, which again messes up formatting "like this". Is there any way to fix this instability?
I can show the problem in Discord with screenshots and other things.
Write me please if you can solve this problem. Discord swatman8331
System prompt does not help to solve the problem.
That's odd because my experience with Magnum has been quite the opposite - it has a bias in favor of adding asterisk wrapping even when the character card's first message is not written with asterisk wrapping.
It's hard to comment on what's happening on your end without more information:
- What frontend are you using? Chat completions or raw text completions?
- What quant are you using?
- What sampler settings are you using?
- What character cards/prompts are you using?
I would ask you to write to me in discord, because there is a faster and more specific connection than in the discussions here. I can just write you a link, you will see the result yourself.
Please visit the website, select any character for conversation, choose your model from the list (it's top 2). There will be an issue during roleplay.
By the way, I was asked to ask you - are you interested in becoming a pre-trainer?
Problem - It’s the template
Issue
Hmm so it's through a chat service - it's a bit hard to say since I'm not sure what is being done exactly behind the scenes. My suspicion would be a prompt templating issue or sampler issue.
I suggest you contact the site staff, they have been trying to solve this problem for several days now. Or we can contact you. Please provide your discord profile contacts or email.
Sent you a requets on Discord, can discuss there if it's easier for you.
I wrote to you on discord.