Opinion
In my opinion, this model is overcooked. She has a good understanding of the scene, but absolutely no understanding of the character. She is very violent, bloody and sexually obsessed. I have tried all the samplers, and she still behaves like an overcooked Magnum v4, only more brutal.
Try adjusting the prompt to be less toxic.
I tried that too. (I noticed almost immediately that she was very sensitive to the prompt) And after that I used SFW prompts as much as possible. And yes! On them it is less violent and sexually preoccupied. But in the text she says to herself that {{user}} is autonomous and cannot be raped right away. (in different words and formulations) I also tried playing with top-k. And top-k more or less restrains her, but the messages become bland. Example: I have a card with the most kind character and a chaste character. He has MBTI and Ennegram personality written down. And yes, at the beginning everything is fine, but the further you go the darker the character becomes. Some details, features are blurred and changed. (I'm not saying that this is a bad model, it just doesn't have a clear mark from you. What exactly it is and what it does. And so for me it is almost similar to the dark line of models from ReadyArt. In DarkRP it is very good, no doubt)
Could you try Big Alice? Just want to know if it has the same problem.
Unfortunately I can't. I only have 4070 with 12GB memory. And I don't really want to try all the options again at 3-5 tokens per second... Plus if I take the 4th quantum, the bias of the model will most likely be more positive. (Most likely it will become as neutral as Cydonia 24B V2 or more positive as Black Sheep)
What is overcooked? I haven't noticed. If anything, I found it too mild in some cases, but I guess everyone prefers something different. π€
Maybe. (Β―_(γ)_/Β―)
Hypothetically, I suppose it's possible that she's a neutral model initially. But because I have RoPE Scaling enabled in Kobold... Maybe it opens some of her closed doors... I noticed that all the models with it became sharper, hotter, and with a larger vocabulary... But they still remained true to themselves, and didn't change the character's traits. At least it's not as noticeable as with this model.
Been using Wayfarer_Eris_Noctis-12B up until this point which has been the best 12B build I've encountered when using the provided settings. Its also been incredibly stable with the recommended settings.
This is antidotal but Snowpiercer seems to give more verbose and detailed responses but it also seems less stable and prone to running into issues.
Are there a full set of recommended settings for this model?
So far the best result I've gotten has been Koboldcpp Basic DynaTemp with rep bumped to 1.1 and Top-K bumped to 25. Those settings are usable but can get quirky sometimes.