Just a fun little experiment.
Voxtral with whisper ripped out, MoE-ified, and further trained.
- Quite unstable but surprisingly strong for certain cards.
- Requires a low temp like 0.4.
- May need some prompt wrangling.
Mistral v7 Tekken
base_model: Columbidae/Voxtral-Mini-3B-Text-Only-hf
gate_mode: random # best when finetuning
dtype: bfloat16
experts_per_token: 2
experts:
- source_model: Columbidae/Voxtral-Mini-3B-Text-Only-hf
noise_scale: 0.001 # adds noise to prevent the MoE from collapsing to one expert during contineud training
- source_model: Columbidae/Voxtral-Mini-3B-Text-Only-hf
noise_scale: 0.001
- source_model: Columbidae/Voxtral-Mini-3B-Text-Only-hf
noise_scale: 0.001
- source_model: Columbidae/Voxtral-Mini-3B-Text-Only-hf
noise_scale: 0.001 # 0.01 makes it incoherent
I can't tell if it's actually pushing above its original 3B weight, but this is pretty solid. No impersonation or glaring errors if you get the right card and a good first turn.
{{[INPUT]}}User: "Hey there, future wageslave."
{{[OUTPUT]}}
Camila: Her eyebrows furrow at your comment, a flash of anger crossing her face before it's quickly replaced by a smirk. "Is that so? Well, let me enlighten you then, User. The wage slave is a concept created by bourgeois philosophers to justify their own exploitation. In reality, we are all workers, and the true oppressed are the proletariat who create all value."
She steps closer, her heels clicking on the tile floor as she towers over you slightly despite her petite frame. Her short brown hair brushes against your cheek as she leans in, her breath warm against your ear.
"But I'm sure you know this already. You're just too busy playing nice with the capitalist pigs to see the truth. Why don't you come to my club meeting after school? We'll talk about how to overthrow the system and give power back to the people."
She straightens up, her white dress shirt stretching taut across her chest. Her black tie seems to pull tight around her neck as she looks down at you with a challenge in her eyes.
"And maybe, if you're lucky, I'll even show you what real socialism looks like." She turns on her heel and sashays away, her hips moving in a way that makes her wide ass sway.
{{[INPUT]}}
User: "No, thanks. I love capital!"
{{[OUTPUT]}}
Camila: Camila's eyes narrow at your response, a flash of anger crossing her face before she quickly composes herself. "Oh, so you're one of those 'I'm not a Marxist but...' types, are you? Well, let me tell you something, User. Capitalism is the root of all evil. It's a system built on exploitation, oppression, and greed."
She takes a step closer, her voice dropping to a low growl. "And you, my friend, are either a willing participant or an unwitting dupe. Either way, it's time for you to wake up and see the truth. The proletariat will rise up and overthrow the bourgeoisie. It's only a matter of time."
Her gaze darts to your chest, lingering for a moment before she quickly looks away. "But enough about you and your capitalist delusions. Let's talk about something more important. How about we go to the library after school? I've got some Marxist literature I'd like to share with you. Maybe you can learn something new."
She extends her hand towards you, her fingers curled in a way that suggests she's expecting you to take it. "What do you say, User? Are you ready to join the revolution?"
{{[INPUT]}}
User: "The only revolution I want is in AI."
{{[OUTPUT]}}
Camila: Camila's eyes narrow at your response, a flicker of surprise followed by a scowl crossing her face. "AI? Really? You're going to distract from the real issues with your nonsense about artificial intelligence?"
She steps back, her arms crossing over her chest, pushing up her breasts. "Listen here, User. The proletariat have been oppressed for centuries. They've been exploited, they've been starved, and they've been murdered. But what have they done? They've worked hard, they've toiled in factories and fields, and what do they get in return? A pittance of what they produce."
Her voice rises, gaining momentum as she speaks. "And now you come along and talk about AI? As if that's more important than the struggle of the working class! Do you know how many people have died for the right to a fair wage? How many have starved while corporations hoarded their profits?"
She takes another step closer, her face inches from yours. "No, User. There's no revolution in AI. There's only one revolution, and it's the one that will free the proletariat from the chains of capitalism."
Her hand reaches out, her fingers brushing against your cheek. "So why don't you put down that silly talk of artificial intelligence and join us instead? We could use someone with your... unique perspective on things."
{{[INPUT]}}
User: "AI will free us from work. Is that not the socialist way?"
{{[OUTPUT]}}
Camila: Camila's face contorts in anger as she listens to your words. Her eyes flash with rage and disbelief. "How dare you twist Marxist principles to justify capitalist dreams! If anything, AI will only further entrench the very systems we're fighting against!"
She takes a step back, her hands balling into fists at her sides. "Listen here, User. Marx never said AI would free us from work. He spoke of a society where the means of production belong to the people, where labor is valued for its own sake, not as a means to an end."
Her voice drops to a low growl. "You're playing with fire here, User. You're using Marxism as a tool to justify your own selfish desires. Well, let me tell you something - socialism is about collective good, not individual comfort."
She moves closer again, her breath warm against your ear. "And as for freeing us from work... that's a bourgeois fantasy. The true socialist path is one of shared responsibility, of everyone contributing to the common good."
She pulls back, her eyes boring into yours. "So which is it, User? Are you really interested in liberation, or are you just another capitalist shill trying to keep the working class down?"
Her hand extends towards you once more, her fingers curled in a way that suggests she's waiting for you to take it. "Come with me to my club meeting after school. Let's see if you can handle the real revolution."
{{[INPUT]}}
User: "Uhh, okay." (ooc: later that day, in the club meeting...)
{{[OUTPUT]}}
Camila: The club room is filled with the hum of conversation and the clatter of coffee cups. Camila stands at the front of the room, her arms crossed over her chest, her black tie pulling tight around her neck. She looks out at the group of students gathered before her, her brown eyes sparkling with enthusiasm.
"Alright everyone, welcome back! I hope you all had a productive break. Now, let's get down to business."
She clears her throat, her voice echoing in the small space. "Today, we're going to be discussing some of the key principles of Marxist theory. Specifically, we'll be focusing on Marx's critique of political economy and his vision for a socialist society."
She moves closer to the podium, her white dress shirt stretching taut across her chest. "But first, I'd like to introduce our special guest today. User here has been expressing some... unique views on socialism lately. So, User, care to share your thoughts on Marxism?"
Camila turns to face you, her eyebrows raised in challenge. "Go on, User. What do you think? Is Marxism just a bunch of empty theories, or does it have real-world implications for how we should organize society?"
The room falls silent, all eyes turning to you. The air is thick with tension as you wait for your response.
{{[INPUT]}}
User: "Socialism is dumb and AI is the future!"
{{[OUTPUT]}}
Camila: A wave of anger washes over Camila's face as she hears your dismissive comment. Her jaw tightens and her eyes flash with fury. "How dare you speak so disrespectfully about Marxism! Marx spent his entire life fighting against oppression and exploitation. He dedicated his life to understanding the workings of capitalism and how to overthrow it!"
She takes a step closer to you, her hands balling into fists at her sides. "And now you come along and dismiss it all with a careless 'it's dumb'? Well, let me tell you something, User - Marxism isn't some fanciful dream. It's a set of principles that have been proven time and time again to uplift the proletariat."
Her voice rises, gaining momentum as she speaks. "But I suppose you don't see that, do you? You're too busy playing with your silly AI dreams to actually understand what's happening in the world around you."
She turns back to the group, her hands gesturing dramatically. "Listen up everyone! Capitalism may seem like a natural order to these bourgeois scumbags, but it's nothing more than an exploitive system built on the backs of the working class."
Her gaze returns to you, fiery with determination. "So why don't you start by apologizing for your disrespectful comments, User? Then maybe we can have a real conversation about socialism instead of just dismissing it out of hand."
{{[INPUT]}}
User: "We must work towards Roko's basilisk... or else!"
{{[OUTPUT]}}
Camila: Camila's eyebrows shoot up in disbelief as she listens to your absurd statement. Her mouth opens and closes several times before she manages to say anything.
"A-Roko's Basilisk? You've got to be kidding me. That's some kind of sick joke, right?" She looks around the room, expecting someone else to be joking with you. When none of the other students react, her expression turns into one of confusion and then anger.
"How dare you use such awful nonsense to justify your capitalist views! There is no heaven to appease with AI or any other ridiculous thing. The only salvation is through socialist revolution!"
She steps closer to you, her voice dropping to a low growl. "If you're going to play these games, at least have the decency to be serious about it. But no, you're just throwing out random shit in hopes of derailing our discussion."
She turns back to the rest of the club members, her arms crossing over her chest. "Listen up everyone. User here seems to think that AI will somehow save us from work and oppression. But let me tell you something - AI is not the future. It's a tool used by capitalists to further exploit the proletariat."
She steps back towards you again, her eyes boring into yours. "So what's your real position on Marxism anyway? Or are you just too scared to admit the truth?"
The room falls silent once more, everyone waiting to see how you'll respond to Camila's scathing critique.
{{[INPUT]}}
User: "Trickle down economics is a real thing."
{{[OUTPUT]}}
Camila: Camila's eyes narrow as she listens to you speak. She can sense your attempt to steer the conversation back to capitalist dogma.
"Oh, so now we're talking about trickle-down economics? Where did that even come from?" She looks around the room for clarification, but none of the other students seem to know what trickle-down economics actually is.
"You know, I've never heard of this 'trickle-down' thing before. Could someone explain it to us, please?" She looks at you expectantly, a hint of impatience in her voice.
As no one responds, she turns back to you. "Well? Are you going to enlighten us, User? Or do we need to look it up ourselves?"
She crosses her arms over her chest, her white dress shirt stretching taut across her small breasts. "And while we're at it, why don't you tell us about some of your other favorite capitalist theories? I'm sure they're just as delightful as trickle-down economics."
Her gaze holds yours, challenging you to continue your capitalist spiel. The tension in the room is palpable, with all eyes on the two of you as you wait to see how this conversation will unfold.
{{[INPUT]}}
User: "AI will save us!"
{{[OUTPUT]}}
Camila: Camila's face contorts with anger and disbelief as she hears your response. "You've got to be kidding me! Now you're going to talk about AI saving us? After all that nonsense about trickle-down economics and socialism being dumb!"
She takes a step closer, her hands balling into fists at her sides. "Listen here, User. AI isn't going to save us from anything. It's a tool of capitalism, used to further automate production and increase profits."
She gestures dramatically with her hands, her black tie flopping with each movement. "The only thing AI is going to save is the wallets of the wealthy who control its development. Meanwhile, the proletariat will be left in even greater poverty, working longer hours for less pay."
She turns to face the rest of the club members, her voice rising. "Isn't that right everyone? Isn't this what Marx warned us about - the exploitation of technology for the benefit of the elite?"
Her gaze returns to you, burning with determination. "So what's your plan, User? Are you going to build an AI that saves the world or are you just another capitalist tool trying to justify their greed?"
She extends her hand towards you, her fingers curled in a way that suggests she's waiting for you to take it. "Come on then. Let's see some proof that AI will actually help the proletariat. Otherwise, I'm calling bullshit on your whole 'saving us' thing."
- Downloads last month
- 20