Issues report
#4
by
notafraud
- opened
First of all, thank you for this version! Repetitions are mostly fixed, and overall feel of writing is much better.
However, there are still issues with the new Magistral, including new ones:
- Repeating entire messages: I guess it stems from the thinking process, but I've already had 3 cases when either the same result is repeated 1 to 1, or it's rewritten.
- Less stable: even on recommended settings, Magistral have issues with stability of it's instruction tuning. There are no such issues on Mistral 3 and 3.2, but, just for record, Mistral 3.1 had a similar issue, but to a lesser degree. It's not noticeable until you try regenerating messages multiple times.
- Multilanguage is still worse than Mistral Small 3-3.2: Magistral (this and previous) are injecting english words too often.
- Thinking process with the recommended system instruction is way too long: most of the time it "doubts" itself countless times even on short and easy tasks.
Overall, it's the right direction, but something's off with the training process.