Best open source model ever, period.
#1
by
BigBlueWhale
- opened
This comment has been hidden
I agree.
After trying and failing at getting moe models to work with me, instead of against me, for nearly a whole day, few months back, I gave up and stuck with 32b dense ever since, and I just ignored every moe release ever since.
So I'm very thankful to qwen team for another 32b dense release. I was getting a little worried we will never see another one.
80B-A3B is really good though, easily beat original 3-32B.