I would like to inquire about the performance of MMMU.
#2
by
scj0709
- opened
Hello!
I'm truly impressed by your model. In my own qualitative evaluation, it outperformed several smaller models and showed the best performance.
Because of this, I wanted to use your model and conducted a quantitative evaluation using MMMU for application comparison.
However, the MMMU results differ significantly from the numbers reported in your paper. Why could this be happening?