context.vn

mmlu Redux

11 models evaluated

#ModelProviderTypeScore
1Claude Opus 4.5AnthropicClosedclaude-opus-4-5
2Qwen3.7 MaxAlibabaClosedqwen3-7-max
3Qwen3.5 397BAlibabaOpenqwen3-5-397b
4Qwen3.7 PlusAlibaba · Closed94.5%
5Qwen3.6 PlusAlibaba · Closed94.5%
6Qwen3.6-27BAlibaba · Open weight93.5%
7DeepSeek V4 Pro BaseDeepSeek · Open weight90.8%
8DeepSeek V4 Flash BaseDeepSeek · Open weight89.4%
9Mellum2-12B-A2.5B-ThinkingJetBrains · Open weight86.2%
10Mellum2-12B-A2.5B-InstructJetBrains · Open weight78.1%
11MiniCPM5-1BOpenBMB · Open weight70.1%