context.vn

pinch Bench

46 models evaluated

#ModelProviderTypeScore
3MiniMax M2.7MiniMaxOpenminimax/minimax-m2.7
4Claude Opus 4.6anthropic/claude-opus-4.6AnthropicClosed
5MiMo-V2-Omnixiaomi/mimo-v2-omniXiaomiClosed
6GLM-5.1z-ai/glm-5.1Z.AIOpen
7Qwen3.5-122B-A10Bqwen/qwen3.5-122b-a10bAlibabaOpen
8Claude Sonnet 4.6anthropic/claude-sonnet-4.6AnthropicClosed
9GLM-5z-ai/glm-5Z.AIOpen
10Qwen3.5 397Bqwen/qwen3.5-397b-a17bAlibabaOpen
11MiMo-V2-Proxiaomi/mimo-v2-proXiaomiClosed
12GLM-5-Turboz-ai/glm-5-turboZ.AIClosed
13Claude Sonnet 4.5anthropic/claude-sonnet-4.5AnthropicClosed
14Seed-2.0-Litebytedance-seed/seed-2.0-liteByteDanceClosed
16GPT-5.4openai/gpt-5.4OpenAIClosed
17Qwen3.5 Plusqwen/qwen3.5-plus-02-15AlibabaClosed
19Claude Opus 4.5anthropic/claude-opus-4.5AnthropicClosed
20Kimi K2.5moonshotai/kimi-k2.5Moonshot AIOpen
21Qwen3.5-27Bqwen/qwen3.5-27bAlibabaOpen
22MiniMax M2.5minimax/minimax-m2.5MiniMaxClosed
23Gemini 3.1 Progoogle/gemini-3.1-pro-previewGoogleClosed
24Claude Haiku 4.5anthropic/claude-haiku-4.5AnthropicClosed
28GLM-4.5-Airz-ai/glm-4.5-airZ.AIClosed
29Step 3.5 Flashstepfun/step-3.5-flashStepFunOpen
30Gemini 3 Flashgoogle/gemini-3-flash-previewGoogleClosed
33Nemotron 3 Super 120B A12Bnvidia/nemotron-3-super-120b-a12bNVIDIAOpen
34Qwen3 Maxqwen/qwen3-max-thinkingAlibabaClosed
35Qwen3.5-35B-A3Bqwen/qwen3.5-35b-a3bAlibabaOpen
36GPT-5.4 miniopenai/gpt-5.4-miniOpenAIClosed
37Grok 4.1 Fastx-ai/grok-4.1-fastxAIClosed
39Grok 4.20x-ai/grok-4.20xAIClosed
41Mercury 2inception/mercury-2InceptionClosed
42MiMo-V2-Flashxiaomi/mimo-v2-flashXiaomiOpen
44GPT-5.4 nanoopenai/gpt-5.4-nanoOpenAIClosed
45GPT-5 miniopenai/gpt-5-miniOpenAIClosed
46DeepSeek V3.2deepseek/deepseek-v3.2DeepSeekOpen
47Gemini 3 Progoogle/gemini-3-pro-previewGoogleClosed
48GLM-5V-Turboz-ai/glm-5v-turboZ.AIClosed
52Gemini 2.5 Progoogle/gemini-2.5-proGoogleClosed
54GPT-4o miniopenai/gpt-4o-miniOpenAIClosed
57Gemini 2.5 Flashgoogle/gemini-2.5-flashGoogleClosed
58GPT-4oopenai/gpt-4oOpenAIClosed
59GPT-5 nanoopenai/gpt-5-nanoOpenAIClosed
60GPT-OSS 120Bopenai/gpt-oss-120bOpenAIOpen
61GPT-OSS 20Bopenai/gpt-oss-20bOpenAIOpen
63Llama 4 Maverickmeta-llama/llama-4-maverickMetaOpen
67GPT-5.4 Proopenai/gpt-5.4-proOpenAIClosed
68Llama 4 Scoutmeta-llama/llama-4-scoutMetaOpen