context.vn
Menu

vals Live Code Bench

142 models evaluated

#ModelProviderTypeScore
1Claude Fable 5.1AnthropicProprietary90.5%
2Claude Fable 5AnthropicProprietary89.8%
3Gemini 3.8 FlashGoogleProprietaryhigh reasoning
4Claude Opus 5Anthropic · Closed89.0%
5Gemini 3.7 FlashGoogle · Closedhigh reasoning88.7%
6Gemini 3.1 Pro PreviewGooglehigh reasoning88.5%
7Grok 4.6xAI · Closedhigh reasoning88.2%
8Gemini 3.6 FlashGoogle · Closedhigh reasoning88.1%
9GPT-5.2-CodexOpenAI · Closed88.0%
10Qwen3.8 MaxAlibaba · Open weight87.9%
11Claude Opus 4.8Anthropic · Closed87.8%
12Gemini 3.5 FlashGoogle · Closedhigh reasoning87.6%
13DeepSeek V4 Pro 0813DeepSeek · Closedmax reasoning87.5%
15Grok 4.5xAI · Closedhigh reasoning87.4%
16GPT-5.3 CodexOpenAI · Closedxhigh reasoning87.3%
17DeepSeek V4 Flash 0731DeepSeek · Closedhigh reasoning87.3%
18Kimi K3Moonshot AI · Closedmax reasoning87.2%
19Qwen3.7 MaxAlibaba · Closed87.1%
20Kimi K2.6Moonshot AI · Open weight86.8%
21GPT-5 miniOpenAI · Closedhigh reasoning86.6%
22GPT-5.1OpenAI · Closedhigh reasoning86.5%
23Gemini 3 Pro PreviewGoogle86.4%
24Nemotron 3 Ultra 550b A55bNvidia86.0%
25Qwen3.6 PlusAlibaba · Closed86.0%
26Inkling-SmallThinking Machines Lab · Open weight0.99 reasoning85.9%
27GPT-5.6 TerraOpenAI · Closedxhigh reasoning85.9%
28GPT-5OpenAIhigh reasoning85.9%
29Muse Spark 1.1Meta · Closedxhigh reasoning85.9%
30Gemini 3 Flash PreviewGooglehigh reasoning85.6%
31GPT-5.1-CodexOpenAI · Closed85.5%
32InklingThinking Machines Lab · Open weight0.99 reasoning85.5%
33GPT-5.2OpenAI · Closedxhigh reasoning85.4%
34Qwen3.5 Plus ThinkingAlibaba85.3%
35GPT-5.5OpenAI · Closedxhigh reasoning85.3%
36Claude Opus 4.7Anthropic · Closed85.1%
37GPT-5 CodexOpenAIhigh reasoning84.7%
38Claude Opus 4.6 (Adaptive)Anthropic · Closed84.7%
39Grok 4.3xAI · Closedhigh reasoning84.5%
40Grok 4.20 0309 ReasoningxAI84.3%
41GPT-5.4OpenAI · Closedxhigh reasoning84.1%
42GPT-5.4 nanoOpenAI · Closedhigh reasoning84.0%
43Qwen3.8-27BAlibaba · Open weightxhigh reasoning84.0%
44Ling 3.0 Flash 2607Ant84.0%
45o3OpenAI · Closedhigh reasoning83.9%
46Kimi K2.5 ThinkingMoonshot AI83.9%
47Claude Opus 4.5 ThinkingAnthropic · Closed83.7%
48GPT-5.1-Codex-MaxOpenAI · Closedhigh reasoning83.6%
49Qwen3.5 FlashAlibaba · Closed83.3%
50Grok 4 0709xAI83.2%
51GPT-OSS 120BOpenAI · Open weight83.2%
52GPT-5.6 SolOpenAI · Closedmax reasoning82.6%
53Claude Sonnet 5Anthropic · Closed82.4%
54GLM-4.7Z.AI · Open weight82.2%
55O4 MiniOpenAIhigh reasoning82.2%
56MiniMax M3MiniMax · Open weight82.2%
57Claude Sonnet 4.6Anthropic · Closed82.1%
58Kimi K2.7 CodeMoonshot AI · Open weight82.0%
59GLM 5 ThinkingZhipu AI81.9%
60MiniMax M2.1MiniMax81.8%
61MiMo-V2.5Xiaomi · Closed81.5%
62GPT-5.4 miniOpenAI · Closedxhigh reasoning81.5%
63GLM-5.1Z.AI · Open weight81.4%
64MiMo-V2.5-ProXiaomi · Closed81.4%
65GLM-4.6Z.AI · Open weight81.0%
66DeepSeek V3p2 ThinkingFireworks AI80.7%
67Grok 4.1 Fast (Reasoning)xAI · Closed80.6%
68GLM-5.3Z.AI · Open weightmax reasoning80.5%
69GLM-5.3-FlashZ.AI · Open weightmax reasoning80.5%
70GPT-OSS 20BOpenAI · Open weight80.4%
71Gemini 3.1 Flash Lite PreviewGoogle80.1%
72MiniMax M2.7MiniMax · Open weight79.9%
73MiniMax M2.5MiniMax · Closed79.2%
74Gemini 2.5 Pro Preview 03 25Google79.2%
75Gemini 3.5 Flash-LiteGoogle · Closedhigh reasoning79.0%
76Grok 4 Fast (Reasoning)xAI · Closed79.0%
77Qwen3 MaxAlibaba · Closed78.2%
78Grok 3 Mini Fast High ReasoningxAIhigh reasoning76.2%
79Gemini 2.5 Flash Preview 09 2025 ThinkingGoogle76.2%
80Gemini 2.5 Flash Preview 09 2025Google75.1%
81Claude Opus 4.5Anthropic · Closed75.0%
82Magistral Medium 2509Mistral AI74.9%
83Claude Sonnet 4.5 ThinkingAnthropic · Closed73.0%
84Magistral Small 2509Mistral AI72.1%
85o3-miniOpenAI · Closedhigh reasoning71.5%
86Gemini 2.5 Flash Lite Preview 09 2025 ThinkingGoogle71.4%
87Qwen3 235b A22bFireworks AI70.6%
88Moonshotai Kimi K2 InstructTogether AI70.4%
89DeepSeek-R1DeepSeek · Open weight70.2%
90GPT-5 nanoOpenAI · Closedhigh reasoning70.2%
91Claude Opus 4 20250514 ThinkingAnthropic70.2%
92DeepSeek V3p2Fireworks AI69.9%
93GLM-5.2Z.AI · Open weight69.5%
94Laguna M.1Poolside · Closed68.1%
95Laguna XS.2Poolside · Open weight67.8%
96Gemini 2.5 Flash Lite Preview 09 2025Google67.7%
97GLM-4.5Z.AI · Closed67.4%
98Qwen3 Max PreviewAlibaba66.9%
99Claude Opus 4.1 20250805 ThinkingAnthropic66.5%
100Grok 3 Mini Fast Low ReasoningxAIlow reasoning66.3%
101DeepSeek V3 0324Fireworks AI65.5%
102Claude Opus 4.1Anthropic64.6%
103Kimi K2 ThinkingMoonshot AI63.1%
104Claude Opus 4Anthropic62.6%
105Claude Sonnet 4 20250514 ThinkingAnthropic62.4%
106Grok Code Fast 1xAI · Closed62.0%
107Claude 3.7 Sonnet 20250219 ThinkingAnthropic60.4%
108Claude Sonnet 4Anthropic59.7%
109Langston Nim Nvidia Llama 3.3 Nemotron Super 49b V1 42e84561 ThinkingTogether AI58.4%
110GPT-4.1 miniOpenAI · Closedhigh reasoning58.2%
111Gemini 2.5 Flash Preview 04 17Google56.9%
112Claude 3.7 SonnetAnthropic56.7%
113Mistral Large 2512Mistral AI55.3%
114GPT-4.1OpenAI · Closedhigh reasoning54.7%
115Grok 3xAI52.9%
116Devstral 2512Mistral AI51.8%
117o1OpenAI · Closedhigh reasoning50.3%
118Claude 3.5 SonnetAnthropic · Closed49.6%
119Llama4 Maverick Instruct BasicFireworks AI47.3%
120Gemini 2.5 Flash Preview 04 17 ThinkingGoogle46.9%
121Grok 4 Fast Non ReasoningxAI46.1%
122Mistral Medium 2505Mistral AI44.8%
123Gemini 2.0 Flash 001Google43.6%
124GPT-4oOpenAI · Closedhigh reasoning43.4%
125Labs Devstral Small 2512Mistral AI43.2%
126GPT-4.1 nanoOpenAI · Closedhigh reasoning42.7%
127Grok 4.1 Fast Non ReasoningxAI42.6%
128Claude 3.5 HaikuAnthropic41.9%
129Gemini 1.5 Pro 002Google41.7%
130Claude Haiku 4.5 ThinkingAnthropic · Closed41.2%
131Grok 2 1212xAI38.7%
132Meta Llama Llama 4 Scout 17B 16E InstructTogether AI38.5%
133Mistral Large 2411Mistral AI37.1%
134Gemini 1.5 Flash 002Google36.9%
135Meta Llama Llama 3.3 70B Instruct TurboTogether AI36.3%
136Langston Nim Nvidia Llama 3.3 Nemotron Super 49b V1 42e84561Together AI36.3%
137Command A 03 2025Cohere35.1%
138Mistral Small 2503Mistral AI31.8%
139GPT-4o miniOpenAI · Closedhigh reasoning26.4%
140Jamba Large 1.6AI21 Labs22.3%
141Command R PlusCohere18.2%
142Mistral Small 2402Mistral AI15.8%
143Jamba Mini 1.6AI21 Labs9.9%