aa Omniscience Index

114 models evaluated

#	Model	Provider	Type	Score
1	Gemini 3.1 Pro	Google	Closed	32.9%
2	Claude Opus 4.7 (Adaptive)	Anthropic	Closed	26.2%
3	Gemini 3.5 Flash	Google	Closed	22.7%
4	GPT-5.5	OpenAI	Closed	20.1%
5	Grok 4.3	xAI	Closed	18.3%
6	Gemini 3 Pro	Google	Closed	15.8%
7	Claude Opus 4.7	Anthropic	Closed	14.2%
8	Qwen3.7 Max	Alibaba	Closed	14.1%
9	Claude Opus 4.6 (Adaptive)	Anthropic	Closed	13.5%
10	Claude Opus 4.5 Thinking	Anthropic	Closed	13.3%
11	Qwen 3.6 Max (preview)	Alibaba	Closed	10.2%
12	GPT-5.3 Codex	OpenAI	Closed	9.9%
13	Kimi K2.6	Moonshot AI	Open	6.4%
14	GPT-5.4	OpenAI	Closed	5.7%
15	GPT-5.1	OpenAI	Closed	5.6%
16	MiMo-V2-Pro	Xiaomi	Closed	4.9%
17	Muse Spark	Meta	Closed	4.1%
18	Grok 4	xAI	Closed	3.8%
19	MiMo-V2.5-Pro	Xiaomi	Closed	3.6%
20	Claude Opus 4.6	Anthropic	Closed	3.5%
21	Qwen3.6 Plus	Alibaba	Closed	2.7%
22	GLM-5	Z.AI	Open	2.0%
23	GLM-5.1	Z.AI	Open	1.9%
24	MiniMax M2.7	MiniMax	Open	0.7%
25	GPT-5.2	OpenAI	Closed	-1.0%
26	GPT-5.2-Codex	OpenAI	Closed	-2.5%
27	Claude Sonnet 4.6	Anthropic	Closed	-2.9%
28	Gemini 3 Flash	Google	Closed	-3.6%
29	Claude Opus 4.5	Anthropic	Closed	-3.9%
30	Command A+	Cohere	Open	-4.0%
31	GPT-5.1-Codex-Max	OpenAI	Closed	-6.0%
32	GPT-5.1-Codex	OpenAI	Closed	-6.0%
33	GPT-5 (high)	OpenAI	Closed	-8.1%
34	Kimi K2.5 (Reasoning)	Moonshot AI	Closed	-8.1%
35	Kimi K2.5	Moonshot AI	Open	-8.1%
36	Claude 4 Sonnet	Anthropic	Closed	-9.2%
37	DeepSeek V4 Pro (High)	DeepSeek	Open	-9.7%
38	DeepSeek V4 Pro (Max)	DeepSeek	Open	-10.0%
39	GPT-5 (medium)	OpenAI	Closed	-10.1%
40	o1	OpenAI	Closed	-10.5%
41	GPT-4o	OpenAI	Closed	-10.7%
42	Gemini 2.5 Pro	Google	Closed	-14.3%
43	GLM-5-Turbo	Z.AI	Closed	-15.1%
44	o3	OpenAI	Closed	-15.3%
45	Gemini 3.1 Flash-Lite	Google	Closed	-15.5%
46	Llama 3.1 405B	Meta	Open	-17.3%
47	MiMo-V2-Omni	Xiaomi	Closed	-17.4%
48	GPT-5.4 mini	OpenAI	Closed	-18.7%
49	GLM-5V-Turbo	Z.AI	Closed	-19.0%
50	Qwen3.6-27B	Alibaba	Open	-19.8%
51	Gemma 4 E4B	Google	Open	-20.0%
52	Qwen3.6-35B-A3B	Alibaba	Open	-21.4%
53	DeepSeek V4 Flash (High)	DeepSeek	Open	-22.3%
54	DeepSeek V4 Flash (Max)	DeepSeek	Open	-22.9%
55	Gemma 4 E2B	Google	Open	-24.0%
56	LFM2.5-8B-A1B	LiquidAI	Open	-24.7%
57	DeepSeek-R1	DeepSeek	Open	-27.1%
58	Kimi K2	Moonshot AI	Closed	-27.5%
59	DeepSeek V3.1 (Reasoning)	DeepSeek	Open	-28.4%
60	Grok 4 Fast (Reasoning)	xAI	Closed	-28.4%
61	Grok 4.1 Fast (Reasoning)	xAI	Closed	-28.7%
62	GPT-5.4 nano	OpenAI	Closed	-29.5%
63	Qwen3.5 397B (Reasoning)	Alibaba	Open	-29.8%
64	Mistral Small 4 (Reasoning)	Mistral	Open	-29.9%
65	Mistral Small 4	Mistral	Open	-29.9%
66	Mistral Medium 3	Mistral	Closed	-31.5%
67	GLM-4.6	Z.AI	Open	-31.6%
68	Mistral Large 2	Mistral	Closed	-34.0%
69	GLM-4.7	Z.AI	Open	-34.6%
70	Hy3 Preview	Tencent	Open	-34.6%
71	Grok Code Fast 1	xAI	Closed	-36.0%
72	Qwen3.5 397B	Alibaba	Open	-36.1%
73	GPT-4.1	OpenAI	Closed	-36.2%
74	Mistral Medium 3.5 128B	Mistral	Open	-36.3%
75	Mistral Large 3	Mistral	Closed	-39.4%
76	Qwen3.5-122B-A10B	Alibaba	Open	-39.6%
77	DeepSeek V3.1	DeepSeek	Open	-41.1%
78	DeepSeek V3	DeepSeek	Open	-41.3%
79	Llama 4 Maverick	Meta	Open	-41.8%
80	Qwen3.5-27B	Alibaba	Open	-42.0%
81	Gemini 2.5 Flash	Google	Closed	-42.0%
82	Qwen3 Max	Alibaba	Closed	-43.1%
83	Trinity-Large-Preview	Arcee AI	Open	-44.2%
84	Trinity-Large-Thinking	Arcee AI	Open	-44.2%
85	Gemma 4 31B	Google	Open	-45.4%
86	Nemotron Ultra 253B	NVIDIA	Open	-45.5%
87	Qwen3.5-35B-A3B	Alibaba	Open	-46.4%
88	DeepSeek V3.2	DeepSeek	Open	-46.7%
89	Claude 3 Haiku	Anthropic	Closed	-47.6%
90	Nova Pro	Amazon	Closed	-47.6%
91	Gemma 4 26B A4B	Google	Open	-48.1%
92	MiMo-V2-Flash	Xiaomi	Open	-48.5%
93	GPT-OSS 120B	OpenAI	Open	-50.0%
94	GPT-4.1 mini	OpenAI	Closed	-50.1%
95	Grok 4.1 Fast	xAI	Closed	-50.9%
96	Llama 4 Scout	Meta	Open	-52.4%
97	Nemotron 3 Nano Omni 30B A3B	NVIDIA	Open	-56.0%
98	GPT-4.1 nano	OpenAI	Closed	-56.4%
99	Phi-4	Microsoft	Open	-56.7%
100	K-Exaone	LG AI Research	Closed	-57.9%
101	Sarvam 105B	Sarvam	Open	-59.5%
102	Solar Pro 2	Upstage	Closed	-61.7%
103	Exaone 4.0 32B	LG AI Research	Open	-62.3%
104	GLM-4.5-Air	Z.AI	Closed	-62.5%
105	GPT-OSS 20B	OpenAI	Open	-63.9%
106	Ling 2.6 Flash	InclusionAI	Open	-65.7%
107	Gemma 3 27B	Google	Open	-65.9%
108	Nemotron 3 Nano 30B	NVIDIA	Open	-69.2%
109	Sarvam 30B	Sarvam	Open	-72.0%
110	Granite-4.0-350M	IBM	Open	-72.1%
111	Granite-4.0-H-1B	IBM	Open	-73.6%
112	Granite-4.0-1B	IBM	Open	-81.8%
113	Exaone 4.0 1.2B	LG AI Research	Open	-82.6%
114	Granite-4.0-H-350M	IBM	Open	-87.2%