Results

18 results

IFBench Original results
ProviderModelScoreSourceRegistry No.
Microsoft AIMAI-Thinking-169.0%microsoft.ai for MAI-Thinking-1 on IFBench Original (opens in a new tab)AccuracyReported Technical reportMicrosoft AISelf-reportedMicrosoftRecord for MAI-Thinking-1 on IFBench Original70003
Meta AI (originally Facebook AI Research)Muse Glimmer 30B (high)77.0%dev.meta.ai for Muse Glimmer 30B (high) on IFBench Original (opens in a new tab)AccuracyReported Model pageMetaSelf-reportedRecord for Muse Glimmer 30B on IFBench Original80004
Alibaba (Tongyi)Qwen3.8-Max82.8%huggingface.co for Qwen3.8-Max on IFBench Original (opens in a new tab)AccuracyReported Model cardQwenSelf-reportedQwen TeamRecord for Qwen3.8-Max on IFBench Original130008
Thinking Machines LabInkling-Small (effort=0.99)82.2%thinkingmachines.ai for Inkling-Small (effort=0.99) on IFBench Original (opens in a new tab)AccuracyReported Launch postThinking Machines LabSelf-reportedRecord for Inkling-Small on IFBench Original160002
Google (DeepMind)Gemma 4 26B A4B Instruct (thinking mode)72.0%arxiv.org for Gemma 4 26B A4B Instruct (thinking mode) on IFBench Original (opens in a new tab)AccuracyReported Technical reportGoogle DeepMindSelf-reportedRecord for Gemma 4 26B A4B Instruct on IFBench Original35001
Google (DeepMind)Gemma 4 31B Instruct (thinking mode)76.0%arxiv.org for Gemma 4 31B Instruct (thinking mode) on IFBench Original (opens in a new tab)AccuracyReported Technical reportGoogle DeepMindSelf-reportedRecord for Gemma 4 31B Instruct on IFBench Original35002
Google (DeepMind)Gemma 4 E2B Instruct (thinking mode)38.0%arxiv.org for Gemma 4 E2B Instruct (thinking mode) on IFBench Original (opens in a new tab)AccuracyReported Technical reportGoogle DeepMindSelf-reportedRecord for Gemma 4 E2B Instruct on IFBench Original35003
Google (DeepMind)Gemma 4 E4B Instruct (thinking mode)44.0%arxiv.org for Gemma 4 E4B Instruct (thinking mode) on IFBench Original (opens in a new tab)AccuracyReported Technical reportGoogle DeepMindSelf-reportedRecord for Gemma 4 E4B Instruct on IFBench Original35004
Google (DeepMind)Gemma 4 12B Instruct (thinking mode)74.0%arxiv.org for Gemma 4 12B Instruct (thinking mode) on IFBench Original (opens in a new tab)AccuracyReported Technical reportGoogle DeepMindSelf-reportedRecord for Gemma 4 12B Instruct on IFBench Original35005
Thinking Machines LabInkling (effort=0.99)79.8%thinkingmachines.ai for Inkling (effort=0.99) on IFBench Original (opens in a new tab)AccuracyReported Launch postThinking Machines LabSelf-reportedRecord for Inkling on IFBench Original160001
Alibaba (Tongyi)Qwen3.7-Plus79.1%alibabacloud.com for Qwen3.7-Plus on IFBench Original (opens in a new tab)AccuracyReported Launch postAlibaba Cloud CommunitySelf-reportedQwen TeamRecord for Qwen3.7-Plus on IFBench Original130007
Mistral AIMistral Medium 3.5 (high)68.0%huggingface.co for Mistral Medium 3.5 (high) on IFBench Original (opens in a new tab)AccuracyReported Model cardMistral AISelf-reportedRecord for Mistral Medium 3.5 on IFBench Original90005
Alibaba (Tongyi)Qwen3.7-Max79.1%alibabacloud.com for Qwen3.7-Max on IFBench Original (opens in a new tab)AccuracyReported Launch postAlibaba Cloud CommunitySelf-reportedQwen TeamRecord for Qwen3.7-Max on IFBench Original130006
Alibaba (Tongyi)Qwen3.6-Plus74.2%alibabacloud.com for Qwen3.6-Plus on IFBench Original (opens in a new tab)AccuracyReported Launch postAlibaba Cloud CommunitySelf-reportedQwen TeamRecord for Qwen3.6-Plus on IFBench Original130004
Mistral AIMistral Small 4 (high)48.0%huggingface.co for Mistral Small 4 (high) on IFBench Original (opens in a new tab)AccuracyReported Model cardMistral AISelf-reportedRecord for Mistral Small 4 on IFBench Original90004
Mistral AIMistral Small 4 (none)35.7%huggingface.co for Mistral Small 4 (none) on IFBench Original (opens in a new tab)AccuracyReported Model cardMistral AISelf-reportedRecord for Mistral Small 4 on IFBench Original90004
Alibaba (Tongyi)Qwen3.5-397B-A17B76.5%alibabacloud.com for Qwen3.5-397B-A17B on IFBench Original (opens in a new tab)AccuracyReported Launch postAlibaba Cloud CommunitySelf-reportedQwen TeamRecord for Qwen3.5-397B-A17B on IFBench Original130003
Alibaba (Tongyi)Qwen3-Max-Thinking70.9%alibabacloud.com for Qwen3-Max-Thinking on IFBench Original (opens in a new tab)AccuracyReported Launch postAlibaba Cloud CommunitySelf-reportedQwen TeamRecord for Qwen3-Max-Thinking on IFBench Original130002