Benchmarks

8 results across 8 benchmarks

Benchmark results for MAI-Thinking-1
BenchmarkScoreSource
GPQA Diamond84.2%microsoft.ai for MAI-Thinking-1 on Graduate-Level Google-Proof Q&A Diamond (opens in a new tab)GPQA Diamond AccuracyReported Technical reportMicrosoft AISelf-reportedMicrosoftRecord for MAI-Thinking-1 on Graduate-Level Google-Proof Q&A Diamond
IFBench Original69.0%microsoft.ai for MAI-Thinking-1 on IFBench Original (opens in a new tab)AccuracyReported Technical reportMicrosoft AISelf-reportedMicrosoftRecord for MAI-Thinking-1 on IFBench Original
MMLU-Pro Original85.0%microsoft.ai for MAI-Thinking-1 on MMLU-Pro Original (opens in a new tab)AccuracyReported Technical reportMicrosoft AISelf-reportedMicrosoftRecord for MAI-Thinking-1 on MMLU-Pro Original
Riemann-bench October 2026 leaderboard4.8%surgehq.ai for MAI-Thinking-1 on Riemann-bench October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Riemann-bench Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for MAI-Thinking-1 on Riemann-bench October 2026 leaderboard
SimpleQA Verified Original31.0%microsoft.ai for MAI-Thinking-1 on SimpleQA Verified Original (opens in a new tab)AccuracyReported Technical reportMicrosoft AISelf-reportedMicrosoftRecord for MAI-Thinking-1 on SimpleQA Verified Original
SWE-bench Verified73.5%microsoft.ai for MAI-Thinking-1 on SWE-bench Verified (opens in a new tab)Resolved TasksReported Technical reportMicrosoft AISelf-reportedMicrosoftRecord for MAI-Thinking-1 on SWE-bench Verified
SWE-bench Pro Public52.8%microsoft.ai for MAI-Thinking-1 on SWE-bench Pro Public (opens in a new tab)Public tasks resolvedReported Technical reportMicrosoft AISelf-reportedMicrosoftRecord for MAI-Thinking-1 on SWE-bench Pro Public
Terminal-Bench 2.046.0%microsoft.ai for MAI-Thinking-1 on Terminal-Bench 2.0 (opens in a new tab)Terminal-Bench AccuracyReported Technical reportMicrosoft AISelf-reportedMicrosoftRecord for MAI-Thinking-1 on Terminal-Bench 2.0