Benchmarks

5 results across 4 benchmarks

Benchmark results for MAI-Code-1-Flash
BenchmarkScoreSource
GPQA Diamond84.6%microsoft.ai for MAI-Code-1-Flash on Graduate-Level Google-Proof Q&A Diamond (opens in a new tab)GPQA Diamond AccuracyReported Launch postMicrosoft AISelf-reportedMicrosoftRecord for MAI-Code-1-Flash on Graduate-Level Google-Proof Q&A Diamond
SWE-bench Multilingual — GitHub Copilot production harnessReported as: adaptive thinkingConfiguration: GitHub Copilot production harness65.5%microsoft.ai for MAI-Code-1-Flash (adaptive thinking) on SWE-bench Multilingual — GitHub Copilot production harness (opens in a new tab)Resolved TasksReported Launch postMicrosoft AISelf-reportedMicrosoftRecord for MAI-Code-1-Flash on SWE-bench Multilingual — GitHub Copilot production harness
SWE-bench Verified — GitHub Copilot production harnessReported as: adaptive thinkingConfiguration: GitHub Copilot production harness71.6%microsoft.ai for MAI-Code-1-Flash (adaptive thinking) on SWE-bench Verified — GitHub Copilot production harness (opens in a new tab)Resolved TasksReported Launch postMicrosoft AISelf-reportedMicrosoftRecord for MAI-Code-1-Flash on SWE-bench Verified — GitHub Copilot production harness
SWE-bench Pro Public — GitHub Copilot production harnessReported as: adaptive thinkingConfiguration: GitHub Copilot production harness51.2%microsoft.ai for MAI-Code-1-Flash (adaptive thinking) on SWE-bench Pro Public — GitHub Copilot production harness (opens in a new tab)Public tasks resolvedReported Launch postMicrosoft AISelf-reportedMicrosoftRecord for MAI-Code-1-Flash on SWE-bench Pro Public — GitHub Copilot production harness
Terminal-Bench 2.0 — GitHub Copilot production harnessReported as: adaptive thinkingConfiguration: GitHub Copilot production harness54.8%microsoft.ai for MAI-Code-1-Flash (adaptive thinking) on Terminal-Bench 2.0 — GitHub Copilot production harness (opens in a new tab)Terminal-Bench AccuracyReported Launch postMicrosoft AISelf-reportedMicrosoftRecord for MAI-Code-1-Flash on Terminal-Bench 2.0 — GitHub Copilot production harness