Benchmarks

7 results across 7 benchmarks

Benchmark results for Mistral Large 3
BenchmarkScoreSource
Arena Text Text Overall — 2026-09-13 snapshot1413.0arena.ai for Mistral Large 3 on Arena Text Text Overall — 2026-09-13 snapshot (opens in a new tab)Arena EloReported Benchmark leaderboardArena IntelligenceIndependentArenaRecord for Mistral Large 3 on Arena Text Text Overall — 2026-09-13 snapshot
Chartography October 2026 leaderboard9.0%surgehq.ai for Mistral Large 3 on Chartography October 2026 leaderboard (opens in a new tab)Archived copy (opens in a new tab)Chartography Pass@1Reported Benchmark leaderboardSurge AIIndependentRecord for Mistral Large 3 on Chartography October 2026 leaderboard
GPQA Diamond — Vals AI harnessConfiguration: Vals AI harness: mean of zero-shot and few-shot CoT68.4%vals.ai for Mistral Large 3 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)GPQA Diamond AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Mistral Large 3 on Graduate-Level Google-Proof Q&A Diamond — Vals AI harness
MMLU-Pro Original — Vals AI harnessConfiguration: Vals AI harness79.8%vals.ai for Mistral Large 3 on MMLU-Pro Original — Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Mistral Large 3 on MMLU-Pro Original — Vals AI harness
MMMU-Pro Vals AI harnessConfiguration: Vals AI harness66.2%vals.ai for Mistral Large 3 on MMMU-Pro Vals AI harness (opens in a new tab)Archived copy (opens in a new tab)MMMU-Pro accuracySetting: Standard (4 options)Reported Benchmark leaderboardVals AIIndependentRecord for Mistral Large 3 on MMMU-Pro Vals AI harness
SWE-bench Verified — Vals AI mini-swe-agentConfiguration: mini-swe-agent harness41.4%vals.ai for Mistral Large 3 on SWE-bench Verified — Vals AI mini-swe-agent (opens in a new tab)Archived copy (opens in a new tab)Resolved TasksReported Benchmark leaderboardVals AIIndependentRecord for Mistral Large 3 on SWE-bench Verified — Vals AI mini-swe-agent
Terminal-Bench 2.0 — Vals AI Terminus 2Configuration: Terminus-2 harness9.0%vals.ai for Mistral Large 3 on Terminal-Bench 2.0 — Vals AI Terminus 2 (opens in a new tab)Archived copy (opens in a new tab)Terminal-Bench AccuracyReported Benchmark leaderboardVals AIIndependentRecord for Mistral Large 3 on Terminal-Bench 2.0 — Vals AI Terminus 2