CharXiv
CharXiv results reported for 41 models across 4 versions. Updated 2026-10-07.
Report an issueVersions
4 versions · Metric: CharXiv Accuracy
| Version | Released | Models | Results |
|---|---|---|---|
| CharXiv Reasoning — Search and code executionConfiguration: Search and code execution | July 21, 2026 | 3 | 3 |
| CharXiv Reasoning — Python enabledConfiguration: With Python | December 11, 2025 | 8 | 8 |
| CharXiv Descriptive and reasoning — Mercor single-shotConfiguration: Mercor single-shot agent | June 26, 2024 | 34 | 36 |
| CharXiv Reasoning — No toolsConfiguration: No tools | June 26, 2024 | 16 | 16 |
Recently reported results: CharXiv Reasoning — Search and code execution
Most recent configuration: CharXiv Reasoning — Search and code execution
| Model | Score | Source |
|---|---|---|
| Gemini 3.7 Flash | 88.7% | deepmind.google for Gemini 3.7 Flash on CharXiv Reasoning — Search and code execution (opens in a new tab)CharXiv AccuracyReported Model cardGoogle DeepMindSelf-reportedRecord for Gemini 3.7 Flash on CharXiv Reasoning — Search and code execution |
| Gemini 3.6 Flash | 89.4% | deepmind.google for Gemini 3.6 Flash on CharXiv Reasoning — Search and code execution (opens in a new tab)CharXiv AccuracyReported Model cardGoogle DeepMindSelf-reportedRecord for Gemini 3.6 Flash on CharXiv Reasoning — Search and code execution |
| Gemini 3.5 Flash | 84.9% | deepmind.google for Gemini 3.5 Flash on CharXiv Reasoning — Search and code execution (opens in a new tab)CharXiv AccuracyReported Model cardGoogle DeepMindSelf-reportedRecord for Gemini 3.5 Flash on CharXiv Reasoning — Search and code execution |