Benchmark Registry

GPQA

Graduate-Level Google-Proof Q&A

Benchmark
GPQA
Evaluated by
GPQA Authors
Release date
November 20, 2023
Version
GPQA Diamond
Metric
GPQA Diamond Accuracy

Results

16 results

ProviderModelScoreSourceRegistry No.
OpenAIGPT-6 Astra96.0%Source10005
OpenAIGPT-5.6 Luna92.3%Source10009
OpenAIGPT-5.6 Sol94.6%Source10010
OpenAIGPT-5.6 Terra92.9%Source10011
OpenAIGPT-5.5 (xhigh)93.6%Source10008
OpenAIGPT-5.4 (xhigh)92.8%Source10007
OpenAIGPT-5.2 (pro xhigh)93.2%Source10012
OpenAIGPT-5.2 (xhigh)92.4%Source10012
OpenAIgpt-oss-120b (low (no tools))67.1%Source15001
OpenAIgpt-oss-120b (medium (no tools))73.1%Source15001
OpenAIgpt-oss-120b (low (with tools))68.1%Source15001
OpenAIgpt-oss-120b (medium (with tools))73.5%Source15001
OpenAIgpt-oss-120b (high (with tools))80.9%Source15001
OpenAIgpt-oss-120b (high (no tools))80.1%Source15001
OpenAIGPT-4.5 Preview69.5%Source10001
OpenAIGPT-4.166.3%Source10002