◆Scientific LLM Benchmarks
GitHub
← All benchmarks
General· graduate-QA

GPQA

NYU / Anthropic / Cohere · 2023

448 expert-written graduate-level biology, physics, and chemistry questions, including the 198-item GPQA Diamond subset used in frontier-model evaluations.

BiologyChemistryPhysics
GitHub stars
Task type
MCQ
Modality
text
Access
gated
Size
448 items
License
CC-BY-4.0
Metrics
accuracy

Samples are not shown — this dataset is gated.

Open it on Hugging Face ↗