Scientific LLM Benchmarks
GitHub
← All benchmarks
General· science-exam-QA

ARC (AI2 Reasoning Challenge)

Allen AI (AI2) · 2018

7,787 grade-school science exam multiple-choice questions split into Easy and Challenge sets.

GitHub stars
Task type
MCQ
Modality
text
Access
open
Size
7,787 items
License
CC-BY-SA-4.0
Metrics
accuracy
id
Mercury_7175875
question
An astronomer observes that a planet rotates faster after a meteorite impact. Which is the most likely effect of this increase in rotation?
choices
{"text":["Planetary density will decrease.","Planetary years will become longer.","Planetary days will become shorter.","Planetary gravity will become stronger."],"label":["A","B","C","D"]}
answerKey
C
id
Mercury_SC_409171
question
A group of engineers wanted to know how different building designs would respond during an earthquake. They made several models of buildings and tested each for its ability to withstand earthquake conditions. Which will most likely result from testing different building designs?
choices
{"text":["buildings will be built faster","buildings will be made safer","building designs will look nicer","building materials will be cheaper"],"label":["A","B","C","D"]}
answerKey
B

Real rows from the Hugging Face datasets server · long values truncated