Scientific LLM Benchmarks
GitHub
← All benchmarks
General· science-exam-QA

OpenBookQA

Allen AI (AI2) · 2018

Elementary science multiple-choice questions requiring core facts plus broad common-sense knowledge.

GitHub stars
Task type
MCQ
Modality
text
Access
open
Size
500 items
License
Apache-2.0
Metrics
accuracy
id
8-343
question_stem
A person wants to start saving money so that they can afford a nice vacation at the end of the year. After looking over their budget and expenses, they decide the best way to save money is to
choices
{"text":["make more phone calls","quit eating lunch out","buy less with monopoly money","have lunch with friends"],"label":["A","B","C","D"]}
answerKey
B
fact1
using less resources usually causes money to be saved
humanScore
1
clarity
2
turkIdAnonymized
b356d338b7
id
1129
question_stem
There is most likely going to be fog around:
choices
{"text":["a marsh","a tundra","the plains","a desert"],"label":["A","B","C","D"]}
answerKey
A
fact1
fog is formed by water vapor condensing in the air
humanScore
1
clarity
1.600000023841858
turkIdAnonymized
a9f90f5da1

Real rows from the Hugging Face datasets server · long values truncated