Scientific LLM Benchmarks
GitHub
← All benchmarks
General· science-QA

QASC

Allen AI (AI2) · 2020

9,980 grade-school science questions requiring retrieval and composition of two facts.

GitHub stars
Task type
MCQ
Modality
text
Access
open
Size
926 items
License
CC-BY-4.0
Metrics
accuracy
id
3C44YUNSI1OBFBB8D36GODNOZN9DPA
question
What type of birth do therian mammals have?
choices
{"text":["Anthax","under water","uterus","wombs","two","moles","live","embryo"],"label":["A","B","C","D","E","F","G","H"]}
formatted_question
What type of birth do therian mammals have? (A) Anthax (B) under water (C) uterus (D) wombs (E) two (F) moles (G) live (H) embryo
id
3B1NLC6UGZVERVLZFT7OUYQLD1SGPZ
question
By what time had mouse-sized viviparous mammals evolved?
choices
{"text":["Corvidae","arthropods","birds","backbones","keratin","Jurassic","front paws","Parakeets."],"label":["A","B","C","D","E","F","G","H"]}
formatted_question
By what time had mouse-sized viviparous mammals evolved? (A) Corvidae (B) arthropods (C) birds (D) backbones (E) keratin (F) Jurassic (G) front paws (H) Parakeets.

Real rows from the Hugging Face datasets server · long values truncated