◆Scientific LLM Benchmarks
GitHub
← All benchmarks
Physics & Astro· climate-science

ClimaQA

UC San Diego · 2024

Graduate-level climate science QA generated from textbooks with climate scientists in the loop: 566 expert-validated Gold questions plus 3,000 synthetic Silver questions in MCQ, freeform, and cloze form.

PhysicsEarth Science
GitHub stars
Task type
QA
Modality
text
Access
open
Size
566 items
License
Apache-2.0
Metrics
accuracy
Unnamed: 0
0
Question
Why does the reflectivity increase between points 3 and 4 in the vertical profile of radar data for stratiform precipitation?
Options
a) Due to the reduction in relative humidity below cloud, causing evaporation of raindrops. -------------------- b) As a result of the snowflakes becoming more compact and collapsing due to increased terminal velocity. -------------------- c) Due to the reduction in size of snowflakes as they melt and acquire a liquid layer. -------------------- d) Because of the increase in the concentration of ice crystals in that layer.
Answer
c
Complexity
REASONING
Validation
true
Unnamed: 0
1
Question
How did the increase in anthropogenic aerosol impact the South Asian monsoon during the second half of the twentieth century?
Options
a) Increasing the global monsoon precipitation by around 8% -------------------- b) Strengthening the Walker Circulation over the Indian Ocean -------------------- c) Enhancing the summer monsoon circulation -------------------- d) Causing a further weakening of the summer monsoon
Answer
d
Complexity
HYPOTHETICAL
Validation
true

Real rows from the Hugging Face datasets server · long values truncated