Scientific LLM Benchmarks
GitHub
← All benchmarks
General· multimodal

ScienceQA

UCLA / Allen AI / ASU · 2022

~21K multimodal multiple-choice science questions with lecture and chain-of-thought explanations.

GitHub stars
Task type
MCQ
Modality
multimodal
Access
open
Size
4,241 items
License
CC-BY-SA-4.0
Metrics
accuracy
question
Which figure of speech is used in this text? Sing, O goddess, the anger of Achilles son of Peleus, that brought countless ills upon the Achaeans. —Homer, The Iliad
choices
chiasmus apostrophe
answer
1
task
closed choice
grade
grade11
subject
language science
topic
figurative-language
category
Literary devices
skill
Classify the figure of speech: anaphora, antithesis, apostrophe, assonance, chiasmus, understatement
lecture
Figures of speech are words or phrases that use language in a nonliteral or unusual way. They can make writing more expressive. Anaphora is the repetition of the same word or words at the beginning of several phrases or clauses. We are united. We are powerful. We are winners. Antithesis involves contrasting opposing ideas within a parallel grammatical structure. I want to help, not to hurt. Apostrophe is a direct address to an absent person or a nonhuman entity. Oh, little bird, what makes you sing so beautifully? Assonance is the repetition of a vowel sound in a series of nearby words. Try to …
solution
The text uses apostrophe, a direct address to an absent person or a nonhuman entity. O goddess is a direct address to a goddess, a nonhuman entity.
image
<image/binary>
question
Which of the following could Gordon's test show?
choices
if the spacecraft was damaged when using a parachute with a 1 m vent going 200 km per hour how steady a parachute with a 1 m vent was at 200 km per hour whether a parachute with a 1 m vent would swing too much at 400 km per hour
answer
1
hint
People can use the engineering-design process to develop solutions to problems. One step in the process is testing if a potential solution meets the requirements of the design. The passage below describes how the engineering-design process was used to test a solution to a problem. Read the passage. Then answer the question below. Gordon was an aerospace engineer who was developing a parachute for a spacecraft that would land on Mars. He needed to add a vent at the center of the parachute so the spacecraft would land smoothly. However, the spacecraft would have to travel at a high speed before …
task
closed choice
grade
grade8
subject
natural science
topic
science-and-engineering-practices
category
Engineering practices
skill
Evaluate tests of engineering-design solutions
lecture
People can use the engineering-design process to develop solutions to problems. One step in the process is testing if a potential solution meets the requirements of the design. How can you determine what a test can show? You need to figure out what was tested and what was measured. Imagine an engineer needs to design a bridge for a windy location. She wants to make sure the bridge will not move too much in high wind. So, she builds a smaller prototype, or model, of a bridge. Then, she exposes the prototype to high winds and measures how much the bridge moves. First, identify what was tested. A …

Real rows from the Hugging Face datasets server · long values truncated