Scientific LLM Benchmarks
GitHub
← All benchmarks
Math· grade-school

GSM8K

OpenAI · 2021

8.5K grade-school arithmetic word problems requiring multi-step reasoning.

Mathematics
GitHub stars
Task type
open-ended
Modality
text
Access
open
Size
1,319 items
License
MIT
Metrics
accuracy
question
Janet’s ducks lay 16 eggs per day. She eats three for breakfast every morning and bakes muffins for her friends every day with four. She sells the remainder at the farmers' market daily for $2 per fresh duck egg. How much in dollars does she make every day at the farmers' market?
answer
Janet sells 16 - 3 - 4 = <<16-3-4=9>>9 duck eggs a day. She makes 9 * 2 = $<<9*2=18>>18 every day at the farmer’s market. #### 18
question
A robe takes 2 bolts of blue fiber and half that much white fiber. How many bolts in total does it take?
answer
It takes 2/2=<<2/2=1>>1 bolt of white fiber So the total amount of fabric is 2+1=<<2+1=3>>3 bolts of fabric #### 3

Real rows from the Hugging Face datasets server · long values truncated