Scientific LLM Benchmarks
GitHub
← All benchmarks
General· theorem-driven

TheoremQA

University of Waterloo (TIGER-Lab) · 2023

800 questions applying 350+ theorems across math, physics, EE/CS, and finance.

PhysicsMathematics
GitHub stars
Task type
QA
Modality
multimodal
Access
open
Size
800 items
License
MIT
Metrics
accuracy
Question
How many ways are there to divide a set of 8 elements into 5 non-empty ordered subsets?
Answer
11760
Answer_type
integer
Question
what is the value of $\int_{-infty}^{+infty} sin(3*t)*sin(t/\pi)/t^2 dt$?
Answer
1.0
Answer_type
float

Real rows from the Hugging Face datasets server · long values truncated