Scientific LLM Benchmarks
GitHub
← All benchmarks
Chemistry· literature-QA

ScholarChemQA

KAUST / Notre Dame · 2024

40K abstract-derived chemistry research questions exposing LLM limits in comprehending scholarly literature.

Chemistry
GitHub stars
Task type
MCQ
Modality
text
Access
open
Size
1,050 items
License
Metrics
accuracy, weighted F1, Macro-F1

Examples

No sample rows available for this dataset.