Scientific LLM Benchmarks
GitHub
← All benchmarks
Chemistry· molecule-text-QA

MolTextQA

UIUC · 2024

500K QA pairs over 240K PubChem molecules evaluating molecule-structure-to-text understanding and retrieval.

Chemistry
GitHub stars
Task type
MCQ
Modality
text
Access
open
Size
12,092 items
License
CC-BY-4.0
Metrics
accuracy
Unnamed: 0
0
CID
11954177
qid
1
split
train
category
2
sentence
This molecule is a steroid acid.,
question
What type of compound is the molecule?,
options
['Amino acid', 'Fatty acid', 'Steroid acid', 'Protein', 'Vitamin"],']
correct
3
retrieval_options
[133082019, 439394, 11954177, 162889264, 54678503]
retrieval_correct
3
Unnamed: 0
1
CID
9985220
qid
2
split
train
category
4
sentence
The molecule is found in Zingiber montanum and Zingiber purpureum.
question
In which plants is the molecule found?,
options
['Zingiber officinale', 'Zingiber montanum and Zingiber purpureum', 'Zingiber zerumbet', 'Curcuma longa', 'Alpinia galanga"],']
correct
2
retrieval_options
[44259710, 9985220, 676454, 162951520, 9794358]
retrieval_correct
2

Real rows from the Hugging Face datasets server · long values truncated