Scientific LLM Benchmarks
GitHub
← All benchmarks
Chemistry· molecular

MoleculeQA

IDEA Research · 2024

62K QA pairs over 23K molecules evaluating factual accuracy of LLM molecular comprehension.

Chemistry
GitHub stars
Task type
MCQ
Modality
text
Access
open
Size
62,000 items
License
MIT
Metrics
accuracy
text
CID Question Answer
text
644073 "Please complete the following question answering task: You are given a SMILES of a molecule and a question about it with several options, please analysis the structure of the molecule and choose the right answer for the question from given options.

Real rows from the Hugging Face datasets server · long values truncated