Scientific LLM Benchmarks
GitHub
← All benchmarks
Biology· protocols

BioProBench

Peking University · 2025

Tests LLMs on biological-protocol QA, step ordering, error correction, generation, and reasoning across 556K instances.

Biology
GitHub stars
Task type
QA
Modality
text
Access
open
Size
5,000 items
License
CC-BY-4.0
Metrics
accuracy, F1, BLEU, ROUGE-L, exact match
context
{"purpose":"Maintain hESCs in optimal conditions for growth and differentiation.","prior_step":"Preparation of vitronectin-coated plates","next_step":"Daily medium exchange"}
corrupted_text
Maintain hESCs in Nutristem medium on 0.5u/c m^2 vitronectin N-precoated tissue culture-treated plastic in a humidified incubator (37^°C,10%C0_2).
corrected_text
Maintain hESCs in Nutristem medium on 0.5u/c m^2 vitronectin N-precoated tissue culture-treated plastic in a humidified incubator (37^°C,5%C0_2).
is_correct
false
type
parameter
error_description
CO2 concentration is critical for maintaining pH balance in the medium.
id
TEST-ERR-000000
context
{"purpose":"Prepare medium for plating hESCs with ROCK inhibitor to enhance cell survival.","prior_step":"Preparation of vitronectin-coated wells","next_step":"Plating of thawed hESCs"}
corrupted_text
Prepare enough Nutristem media for plating (3 mL per 3 cm well of a 6-well plate) with 1:100 ROCK inhibitor.
corrected_text
Prepare enough Nutristem media for plating (3 mL per 3 cm well of a 6-well plate) with 1:1000 ROCK inhibitor.
is_correct
false
type
reagent
error_description
ROCK inhibitor concentration is crucial for preventing apoptosis during cell dissociation.
id
TEST-ERR-000001

Real rows from the Hugging Face datasets server · long values truncated