Scientific LLM Benchmarks
GitHub
← All benchmarks
Math· formal-proof

ProofNet

Yale University · 2023

371 undergraduate theorems for autoformalization and formal proving in Lean.

Mathematics
GitHub stars
Task type
proof
Modality
text
Access
open
Size
371 items
License
MIT
Metrics
accuracy, BLEU
id
Rudin|exercise_1_1b
nl_statement
If $r$ is rational $(r \neq 0)$ and $x$ is irrational, prove that $rx$ is irrational.
nl_proof
\begin{proof} If $r x$ were rational, then $x=\frac{r x}{r}$ would also be rational. \end{proof}
formal_statement
theorem exercise_1_1b (x : ℝ) (y : ℚ) (h : y ≠ 0) : ( irrational x ) -> irrational ( x * y ) :=
src_header
import .common open real complex open topological_space open filter open_locale real open_locale topology open_locale big_operators open_locale complex_conjugate open_locale filter noncomputable theory
id
Rudin|exercise_1_4
nl_statement
Let $E$ be a nonempty subset of an ordered set; suppose $\alpha$ is a lower bound of $E$ and $\beta$ is an upper bound of $E$. Prove that $\alpha \leq \beta$.
nl_proof
\begin{proof} Since $E$ is nonempty, there exists $x \in E$. Then by definition of lower and upper bounds we have $\alpha \leq x \leq \beta$, and hence by property $i i$ in the definition of an ordering, we have $\alpha<\beta$ unless $\alpha=x=\beta$. \end{proof}
formal_statement
theorem exercise_1_4 (α : Type*) [partial_order α] (s : set α) (x y : α) (h₀ : set.nonempty s) (h₁ : x ∈ lower_bounds s) (h₂ : y ∈ upper_bounds s) : x ≤ y :=
src_header
import .common open real complex open topological_space open filter open_locale real open_locale topology open_locale big_operators open_locale complex_conjugate open_locale filter noncomputable theory

Real rows from the Hugging Face datasets server · long values truncated