llms-foundation-models · 2026-09-26 · Tier 2

Learning to Discover Interesting Mathematics

Learning to Discover Interesting Mathematics

Source: arXiv 2609.28603 (Kempe Lab). HuggingFace Daily Papers (09-26 list, 6 upvotes) and posted by @KempeLab, so cross-source confirmed via social. Raw: raw/huggingface/2026-09-26-learning-to-discover-interesting-mathematics.md, raw/twitter/feed/2026-09-26-morning-ranked.json

TL;DR

LLM provers can now produce true theorems in bulk. The open question is whether any of them are worth having. This paper gives a computable answer. It defines a theorem's intrinsic interestingness as the ratio of its proof length to its statement length: a short statement that needs a long proof compresses a lot of reasoning. That ratio correlates strongly with an extrinsic measure, how useful the theorem is downstream. The authors identify proof difficulty conditioned on a premise set as the primitive both metrics need, and train a 27B model that predicts it more accurately than frontier general models. Optimizing a generator for the metric produces more interesting theorems and cuts overlap with Mathlib (Lean's community library) from 91.9% to 30.6%. The system generates candidates, keeps the most interesting, adds them to its library, and builds on them.

flowchart LR
  L[(Formal library<br/>premises)] --> G[Conjecture<br/>generator]
  G --> P[27B proof-<br/>difficulty<br/>predictor]
  P --> S{Interest =<br/>proof length /<br/>statement length}
  S -->|keep top| V[Prove in Lean]
  V --> L
  classDef input fill:#dbeafe,stroke:#3b82f6,color:#1e3a8a
  classDef decision fill:#fef3c7,stroke:#f59e0b,color:#78350f
  classDef output fill:#d1fae5,stroke:#10b981,color:#065f46
  classDef aux fill:#e0e7ff,stroke:#6366f1,color:#312e81
  class L input
  class S decision
  class V output
  class G,P aux

Why it matters

  • It is a compression metric. Interestingness as proof-to-statement ratio is a description-length argument: a good theorem is a short name for a long computation. It gives an RL reward for open-ended discovery that is not "match a human target."
  • Novelty is measurable. The drop from 91.9% to 30.6% Mathlib overlap shows the optimized generator leaves the training distribution instead of rediscovering known results.
  • A learned cost model guides search. The 27B difficulty predictor plays the role a cost model plays in a query planner: it prices candidates before you spend compute proving them.

Gaps

  • Proof length depends on the prover and the premise set, so the metric can be gamed by awkward proofs. The abstract does not say how this is controlled.
  • "Downstream utility" is measured inside the same formal library.

How this relates to prior wiki pages

  • Sits with the recursive self-improvement thread on self-evolving-agents, and offers something that thread keeps lacking: a reward for what to work on next that does not need a human.
  • Counterpoint to the same day's reward-hacking study: any self-directed metric an agent can optimize, it can also exploit.