CaltechMathAI

We are a team of Math-AI researchers at Caltech, focused on developing AI systems that can tackle hard research-level math problems. Solving challenging mathematical tasks, such as proving or disproving long-standing conjectures, or establishing difficult theorems, often requires discovering intricate, multi-step solutions. Our mission is to use these hard mathematical problems as environments to design new AI algorithms and architectures that can identify rare solutions carrying disproportionately high rewards. In other words, we aspire to be one of the best AI research labs focused on sparse-reward, long-horizon tasks.

A sparse infinite wave graph with isolated orange peaks rising above hills and valleys

The Algebraic Hirsch conjecture.

Rare non-Hirsch ideals constructed across a wide range of degrees.
First successful use of hierarchical RL in commutative algebra.
ALGEBRAIC_HIRSCH.ENV
Environment Demo
GENERATOR GRAPH / GI READY
Interactive Algebraic Hirsch generator graphNodes are joined by level-one edges when their labels intersect in d minus one symbols. Orange marks a diameter path; curved off-red edges are irreducible level-two edges.
INITIAL GENERATOR024578Presampled trajectory ready

HOW TO READ IT Nodes connect when |Si ∩ Sj| = d − 1. Orange traces a diameter path; curved off-red arcs mark irreducible level-two edges.

The hierarchical run is presampled: πS builds the line, then πL completes linearity. Uniform search samples distinct generators randomly.

The Andrews–Curtis conjecture.

153 more presentations solved than the prior RL baseline.
550 unsolved examples reduced to 261 equivalence classes.
New datasets
AC-19: 125K · AC-1M: 1.1M
ANDREWS_CURTIS.ENV
INTERACTIVE SANDBOX
BALANCED PRESENTATION / ⟨x,y | r₁,r₂⟩ READY
r₁5 letters
r₂4 letters

TRY IT Apply legal transformations manually, or run the stored agent trajectory back toward ⟨x,y | x,y⟩.

Free reductions happen automatically after every move. This is a small word sandbox, not a general conjecture solver.

The Caltech MathAI team.

Sergei Gukov

Sergei Gukov

Giorgi Butbaia

Giorgi Butbaia

Davide Passaro

Davide Passaro

Michele Tarquini

Michele Tarquini

Lucas Fagan

Lucas Fagan

Justin Tan

Justin Tan

External collaborators.

Paul Orland

Paul Orland

Portrait of Angus Gruen

Angus Gruen

Portrait of Elli Heyes

Elli Heyes

Coco Xiaoyu Huang

Coco Xiaoyu Huang

Maksymilian Manko

Maksymilian Manko

The lab is grateful to the institutions and partners whose support makes this work possible.