Did GPT–5 Just Crack ‘Minor’ Open Math Problems? ArXiv Paper and Reddit Debate

A short post in r/OpenAI sparked a familiar mix of excitement and skepticism this week: a mathematician (now working in AI) posted an arXiv paper arguing that GPT–5 can solve “minor open” math problems – those that would typically take a competent PhD student a day or a few days. The paper (linked in the thread) and a flurry of retweets from AI insiders prompted the Reddit discussion (https://reddit.com/r/OpenAI/comments/1nqqh23/mathematician_says_gpt5_can_now_solve_minor_open/).

Three key questions

1. Are the problems genuinely novel (not simply present in training data)?
2. Does GPT–5 produce verifiable, checkable proofs, or plausible-sounding but wrong arguments?
3. Even if limited, how much does this change the pace or method of mathematical research?

What the thread shows

• Link and source: A user posted the arXiv link (https://arxiv.org/abs/2509.18383) after other commenters asked for it. That’s the central artifact for verification.
• Mixed reactions: Several commenters argued these are problems a competent specialist could solve in days, so “minor” is probably the right label. Others pointed out that even solving those reliably would be a large practical step for research tooling.
• Skepticism about leakage: Some users suspected data leakage, that the model had seen solutions or very similar arguments during training. This is the chief technical worry when claims of novel problem-solving surface.
• Practical value noted: A number of commenters emphasized that rapid help on “small but annoying” research bottlenecks could accelerate work the same way AlphaFold accelerated structural biology.

Representative comments

“The critical thing is that the answer isn’t in the training data. Whether or not GPT–5 is able to solve things truly novel, it’s applying its knowledge like a real PhD. It’s not simply regurgitating.” — u/SoylentRox

“Being able to solve these problems can greatly accelerate research. You can do it in a few minutes instead of days, and also in parallel. It’s like having 100 PhD students working for you at the same time.” — u/mao1756

Why this matters

• Math as a reasoning testbed: Mathematics is arguably one of the cleanest domains to probe a model’s reasoning. Textual descriptions plus formalizable logic make it easier to distinguish memorization from generalization. If models can produce verifiable proofs, that is meaningful.
• Tooling effect vs. replacement: Even if GPT–5 only handles “minor” problems, the practical effect is large. A model that assists with lemmas, heuristics, and writeups could multiply researcher productivity; parallelism and speed matter.
• Verification and trust: For real research use, model outputs must be checkable. AlphaFold succeeded in part because it provided confidence measures and outputs that domain experts could validate. Math needs the same: rigorous proofs, reproducibility, and ideally mechanized verification (proof assistants) to move from impressive demo to reliable tool.

Concerns to keep in mind

• Data leakage: If the solutions or near-equivalent derivations exist in the training corpus, the result is less surprising. Papers need to be explicit about dataset exposure and held-out evaluation.
• Hallucination risk: Even when conclusions are sometimes correct, intermediate steps can be confidently wrong. That undermines trust unless there is a way to check steps mechanically.
• Overclaiming: Community amplification (retweets, headlines) can inflate expectations. Several Redditors flagged potential bias since the author works in AI and the paper circulated through company channels.

What to look for next (actionable checklist)

1. Reproducibility: Can other teams run the same experiments on independently trained models and get the same results?
2. Held-out challenges: Are there new, verifiably unsolved problems used as a blind test set?
3. Formal verification: Are outputs exported to proof assistants (Coq, Lean) or theorem provers for mechanical checking?
4. Calibration & uncertainty: Does the model provide confidence scores that correlate with correctness, like AlphaFold’s pLDDT?

My takeaways

• Treat the paper as an important data point, not a conclusion. There’s real potential here: math-focused reasoning by LLMs could be a major productivity multiplier.
• Verification is everything. Without held-out tests and mechanical checking, we should expect a mix of genuine reasoning, helpful heuristics, and occasional regurgitation.
• The practical story is the most compelling: even “minor” problem-solving that cuts days to minutes will change how research gets done.

Final note

Remember that there is often another side to the story. Exciting claims merit independent verification and sober framing. If GPT–5 (or successors) genuinely produce verifiable new math at scale, the community will need to build standards: datasets, blind challenges, and proof-checking pipelines so we can separate hype from hard progress.