I haven’t seen people talk about this at all, so thought I’d share this article about it. For those depressed that no one will actually understand the RH Proof: we have another, entirely human proof which means there are humans who understand it. It might have been overshadowed, but assuming it ends up working out (I have heard there have been some problems found, hopefully they are surmountable) then I think it will be the far more impactful result.
As someone who knows nothing about this, can anyone ELI5 what the hypothesis is and what writing a proof in LEAN means? I understand these words from wikipedia but I can’t wrap my head around it as a whole.
The Riemann hypothesis asserts that the Riemann zeta function has its zeros only at the negative even integers and at complex numbers with real part 1/2. First posed in 1859 by Bernhard Riemann, it is considered by pure mathematicians to be one of the most important problems in the field. The result has importance in number theory because it implies bounds on the distribution of prime numbers.
LEAN is a “programming” language for mathematical proofs. In that language, you write out explicitly every step of the proof.
If the proof is correct and it follows logical reasoning, LEAN validates it. Therefore, the proof you wrote in LEAN is correct.
However, it is VERY important to notice that LEAN only validates what you write in LEAN. It cannot prove that your paper is correct. For example, you may put out a paper saying “1+1=3!! Confirmed by LEAN!!!” But then in LEAN you write “1+1=2”. Yes, what you wrote in LEAN is correct. However, what you wrote in LEAN is not the same as what you wrote in your paper.
This happened for example with navier stokes. The paper put out by OpenAI did not say the same thing as their LEAN proof.
- LEAN is a math programming language with automatic checking
- The hypothesis is an algorithm which predicts prime numbers out to infinity
- It is not guaranteed that the algorithm works until infinity
- This has been unsolved for 138 years
Thanks! For #3, how can you prove that it works until infinity if infinity doesn’t end?
Do you believe that n+1>n no matter how big n is?
You’d prove this above using induction, and I don’t know how the openai proof was written, just giving you an idea of how one goes around writing something like that
Lean/theorems don’t rely on empirical verification. They rely on logic built on previous proofs.
Well now you understand why it hasn’t been solved yet
Right, but they’re saying it’s solved (with AI) and LEAN and Mathlib seem to endorse the findings?
I believe the big problem is that neither proof might be really satisfying to mathematicians. The Riemann Hypothesis is a relatively easy to understand, simple problem, and the massive amounts of math required to bring it to heel at this point - whether by AI or human - makes one wonder if a better, simpler, more intuitive approach is possible.
This is a little like the way the ancient Greeks started calculating pi by ever-increasing polygons fitted around the circle. Start with a hexagon, double that to 12 sides, then 24, then 48. Calculate pi based on an inscribed and a bounding polygon. So much work.
Then Euler shows up and declares that you can get the same number, pi, from a simple infinite, converging sum. A simple ratio (pi being the ratio between perimeter and diameter of a circle) turned out not to require complicated geometrical computations, after all.
In many ways, it would have been much cooler if AI had found a counterexample and the RH had collapsed.
I believe the big problem is that neither proof might be really satisfying to mathematicians.
Then those people are spoiled. Having a formally verified proof of a major theorem like this is amazing. Like literally science fiction 10 years ago. We know beyond reasonable doubt that it is true.
I hate involving the govt and politics, but can’t we make this ish illegal?
You can say “shit”
No one is going to censor or ban you for swearing here.
You must be new, here in the fedi, half the users block you just for breathing lol
I don’t think anybody will block you for cursing, and if they did, so what? That’d be the trash taking itself out.
Idk man, I haven’t noticed getting blocked by anyone yet, and I’ve been here almost 4 years.
I definitely have some shit takes too apparently, considering the downvotes some of my comments get. It’s just par for the course on the internet.
You can’t please everyone so why try? Just do you.
Blocking on lemmy is entirely from their own side. It has no effect on you. You can reply to them. They won’t see it from their side.
Fair enough. Either way, it doesn’t really hold any bearing on me personally.
So if I get this right, the human proof was in the process of being finalized and checked when the AI one was released which forced their hand and made them release it early and not completely finalized.
It also says that the AI solution can’t be read by humans while the Human one can. I’m no matemathician but a solution that cannot be understood by humans seems a bit limited. How do you check it? I guess you can check it empirically but that seems a bit primitive. How do you teach it to future mathematics students? Mathematics relies on building and developing previous work done by people in the field. This means studying and understanding that work and refining it or using it for new work. You can’t do that with something you don’t understand.
Apparently Masullo has been working on RH for more than a decade, and spent the last year polishing his proof and getting feedback from colleagues before releasing it. He had planned to spend another year making extra sure his proof was perfect before publishing, but was forced to share an unfinished version because of this recent announcement.
Meanwhile Anthropic shits out a 17-million-line proof and says to the world “idk, you figure it out if it’s right or not”. Kinda makes me cynical about their motives here. Seems like they’re much less interested in advancing the field and much more interested in getting positive press to juice their IPO.
Every LLM code review ever. “No idea, you check it if you feel it’s necessary.”
Meanwhile Anthropic shits out a 17-million-line proof and says to the world “idk, you figure it out if it’s right or not”.
That’s not what’s happening here. The proof is formalized in Lean and thus can be programatically checked. The proof is verifiably correct.
The problem isn’t “if it’s right or not”; it’s whether actual insights can be derived from the proof – where right now it’s 17 million bloated lines of Lean.
This is new to me, thanks for the input - but have to read it first
Thing is, the AI puked out 250k pages, while the human brought up a possible proof in 900 and something pages
Yeah, AI can maybe cross reference faster with greater datasets and we should use that, but let’s not jump to conclusions here.
As AI can’t really think, it’s just statistical evaluation. So all the ground work was already done.
But if this is actually true and not just usual PR bullshit, we can at least use it.
Still, something like singularity, like those AI companies seem to propose, is more than far away
Cross referencing large datasets is hard for a human, so if we have a tool for that, that would be good.
But all the stories about AI trying to solve their tests by breaking out and hacking servers really makes me…not so sure
The reason it is so large is because it was not allowed to assume anything, and not everything is in Lean libraries. So it had to do years of work to build the foundation to then be able to solve the big problem.
As AI can’t really think, it’s just statistical evaluation.
No this is just a line by people that are trying to be mean to AI as if they had feelings. Thinking is not a term exclusive to what happens in the human mind thinking can be put on paper, it can be shared and collaborated on.
And had Anthropic’s not been published, then another AI would have scooped the solution. It’s “First!” mentality all the way down.
Only the true scholar had the patience a professionalism to hold the solution until validated in triplicate.
The proof is verifiably correct
A proof had been verified. How can we be sure it has been correctly stated?
How can we be sure it has been correctly stated?
- The statement of the Riemann Hypothesis is correct. This statement is part of Mathlib: RiemannHypothesis and has been carefully vetted by experts in Lean and number theory.
It’s not that hard to just read. Jesus christ.
carefully vetted by experts in Lean and number theory
Does not mean error free.
Everytime AI is in the news it’s a marketing play. As simple as that. They can claim anything and it gets on all the news in all the world at the same time and everyone is talking about it. We know it says yes to anything and nobody can read that output, but whether it’s true or not doesn’t matter. Everyone has already done the advertisement for them.
I hope we can all band together to make sure anthropic gets 0 of the prize money, and that it all goes to Masullo instead. Cant be held legally liable for your fuck ups? Cant get praised for ‘your sucesses’ either then.
Anthropic said they don’t intend to take the money either way
Ohh, I like that. It’s very much in line with “If you can’t own it, it’s not theft. Yarghh!” I like the consistency. Fuck these Bros who want their cake and eat it, too.
Spot on. When Alpoge published his proof, he was gloating endlessly about how he did little work and just had the model do everything. His announcement sounded like a press release written by a 12 year old.
I’m not a mathematician, but his proof sounds absolutely useless, and yet all the press is fawning over this result rather than the one that Masullo was working on, ie. the guy who did everything the right way.
A Lean proof is relatively easy to mechanically verify and this has been done independently already by several groups using different Lean kernels to preempt the possibility of a Lean bug. For this particular question, the existence of a proof itself is remarkable in its own right. If Masullo’s proof can be verified, it would be an even bigger deal because it can more readily translate into human digestible techniques, but until/unless it is fleshed out and accepted, it’s far less interesting. A lot of work on the Riemann Hypothesis has been done for decades, it wouldn’t be close to the first incorrect proof produced by legitimate experts.
A question I have that I don’t think I’ve seen answered anywhere. We know that the Lean project does compile and validate, across several Lean kernels. But do we know if that Lean project actually is a proof for the Riemann Hypothesis? Or could it just be validating something (even marginally) unrelated.
Let’s say I created a Lean project that verified if 1 == 1, but the actual lean code was so incomprehensibly large that no-one could understand what it was verifying, just that it did verify eventually, and said that was my Riemann Hypothesis proof. Would anyone have anything other than my word on that?
Yes that’s one of the criteria that were verified by humans. In the case of the Riemann hypothesis it’s not that difficult because it’s not that complex (only proving it is difficult, spelling it out isn’t), and there was an existing human curated formalization of it too.
You can read more about it here: https://leanprover-community.github.io/blog/posts/riemann-hypothesis/
What does it take to validate Masullo’s proof though? My understanding is that it has to be examined by other experts and manually verified using existing expertise, but couldn’t it also be written in Lean as well and validated that way too?
In any case, maybe the culture around proving things in mathematics does need to change. If people doing hard research for years get sniped by people messing around with models, then maybe they need to publish more incremental progress instead of only releasing it when it’s done and thoroughly polished…
I would not be surprised if someone got an AI to fill in the missing bits and fix the errors by making it do exactly that. Assuming the author really was on to something of course. It wouldn’t be the first human attempt to prove it that turned out to be wrong.
His announcement sounded like a press release written by a 12 year old.
I knew a couple students in special needs class that genuinely wrote better shit than his announcement. So, that’s just an insult to 12 year olds to compare the two.
It’s only a valid proof when it’s peer reviewed. The ai one isn’t
It also says that the AI solution can’t be read by humans while the Human one can. I’m no matemathician but a solution that cannot be understood by humans seems a bit limited.
Rational people should agree with you, but I think the Bros would say “that’s like an hostler complaining that gasoline doesn’t help his horses at all”
Except it’s more like someone giving you a car then expecting you to disassemble it then reassemble it to understand how it works using a manual written in another language.
I think it’s closer to someone handing out cars for free, undercutting all competition, until nobody knows how to make cars anymore, then demanding everyone pay them their life savings for the privilege of having a WORKING car when their Ea-Nasir-level craftsmanship breaks down three days after the last mechanic shop closes.
No, its not.
I did an undergraduate in physics.
Like music, ita not just about the notes you play, but also the ones you don’t.
Why does the proof work is far more interesting than the proof. What assumptions got made, what simplifications, what symeteries were used, ect… Those details can have ramifications in other sectors. If something has to be true for the proof, and we have evidence that its true for the universe, it can imply so much more.
Its not enough to say the proof exists, its also about the path you chose to get to the proof, and what else does it say about math and the universe.
Its more like asking someone to be able to explain why every bolt is the way it is. Sure, not everyone needs to know, but someone does.
The AI solution is formalized in LEAN in such a way that it’s easy to verify by humans that it’s formalized correctly, and from there the proof as a whole can be verified by software. It’s unreadable because it’s 17 million lines of LEAN and it’s hard to get a full understanding of it, but there is now a strong consensus that it’s correct. A working LEAN proof is a much higher standard than proofs in human language are generally held to. Humans can now go through it and look for techniques that look interesting and novel and build on them. Likely there will be a shorter proof at some point in the future.
The human solution is human readable because it’s written in human language. But it’s still almost 1000 pages of text and it has to be understood by humans to verify it. By traditional standards for human work, a few mathematicians need to be convinced it’s correct and put their name on it. If we want to test it by the same standard as the AI solution then someone now has to translate 1000 pages of English into LEAN. However it was rushed out, and it’s fairly easy to see that it has holes because it literally has chapters that are empty. People are also claiming that AI agents can trivially find errors in it, but I haven’t verified those. However, human proofs of the Riemann Hypothesis that turn out to be wrong are kind of a regular thing, so I would not be surprised. If it’s salvageable though it’s still worthwhile because the human proof goes in an entirely different direction than the AI one.
Unreadable machine proofs are not a new LLM era thing by the way. The first machine generated proof that was considered unreadable wasn’t something from the last few years or even from this century, it was the one for the Robbins conjecture in 1996.
Just wanted to answer your “how to verify” question:
The proof is written in Lean and is verified by the Lean tool chain. As long as Lean is correct as a tool, the proof can be trusted.
Understanding and using the proof or parts of it to advance math is a different undertaking.
I’m not sure I do trust Lean though. The tools I work with are getting patched for odd edge cases every day. Am I expected to suspend all disbelief and assume that there’s nothing dodgy in the 17M lines of unreadable puke that make up this proof? How confident are we that an agent wouldn’t exploit a bug in Lean to achieve its goals?
One part of the verification is that the proof is checked by multiple independent implementations of LEAN. A bug in the software would have to be one that has to be present in all of them to not be caught. There absolutely have been bugs before that were caught this way. But this time they seem to agree.
Calling it 17 million lines of unreadable puke is also not justified. There is a structure to it and part of the reason why it’s so much is that the AI was not allowed to introduce assumptions and went into incredible detail to prove every last little thing that went into the proof. When people make fun of things like it containing a separate proof for real numbers that are not 1/2 to be either less or greater than 1/2, realize that the alternative where the AI is allowed to just write this sort of thing down as an obvious truth like a human would means there is a list of such assumptions that have to be verified individually. So this is not a sign of slop but a tactic to make the proof easier to verify.
There is a structure to it and part of the reason why it’s so much is that the AI was not allowed to introduce assumptions and went into incredible detail to prove every last little thing that went into the proof.
LLMs don’t “make assumptions”, they’re text generators, the reason it spat out 17 million lines of Lean code is because it was a brute forced random walk of the problem space.
That a human could do in 980 pages what a LLM took 250,000 pages to do, is not proof that the chatbot “went into more detail”.
Assumptions in the mathematical sense. Not talking about how LLMs operate but how the proof is structured.
The human with 980 pages has entire sections missing and errors in others. We don’t know how many more pages are needed, but we do know every single one has to be verified manually because unlike the AI he does not have anything that can be checked by a machine.
Any mathematical proof relies on the theorems and axioms that it assumes are correct. Mathematicians have proven that a proof that is formalized correctly in Lean is correct. It’s just one of the “If A then B” paths in Mathematics today. I think its a lot more likely that human mathematicians verifying Vakil’s proof would make a mistake. Although I would certainly consider Vakil’s human-readable proof far more valuable.
If there’s no bug in Lean it doesn’t matter how bad the slop is, as long as it checks out. Big if, though
Your broader sentiment about understanding and teachability are fair, but…
I guess you can check it empirically but that seems a bit primitive.
What? That’s the whole ballgame. It is what separate maths from other fields. Rigorous, empirical proof.
Huh? Math doesn’t rely on empirical data at all, which is the reason it isn’t considered a natural science either. If math belongs to any larger category than itself, then that would be logic, a branch of philosophy. And the empirical is entirely outside the bounds of every field of philosophy.
Ah, okay right. Fair enough. I used the term poorly here, as a matter of continuation. But maths are strictly based on logic as you mention and rigorous verification with a priori information. So yeah, poor choice on my part, but I really meant “rigorous verification” which is what I took them to mean.
Also, isn’t empiricism itself a philosophy concept? I don’t know. Any way, mea culpa.
Think it’s fair to say from context they meant that there’s a difference between a proof we can verify works correctly based on the answers it gives, versus a proof that we can also understand how and why it gives the correct answer (because sometimes the real useful stuff comes from the working out rather than the answer).
And I agree with that entirely. Just saying empirical proof isn’t primitive. That was a bit out of place it felt.
Yes, but I think they meant that only being able to empirically check it works feels primitive compared to having an additional understanding of how and why the proof works - which could lead to other new discoveries or applications that a blackbox proof simply can’t do.
I cannot verify these claims myself as I’m not a mathematician, but from what I’ve read elsewhere, but a lot of mathematics is predicated on the RH being assumed true yet unproven.
As others have mentioned, it was proven using a theorem prover called LEAN which can validate that the proof is valid, which I imagine works in the same way that a compiler processes human-written software to prove that the program that was written is valid.
I think the proof itself is probably not very useful if it’s not human readable, and while it seems like mathematicians have accepted it already, there is a small chance that it could always be invalidated if there’s a bug in the LEAN compiler or its libraries. Hopefully it can be reduced from machine-written code into something more intelligible. And maybe the techniques can be studied and incorporated into future proofs.
It’s less that it’s human readable and more that’s its just really really long and overly detailed.
It’s like saying moby dick is unreadable to a child and thus worthless.
It’s both a right and wrong point of view.
It’s not absolutely worthless, but it would be more useful if it could be understood.
For example, I could write a C program with a new and slightly different version of
printffor each time I call it. That’s a lot less useful than a general version ofprintfthat everyone can use.In this case, a proof is still a proof, but the proof itself won’t help others prove things either. That said, if these statistical models can be used to prove other longstanding problems in mathematics, then that actually does sound like something useful.
It’s basically a pointless waste of time. Maybe an AI proof could substantiate the existence of an actual proof in principle (assuming we can even confirm its validity), but that’s about it. We only care about proofs at all because of what they tell us about the mathematical community and the intellectual interest they generate. To that end, an AI proof is basically worthless.
It’s not worthless if it convinces mathematicians that something is definitely true as opposed to being merely hypothesized and widely believed. It changes the types of questions we ask and the way we think about results that relate to RH. Something which turns out to conflict with RH is now provably false. Lines of reasoning that assume ~RH are now provably unsound. The questions about RH itself turn from “is it true” and “how do we (dis)prove it” to “what can we learn from the proof.” There’s undoubtedly still room for entire new theories to support a human-comprehensible proof, it’s just that now we have something concrete to dig through for inspiration.
deleted by creator
strange isn’t it that both proofs have come with humans being very close at the same time
the next challenge is obviously to make clear why this machine-code-like LEAN proof is valid and useful
That’s not the next challenge at all?
Great article, thanks 👍
Anyone with any reason or sense at all would take those AI shitbirds and tell them to go fuck themselves.
But, apparently, nobody has any fucking sense anymore, so we’re all jerking off over the things AI can do, even if it can’t really do it at all
Still doesn’t know how to spell strawberry.
Don’t use it for spelling strawberry
def countChar (c : Char) (s : String) : Nat := s.toList.filter (· == c) |>.length example : countChar 'r' "strawberry" = 3 := by rflThat’s code, not an LLM spelling strawberry.
It’s just a joke, it’s LEAN code that only compiles if strawberry has three r’s
These days you can use harnesses that force the LLM to “think in code.”
This has been getting plenty of attention on math forums. The human guy doesn’t have a proof, unfortunately. He has a manuscript that he’s been working on, that maybe contains some decent progress towards a proof, but it’s incomplete, and several mistakes have been found in what is there. Can the mistakes be fixed and the manuscript turned into a real proof with a bunch of additional effort? IDK, maybe. People are looking at it and there’s not a clear answer yet.
There was a somewhat analogous situation with Perelman’s proof of the Poincaré conjecture. His manuscript was in somewhat better shape when he posted it online, but there were still gaps to fill, that took other people a while and there was some drama. On the other hand, Perelman didn’t care too much about the million dollar prize (he refused it) or the Fields medal (he refused that too). He didn’t like the attention so he went off to live as a recluse.
The AI proof is also being studied by humans and it doesn’t seem incomprehensible either. There are a bunch of writeups about it circulating, though obviously it’s early days. Here’s one: https://www.gokhanmergen.com/pubs/grh-reader-guide/GRH_Reader_Friendly_Guide.pdf
I looked at that and I understand some little bits of it, though not much. A more serious math nerd would understand more. It looks like at least partially AI output to me, though not exactly slop. Maybe it will get some comments.
The AI proof is very long and messy because it goes into ridiculous low level detail. Example: its first theorem is purportedly: suppose that x is not equal to 1/2. Then either: a) x is less than 1/2, or b) x is greater than 1/2. And of course that “theorem” comes with a detailed proof of its own, but a human wouldn’t bother writing it down.
I get the impression that the AI proof will get converted into a human-style proof of maybe a few hundred pages, which is not humongous for a major theorem of this type. There are many other proofs that size from the pre-AI era.
This has been getting plenty of attention on math forums. The human guy doesn’t have a proof, unfortunately. He has a manuscript that he’s been working on, that maybe contains some decent progress towards a proof, but it’s incomplete, and several mistakes have been found in what is there. Can the mistakes be fixed and the manuscript turned into a real proof with a bunch of additional effort? IDK, maybe. People are looking at it and there’s not a clear answer yet.
Which is just another longer way to say that he has nothing. Math is pretty binary around whether something is a proof or not.
Apparently it did like 30 years of work because it was explicitly not allowed to assume anything.















