From the article:

While this mathematical formalism was unreasonably effective, it came with a decidedly unhealthy downside. Shahar Mendelson best described this general problem of applied pure mathematics in a talk he gave at COLT 2014. Applied mathematicians often need to build a giant scaffolding of mathematical modeling to solve a problem. This scaffolding creates new mathematical puzzles that aren’t directly connected to the original problem of interest, but that entice problem solvers. You’ll then see dozens of follow-up papers solving the puzzles but forgetting the problem we cared about in the first place.

This is open problem culture, and it’s corrosive. It leads to trophy hunting, where people race to scoop each other, consult expert friends for secret insights, or steamroll each other with ever more complicated math.

This fetishization of puzzle-solving as genius has long been a destructive tendency in mathematics more broadly. It’s easy to get caught up in the thrill of it. Mathematics is arguably the most meritocratic academic discipline. There are set problems, and the people who solve them are the smart ones. Everyone forgets that the only reason problems confer status is that (a) they are currently unsolved and (b) enough mathematicians have decided these are worth solving. That (b) part is not meritocratic.

[...]

Indeed, I didn’t learn anything about fluid dynamics from OpenAI’s proposed solution to the Clay Millennium Prize Navier-Stokes problem. This problem is exactly the sort of puzzle artifact that I lamented above. The resolution of the Navier-Stokes problem itself tells us nothing about the dynamics of fluids that the equations attempt to model.

That said, I’ve learned a lot from the supposed resolution. I learned that the jump from rote IMO solving to the Millennium Prizes was much shorter than I expected. If you build an algorithm that’s good at solving IMO problems, and you present it with the right ingredients and computational resources, you can solve hard math problems too. That is, a lot of mathematics is training people to benchmaxx. We have already created a battery of tests, carefully tuned with the best psychometrics to find mathematical genius. Training computers to maximize those benchmarks ends up solving the benchmarks. What are millennium problems other than humanity’s final math exam?

This unfortunately makes a lot of sense with the benefit of hindsight!

If this is the lesson, there’s a funny takeaway. While it feels like you need to be an IMO prodigy to set foot in the mathematical arena, being a great IMO solver doesn’t mean you’ll become a great mathematician. For that, you need to bring other talents to bear. Despite the efforts of many smart and caring people, those talents remain ineffable. They certainly aren’t benchmarkable.

In an age of the decidedly anti-intellectual culture of artificial intelligence, mathematicians, both pure and applied, need to keep working to articulate what on earth those talents are. The statements so far, describing how mathematical programs are more than the truth values of their associated theorems, are a good start even if they are not met with universal acclaim. More need to chime in with stories about how mathematics, even the very pure variety, is valuable for scientists, engineers, and everyone else.