Discussion about this post

User's avatar
Tony Feng's avatar

I support activism - shame away! But maybe read the rest of this post first.

In my opinion, a couple productive ways for activists to channel their energy would be to:

(1) go on Twitter and criticize bad behavior, call out misleading or misinformed takes, douse hype (Thomas Bloom is great example to follow), etc.

(2) propose, in broad discussion with the mathematics community, realistic and concrete actions to improve the situation.

The sentiment that "everybody hates the AI industry" should certainly be given its fair share of airtime, but it is already quite well known.

Plenty of tech folks have made fools of themselves commenting on mathematics. Conversely, mathematicians may not understand the dynamics of tech labs as well as they think. For example, there seems to be a common misconception that AI companies want to "solve math" as a marketing gimmick to demonstrate superintelligence. This does not match my experience of the frontier labs (OpenAI, Anthropic, Google). It is true that Google employs many people with math backgrounds, who like to try math problems on their products for fun, and initially got overexcited with the results - I acknowledge my own guilt in this - but since then we have exercised considerable restraint behind the scenes.

Lastly, I'd like to advocate for one benefit of the technology. Wizened mathematicians like myself know that "proof indigestion" was a problem even before AI, and almost every paper of appreciable length contains serious mistakes (meaning beyond typos). One of my main research threads in AI is on natural language verification, this is the main way I use AI for my mathematics, and I'm happy that the models have reached the point of helping me catch many errors in my work. Once these idealistic young AI abstainers see how pervasive mistakes are in the literature, they may develop a slightly more accommodating view of the role of the technology. I am happy to provide trial refereeing for those who do not have ChatGPT subscriptions.

Grigori avramidi's avatar

Weirdly enough (or maybe not), I recently observed that it bothers me a lot more when people don't write in their own voice than when they use an argument suggested by an llm. The later is ''oh, Frank learned some new tricks, this is how he thinks about that argument'' (no shade on any Franks out there), while the former is much more ''Frank is gone, it's just an llm speaking through him''. At this point this is just an emotional response, but I'm surprised by how visceral it is.

P.S.: I initially used Mike for my hypothetical person, but then realized that you might go by that so changed it to Frank...

26 more comments...

No posts

Ready for more?