A thought about mathematics and genAI (sorry), but I haven't seen this point expressed yet, so wanted to share.
According to Platonism (in the sense of Gödel), humans discover mathematical truths by developing a kind of quasi-sensory relationship with their abstract object of study. This suggests an interaction that is quite similar to how we interact with physical objects: they're objectively there, independent of us, and we discover their properties through our senses. 1/2
From that perspective, an LLM-based system can continue to build upon what mathematicians have written so far, exploring the convex hull of the space of their writings so far (which may yield new combinations that we could consider creative), but one could expect this to diverge significantly from what researchers, who are in contact with their object of study, would find. Much like you wouldn't expect physics to get ahead based only on what's written so far, without additional experiments. 2/2