No.
The automatic theorem proving blokes were writing programs that actually tried to do mathematics. LLMs are exactly and only random text generators. Since they have a lot of math proofs in their training data, they randomly mimic math proofs quite nicely.
LLMs do not have a mechanism for checking their output. That's your job.
Lean, on the other hand, is about computer representation of proofs; building libraries of valid proof steps. Serious work. Not a joke.
