Reasoning requires logic (which is the study of correct reasoning) and logic is a philosophical discipline. It requires understanding and a theory of mind.

You can’t statistics yourself into logic; despite some mathematicians claiming you can—it’s a categorical error to think this (indeed, a reasoning logic error).

Both from a perspective of mathematics (“it’s likely therefore it’s true” is not logically valid) and from a perspective of philosophy (which requires understanding what is actually talked about).

Therefore statistical algorithms such as LLMs can never reason.