Seeing Donald Knuth sing praise of Claude and be swooned by it for seemingly fuzzing a solution to some problem he was working on while:
- Having no formal proof it is correct
- Claude immediately lost the illusion of cohession as their session continued
I'm growing convenced these things are a siren song to the human brain. It's creepy how fast people will resign themselves to these text generators just cause they can brute force and correctly predict a few solutions.
@andnull Yeahhh I've been thinking about this type of thing recently, too https://mas.to/@nielsa/116155283958385166
It's an eerie, lonely feeling to look at those one thought of as good at the exact things needed to see through the flashy deceptions of LLMs not just fall for them, but commit fully and strongly. And, in my experience, then refuse to face factual points that should convince them to let go of the delusion...