The human brain does not desire knowledge, or safety, or truth - it desires certainty. The job of science is to deconstruct and rebuild the brain’s naive concept of certainty.
In that light, #LLMs are no different from fortune telling, or religion. What they tell you may be true or it may not - but truth is not the product. *Certainty* is the product.
They make you *feel* enlightened. That they can do this at a scale that fortune tellers could never dream of should be terrifying.