@sbrl's 2 laws of artificial intelligence:
1. AI will always hallucinatinate
2. AI will always be biased
AI is like a dictionary. It stores the important things in the training dataset in its memory. Then it matches against them when queried. Anything outside of what it learnt matches results in an inaccurate answer.
Data is generated by humans, who are inherently biased. We can't account for biases we don't know about.
What matters is not really AGI and media hype, but how we understand how models work, apply them appropriately, and continually work to understand and deal with bias as best we can - just like with irl.