"To know what needs to be measured one has to understand what makes human intelligence so powerful.

Unfortunately almost nobody leading AI efforts right now is doing that or getting it right. Some cling to the idea that knowledge and/ or reasoning are intelligence, others explicit state that they don’t know what intelligence is: Demis Hassabis says that we need to build AGI in order to understand intelligence, while Elon Musk claims that nobody understands it (personal conversation).

Fact is that we can and must understand human intelligence from first principles for us to develop it effectively. However, we need to start with epistemology and cognitive psychology to figure it out. Not statistics, mathematics, or computer science. I summarize these blind spots towards AGI as ‘The 7 Deadly Sins of AGI Design’.

In short, what makes human intelligence so special is the ability to quickly adapt to changing circumstances, by learning incrementally in real time and to form contextual abstraction on-the-fly. We also leverage meta-cognition to monitor and control our thought processes (System1 and 2 thinking).

AI born from these insights is called Cognitive AI, or what DARPA calls “The Third (and final) Wave of AI“. LLMs contain knowledge and skills that are off the charts relative to humans, but they do not posses the unique qualities required for real intelligence."

https://petervoss.substack.com/p/benchmarks-and-the-narrow-ai-trap

#AI #AGI #Intelligence #CognitiveAI #CognitivePsychology #Epistemoogy #LLMs #Chatbots #GenerativeAI