How AI Lost Its Way - By Peter Voss | Published: Nov 27, 2024
Explores misconceptions in AGI design, highlighting seven key mistakes preventing progress toward real artificial general intelligence.
Misconception that knowledge equals intelligence. AI should dynamically acquire and generalize knowledge, not just store it.
Focus on specific abilities rather than general intelligence for novel problems. AGI should be excellent generalists.
Intelligence comes from human programmers, not the system. Real AGI must figure things out autonomously.
Models trained upfront can't update in real-time, making them disposable and limited.
Reliance on massive data quantities leads to hallucinations. Focus on quality over quantity.
Statistical predictions cause errors; knowledge isn't grounded in real-world interactions.
No deep understanding of human intelligence; brute-force approach is inefficient.
Systems that can learn and perform any intellectual task that a human can.
AI models trained on vast text data for language tasks, but limited in generalization.
Third Wave AI focusing on real-time learning and reasoning, path to AGI.
A training algorithm used in neural networks for error minimization.
Factual errors generated by AI due to statistical predictions.
Knowledge representations grounded in real-world attributes.
DARPA's term for adaptive, contextual AI systems.
Integrated Neuro-Symbolic Architecture for Cognitive AI.
AGI refers to systems that autonomously learn novel human-level cognitive tasks with limited resources.
Deep Learning relies on pre-training and can't update in real-time or generalize broadly.
Emphasizing stored knowledge over the ability to acquire and generalize new knowledge dynamically.
It focuses on specific tasks, not general intelligence for novel problems.
Intelligence derived from human engineers rather than the AI system itself.
Models can't update core knowledge in real-time, becoming outdated quickly.
Massive, uncurated data leads to hallucinations and poor robustness.
Predictions are randomized, not grounded in real-world ontology.
Without understanding human intelligence, AGI is pursued via brute force inefficiently.
DARPA's Third Wave: Learns incrementally with less data, path to real AGI.
Integrated Neuro-Symbolic Architecture, an example of Cognitive AI for AGI.
A few million words, not trillions like LLMs.
IBM's Deep Blue for chess, AlphaFold for protein folding, and specialized LLMs.
Allows adaptation to new information without full retraining, enhancing flexibility.
Due to statistical predictions from uncurated data, leading to plausible but false outputs.
Studies how knowledge is acquired and validated, essential for building intelligent systems.
Cognitive AI focuses on real-time, adaptive learning vs. Deep Learning's static pre-training.
Bill Dally Interview with Yann LeCun at GTC 2025: Discussing LLM limitations.
Company developing Cognitive AI for AGI. Visit
U.S. agency advancing technology. Visit
AI for protein prediction, narrow AI example.
IBM's chess AI, narrow system.
Paid access: $5 USD/month.
NVIDIA's tech conference. Details