by Peter Voss · Substack · 2024-11-27
Peter Voss analyzes seven key mistakes in AGI design, arguing for a more general, theory-driven approach to artificial intelligence.
Knowledge alone is not intelligence. AGI must dynamically acquire and generalize new knowledge and skills.
Narrow AI focuses on specific tasks. AGI should be a generalist, able to solve novel problems autonomously.
Current AI relies on human input for intelligence. Real AGI must figure things out independently.
Pre-trained models cannot update in real time, making them inflexible and disposable.
Current AI prioritizes data quantity over quality. AGI should focus on robust, high-quality knowledge.
Statistical models lack grounding in real-world experience, leading to hallucinations and errors.
A lack of theory about intelligence hinders AGI. Understanding human cognition is essential.
A type of AI capable of understanding, learning, and applying knowledge across a wide range of tasks.
AI systems designed for specific, limited tasks, lacking generalization ability.
AI that mimics human cognitive processes, emphasizing real-time learning and reasoning.
A model trained on large datasets before deployment, unable to learn incrementally.
Adapting a pre-trained model to specific tasks using additional data.
Crafting input prompts to guide AI model outputs.
Representing knowledge based on real-world entities and relationships.
Combining neural networks and symbolic reasoning for flexible, robust AI.
The ability of a system to learn and adapt as new data arrives.
AI-generated outputs that are plausible but factually incorrect.
Prioritize Learning Ability: Focus on systems that can learn and generalize, not just store knowledge.
Design for Generalization: Ensure the system can handle a wide range of novel problems.
Build Internal Intelligence: Reduce reliance on human input; enable autonomous reasoning.
Enable Real-Time Learning: Allow models to update incrementally as new data arrives.
Emphasize Data Quality: Train with high-quality, curated data instead of massive, unfiltered datasets.
Ground Knowledge Ontologically: Represent concepts based on real-world features, not just statistics.
Develop a Theory of Intelligence: Base AGI design on a deep understanding of human cognition and learning.
A company developing cognitive AI and neuro-symbolic architectures for AGI.
Integrated Neuro-Symbolic Architecture enabling real-time, incremental learning for AGI.
The Defense Advanced Research Projects Agency, promoting the 'Third Wave of AI'.
AI model trained on vast text corpora to generate human-like language.
AI system by DeepMind for protein structure prediction.
IBM's chess-playing computer, an example of narrow AI.
A standardized test designed to measure human intelligence.
The biological organ responsible for human cognition and intelligence.
The philosophical study of knowledge, its nature, and how it is acquired.
Bill Dally interviews Yann LeCun at GTC 2025:
Watch on YouTube
Yann LeCun stated that LLMs will not get us to AGI, echoing Peter Voss's views.
Questions the necessity of AGI, suggesting human cognition is already the most sophisticated machinery.