Peter Voss

The 7 Deadly Sins of AGI Design

by Peter Voss · Substack · 2024-11-27

Peter Voss analyzes seven key mistakes in AGI design, arguing for a more general, theory-driven approach to artificial intelligence.

The 7 Deadly Sins of AGI Design

Knowledge

1. Focus on Knowledge

Knowledge alone is not intelligence. AGI must dynamically acquire and generalize new knowledge and skills.

Narrow AI

2. Narrow AI

Narrow AI focuses on specific tasks. AGI should be a generalist, able to solve novel problems autonomously.

External Intelligence

3. External Intelligence

Current AI relies on human input for intelligence. Real AGI must figure things out independently.

Pre-Trained

4. Pre-Trained

Pre-trained models cannot update in real time, making them inflexible and disposable.

Quantity

5. Quantity

Current AI prioritizes data quantity over quality. AGI should focus on robust, high-quality knowledge.

Statistical

6. Statistical

Statistical models lack grounding in real-world experience, leading to hallucinations and errors.

Theory

7. Theory

A lack of theory about intelligence hinders AGI. Understanding human cognition is essential.

Key Terms

AGI

A type of AI capable of understanding, learning, and applying knowledge across a wide range of tasks.

Narrow AI

AI systems designed for specific, limited tasks, lacking generalization ability.

Cognitive AI

AI that mimics human cognitive processes, emphasizing real-time learning and reasoning.

Pre-trained Model

A model trained on large datasets before deployment, unable to learn incrementally.

Fine-tuning

Adapting a pre-trained model to specific tasks using additional data.

Prompt Engineering

Crafting input prompts to guide AI model outputs.

Ontological Grounding

Representing knowledge based on real-world entities and relationships.

Neuro-Symbolic Architecture

Combining neural networks and symbolic reasoning for flexible, robust AI.

Real-Time Learning

The ability of a system to learn and adapt as new data arrives.

Data Hallucination

AI-generated outputs that are plausible but factually incorrect.

How to Avoid the 7 Sins

Step 1

Prioritize Learning Ability: Focus on systems that can learn and generalize, not just store knowledge.

Step 2

Design for Generalization: Ensure the system can handle a wide range of novel problems.

Step 3

Build Internal Intelligence: Reduce reliance on human input; enable autonomous reasoning.

Step 4

Enable Real-Time Learning: Allow models to update incrementally as new data arrives.

Step 5

Emphasize Data Quality: Train with high-quality, curated data instead of massive, unfiltered datasets.

Step 6

Ground Knowledge Ontologically: Represent concepts based on real-world features, not just statistics.

Step 7

Develop a Theory of Intelligence: Base AGI design on a deep understanding of human cognition and learning.

Key Questions & Answers

Key Entities & Technologies

Aigo.ai

A company developing cognitive AI and neuro-symbolic architectures for AGI.

INSA

Integrated Neuro-Symbolic Architecture enabling real-time, incremental learning for AGI.

DARPA

The Defense Advanced Research Projects Agency, promoting the 'Third Wave of AI'.

Large Language Model

AI model trained on vast text corpora to generate human-like language.

AlphaFold

AI system by DeepMind for protein structure prediction.

Deep Blue

IBM's chess-playing computer, an example of narrow AI.

IQ Test

A standardized test designed to measure human intelligence.

Human Brain

The biological organ responsible for human cognition and intelligence.

Epistemology

The philosophical study of knowledge, its nature, and how it is acquired.

Featured Video

Bill Dally interviews Yann LeCun at GTC 2025:
Watch on YouTube

Community Voices

Michael Gray

Yann LeCun stated that LLMs will not get us to AGI, echoing Peter Voss's views.

Javier Lopez

Questions the necessity of AGI, suggesting human cognition is already the most sophisticated machinery.