Core Concepts

What is Model Collapse?

When AI models degrade from being trained on AI-generated content instead of human data.

Definition

Model collapse is a phenomenon where AI models trained on synthetic (AI-generated) data progressively lose quality and diversity in their outputs. As AI-generated content floods the internet, future models risk being trained on this synthetic data, creating a feedback loop that degrades quality over time.

๐Ÿ’ก Example

If a future LLM is trained primarily on AI-written articles (rather than human-written ones), its output would become increasingly generic, repetitive, and lacking in creativity โ€” each generation slightly worse than the last.

Related concepts

LLM (Large Language Model)

A type of AI trained on massive text datasets to understand and generate human language.

โ†’
Generative AI

AI systems that create new content โ€” text, images, code, music, video.

โ†’

Explore AI tools

Find tools that use model collapse in practice.

Browse all tools โ†’ Back to glossary
What is Model Collapse?

Model collapse is a phenomenon where AI models trained on synthetic (AI-generated) data progressively lose quality and diversity in their outputs. As AI-generated content floods the internet, future models risk being trained on this synthetic data, creating a feedback loop that degrades quality over time.

How does Model Collapse work in practice?

If a future LLM is trained primarily on AI-written articles (rather than human-written ones), its output would become increasingly generic, repetitive, and lacking in creativity โ€” each generation slightly worse than the last.