Browse topics Hub · essay · articles · FAQ · glossary

Attention degradation — context saturation & attentional residue

A formal account of *why* long contexts degrade. Research operationalises two mechanisms: **context saturation**, where extraneous task-irrelevant informatio…

A formal account of why long contexts degrade. Research operationalises two
mechanisms: context saturation, where extraneous task-irrelevant information
crowds the workspace, and attentional residue, where interference from
task-switching lingers and impairs subsequent reasoning. These are tied to
architectural causes — the quadratic scaling of attention and "attention sinks" that
distribute focus unevenly across a sequence. This gives the "context rot" students
met at Basic++ a rigorous, measurable foundation.

Sources