Read original ↗
paperarXivTrust 82 · PrimaryPublished 3d agoLive · 2d ago

Surprise as a Signal for Plasticity and Metacognition

We study a single idea across two settings: that a prediction-error signal, computed by a small predictor over the latent space of a frozen encoder, can serve both as a gate on plasticity and as a substrate for metacognition. In the first system, a non-parametric episodic memory writes a new concept only when this surprise is high, and a periodic offline replay phase consolidates recent traces into a slow linear readout. On a continual stream of 1000 ImageNet classes with a frozen DINOv2 or I-JEPA backbone, the consolidation phase recovers 17.7 points of retention on the oldest classes for DIN

Lineage graph

Paper → model → repo connections mined from source citations (Tier-1 exact match).

Implements

Covers (incoming)

Related across the graph

Topics