Cortex: Consolidating Context into Parametric Memory

Cortex is a method that consolidates context into parametric memory by generating prospective queries and distilling context-conditioned outputs into low-rank or structural feed-forward network updates, achieving strong consolidation and retention performance across various model types.