ResearchNov 16, 2026 · 07:001 source
Loopback Transformer: Towards a Unified View of Residual Looped Transformers
From huggingface.co
The Loopback Transformer reduces parameter count by repeatedly applying shared blocks. On ClimbMix, Loopback reaches lower validation loss than standard Transformer baselines with 40-75% of their Transformer parameters at reference scales from 191M to 3B. It also has higher mean accuracy over thirteen downstream tasks at 1.4B and 3B.
Read the sourceSign in to suggest
Sources
One ranked edition, every morning
The stories that matter today. Free, cancel anytime.
Telegram @aidr_today