● ResearchNov 3, 2026 · 15:518 sources

Replication Confirms MIT Weight Editing Study as Authors Clarify Loop Fix

From marketbrief.now

AI;DR

An independent replication by researcher Alex Krentsel confirmed MIT CSAIL's weight space programming results and found that the ability to write functional neural network weights from scratch only emerged in the latest generation of frontier models, such as GPT-6 Astra and Claude Opus 5.5. In those tests, the newest models generated networks to play the Atari game Breakout without training or tools, scoring up to 22 times an RL-trained baseline. Lead MIT author Rikiya Takehi also released the edited Qwen3.5-0.8B model on Hugging Face Hub after it was rebuilt from published logs and scored 51.0% on a MATH-500 re-run.

MIT co-author Alex Zhang clarified that GPT-6 Astra did not edit new math skills directly into Qwen3.5-0.8B, which originally scored 7.9% on MATH-500 before rising to 48.1% in the paper and jumping from 21.0% to 62.3% on instruction following. Instead, an LLM-optimized prompt contained hints to check for repetitive reasoning loops, a defect noted in Qwen's model card. Given 50 forward-pass batches, Astra wrote code using activation steering to suppress a looping signal across 131,000 weights in layers 15 and 19, or 0.016% of the 800M parameter model.

Cutting those lo

Read originalSign in to suggest

Sources

+ 5 more
  1. SUPPORT@adam_karvonen“Astra used code to perform some standard interp techniques, found a looping direction, and ablated it from the weights.”x.com
  2. SUPPORT@a1zhang“We discovered Astra indeed used a trick loosely described in https://t.co/XMh94FEZjx based on activation steering to reduce this effect”x.com
  3. SUPPORT@hosseeb“It's more like "Astra found a published interpretability technique that can solve this particular kind of failure modes, and implemented it on its own."”x.com
  4. SUPPORT@paul_cal“2 interesting things: recent models can pick out Atari games from neural net weights alone (nets trained to beat them) in one shot w no tools. And can write a competent Breakout-playing neural net with no tools.”x.com
  5. SUPPORT@wesroth“The share of MATH-500 answers hitting the 32,768-token limit fell from 93% to about 33%, alongside a substantial accuracy gain. A follow-up with Gemma 3 270M, which rarely looped, produced no clear math improvement.”x.com
#openai#llmMarkdownScore 4.03.4k tokens
Image: marketbrief.now
Read original