1

An interview with Goodfire researcher Nick Cammarata, whose viral blog post claimed LLMs are easier to understand than thought, as other researchers push back (Will Douglas Heaven/MIT Technology Review)

techmeme.com

A Goodfire researcher whose blog post claimed LLMs are easier to understand than thought discussed the topic in an interview, as other researchers have pushed back.

Sign in to suggest

Key sources

  1. SOURCE@nickcammarata“I started openai's first large-scale automated interpretability project, finding about 2% of neurons legible with the primitive tools we had”x.com
  2. SUPPORT@choblin29“In a new Goodfire essay, he reports preliminary audits of Qwen3-32B finding that ~90% of neuron poles have one main job, ~7% have two related jobs, and only 2–4% remain unexplained.”x.com
  3. SOURCE@goodfireai“I think our job is to sort of try to think like the neural network.”x.com
  4. SUPPORT@tszzl“when nick told me that he had some interp breakthroughs, he was uh, underselling it. i think this may be remembered as a major moment in scientific history.”x.com
  5. SUPPORT@_nathancalvin“Labeling neurons is not understanding behavior. Even if 90% of neurons have clear labels, explaining or ruling out something like deception means understanding how millions of them work together.”x.com
  6. SUPPORT@hosseeb“Takeaway: superposition was a hoax. Neurons are actually simple and encode simple concepts; we just didn't know it because previous tools sucked.”x.com
  7. SUPPORT@teortaxestex“you can see why frontier bros will be excited it's a permission structure to race ahead”x.com
  8. SUPPORT@jachiam0“I am excited to see the insights here translate into tools with quantifiable success rates for helping us identify potential harms or steer neural networks away from risk.”x.com
Markdown