ModelsOct 2, 2026 · 11:242 sources

Marin’s 535B Model Tracks loss within 0.3% in Largest Live Run

From huggingnews.com

Image: huggingnews.com
AI;DR

Marin's 535B parameter Mixture of Experts model is halfway through a public training run on 18T tokens over 43 days, tracking within 0.3% of its loss forecast despite a 300x extrapolation, after the project's scale was increased from an original 360B parameters using custom kernels to improve hardware efficiency.

Read the sourceSign in to suggest

Sources

One ranked edition, every morning

The stories that matter today. Free, cancel anytime.

Telegram @aidr_today