ModelsOct 2, 2026 · 11:242 sources
Marin’s 535B Model Tracks loss within 0.3% in Largest Live Run
From huggingnews.com
Marin's 535B parameter Mixture of Experts model is halfway through a public training run on 18T tokens over 43 days, tracking within 0.3% of its loss forecast despite a 300x extrapolation, after the project's scale was increased from an original 360B parameters using custom kernels to improve hardware efficiency.
Read the sourceSign in to suggest
Sources
One ranked edition, every morning
The stories that matter today. Free, cancel anytime.
Telegram @aidr_today