Training a 3.8B LLM to 0.384 CORE for $998 – Hugo Vergnes

A 3.8B model pretrained from scratch to 0.384 CORE on 65B tokens in 43 hours, for $998.