---
format: "aidr-story-markdown/v1"
id: "82e16a5932f34a9929c93fced938ad4a7daa83eed6b8b7ebc9b3da6dfcd8cec9"
canonical_url: "https://aidr.today/82e16a59?lang=en"
title: "Zero-Order Training Hits New FineWeb-30M Record With 7.9 Minute Run"
lang: "en"
requested_lang: "en"
available_langs: ["en","vi"]
translation_fallback: null
fallback_fields: []
published_at: "2026-10-24T18:09:33.000Z"
category: "Research"
topics: ["llm"]
source_urls: ["https://huggingnews.com/ai/update-zero-order-training-hits-new-fineweb-30m-record-with-79-minute-ru-36775dfd","https://x.com/RobertTLange/status/2113969523153854671","https://x.com/industriaalist/status/2113365351455219760","https://x.com/spicey_lemonade/status/2113525694521344096","https://x.com/FrancoisChauba1/status/2114003080551485472","https://x.com/zhengyaojiang/status/2113592326463312382","https://marketbrief.now/ai/update-zero-order-training-hits-new-fineweb-30m-record-with-79-minute-ru-36775dfd"]
summary: "Robert Lange achieved a validation loss of 3.5 on the FineWeb-30M zero-order optimization benchmark in 7.9 minutes using a single 8xH100 node, a 12.9x improvement over the previous record of 102.5 minutes set by the Noise speedrun."
---

# Zero\-Order Training Hits New FineWeb\-30M Record With 7\.9 Minute Run

> [Open the canonical story](<https://aidr.today/82e16a59?lang=en>)

**Published:** 2026-10-24T18:09:33.000Z
**Category:** Research
**Topics:** llm

## Summary

Robert Lange achieved a validation loss of 3\.5 on the FineWeb\-30M zero\-order optimization benchmark in 7\.9 minutes using a single 8xH100 node, a 12\.9x improvement over the previous record of 102\.5 minutes set by the Noise speedrun\.

## Sources

- [Story source](<https://huggingnews.com/ai/update-zero-order-training-hits-new-fineweb-30m-record-with-79-minute-ru-36775dfd>)
- [Story source](<https://x.com/RobertTLange/status/2113969523153854671>)
- [Story source](<https://x.com/industriaalist/status/2113365351455219760>)
- [Supporting source](<https://x.com/spicey_lemonade/status/2113525694521344096>)
- [Supporting source](<https://x.com/FrancoisChauba1/status/2114003080551485472>)
- [Supporting source](<https://x.com/zhengyaojiang/status/2113592326463312382>)
- [Story source](<https://marketbrief.now/ai/update-zero-order-training-hits-new-fineweb-30m-record-with-79-minute-ru-36775dfd>)