---
format: "aidr-story-markdown/v1"
id: "138e9b7e7d9747243aa585f555fbf6f3d58b687e3498b374de6b74802266db21"
canonical_url: "https://aidr.today/138e9b7e?lang=en"
title: "Scaling Indic Pretraining: 2.8 Trillion Tokens and an Open Data Generation Pipeline"
lang: "en"
requested_lang: "en"
available_langs: ["en","vi"]
translation_fallback: null
fallback_fields: []
published_at: "2026-10-16T01:44:47.000Z"
category: "Data"
topics: ["nvidia","llm","data-engineering"]
source_urls: ["https://huggingface.co/blog/nvidia/scaling-indic-pretraining"]
summary: "NVIDIA published a blog post on Hugging Face describing a 2.8 trillion token Indic pretraining effort and an open data generation pipeline."
---

# Scaling Indic Pretraining: 2\.8 Trillion Tokens and an Open Data Generation Pipeline

> [Open the canonical story](<https://aidr.today/138e9b7e?lang=en>)

**Published:** 2026-10-16T01:44:47.000Z
**Category:** Data
**Topics:** nvidia, llm, data\-engineering

## Summary

NVIDIA published a blog post on Hugging Face describing a 2\.8 trillion token Indic pretraining effort and an open data generation pipeline\.

## Sources

- [Story source](<https://huggingface.co/blog/nvidia/scaling-indic-pretraining>)