1

Wieszcz-XIX: A 3.1-Billion-Word Corpus of Pre-1918 Polish and Temporally Bounded Language Models Trained From Scratch

arxiv.org

Wieszcz-XIX is a corpus of 6.75 billion tokens (about 3.1 billion words) in 294,369 documents of Polish published from 1800 to 1918. The corpus was assembled from Wolne Lektury and the Internet Archive using a pipeline that filters, deduplicates, and audits for post-1918 leakage.

Sign in to suggest edits

Key sources

  1. SOURCEarxiv.org
Markdown