1

Next-Concept Modeling: Fast, Parallel Coarse-to-Fine Text Generation

arxiv.org

Next-Concept Modeling (NCM) is a two-stage, coarse-to-fine text generation framework using a multiscale residual VQ-VAE and a transformer, achieving better generative perplexity than diffusion language models on LM1B while running 21 times faster.

Sign in to suggest

Key sources

  1. DISCUSSIONYogthoslobste.rs
Markdown