1

Hugging Face TRL v1.15 Cuts Peak VRAM by 82%

huggingnews.com

Hugging Face released TRL v1.15, which reduces peak VRAM usage by up to 82% via a fused LM head enabled by default. The update supports sequence lengths up to 7 times greater than previous versions, increasing token capacity for DPO from 10k to 59k and GRPO from 29k to 115k.

Sign in to suggest edits

Key sources

  1. SOURCE@qgallouedec“DPO 10k → 59k tokens, GRPO 29k → 115k”x.com
  2. SOURCEmarketbrief.now
Markdown