--- format: "aidr-story-markdown/v1" id: "da4dd9bf75611cec07d85abb379cd94d9a0c10ddd7002377837c9d08450398a0" canonical_url: "https://aidr.today/da4dd9bf?lang=en" title: "TRL Reduces Agentic RL Trainer Compute 26x via Tree Packing" lang: "en" requested_lang: "en" available_langs: ["en","vi"] translation_fallback: null fallback_fields: [] published_at: "2026-10-15T09:23:00.000Z" category: "Frameworks" topics: ["agent","framework"] source_urls: ["https://huggingnews.com/ai/trl-reduces-agentic-rl-trainer-compute-26x-via-tree-packing-ea1297fe","https://x.com/DirhousssiAmine/status/2110642116716351663","https://x.com/_lewtun/status/2110647508711964871","https://marketbrief.now/ai/trl-reduces-agentic-rl-trainer-compute-26x-via-tree-packing-ea1297fe"] summary: "TRL's AsyncGRPO implementation now uses a tree packing mechanism that forwards each unique token once per batch instead of repeating shared rollout history, allowing trainers to reach the same reward on agentic reinforcement learning with 26x less compute on MiMo Envs. The update replaces an earlier FlexAttention-based iteration with a single FA3 varlen call and addresses bottlenecks in forward and backward passes when agentic training rollouts exceed 100k tokens." --- # TRL Reduces Agentic RL Trainer Compute 26x via Tree Packing > [Open the canonical story]() **Published:** 2026-10-15T09:23:00.000Z **Category:** Frameworks **Topics:** agent, framework ## Summary TRL's AsyncGRPO implementation now uses a tree packing mechanism that forwards each unique token once per batch instead of repeating shared rollout history, allowing trainers to reach the same reward on agentic reinforcement learning with 26x less compute on MiMo Envs\. The update replaces an earlier FlexAttention\-based iteration with a single FA3 varlen call and addresses bottlenecks in forward and backward passes when agentic training rollouts exceed 100k tokens\. ## Sources - [Story source]() - [Story source]() - [Supporting source]() - [Story source]()