FrameworksNov 16, 2026 · 07:001 source

Last year we built megakernels. This year we deleted them: The road to Together Compiler

From together.ai

Image: together.ai
AI;DR

Together Compiler uses AI agents to rewrite and fuse GPU kernels in a model's forward pass. On a B200, it reportedly beats hand-written megakernels by 28%, achieving 2,118 tokens/s compared to 1,649 tokens/s on Llama 3.2 1B.

Read the sourceSign in to suggest

Sources

One ranked edition, every morning

The stories that matter today. Free, cancel anytime.

Telegram @aidr_today