InfraNov 18, 2026 · 03:071 source

AMD MI355X Hits Record 1,129 Output Tokens Per Second on MiniMax M3.1 Flash

From marketbrief.now

Image: marketbrief.now
AI;DR

vLLM and Inferact increased the performance of AMD MI355X GPUs on the MiniMax M3.1 Flash model by 4x in less than 20 days. The optimization achieved 1,129 output tokens per second (tps) at P90 during real production traffic.

The gains came from new AMD kernels written in FlyDSL. These kernels are deterministic, meaning they do not use atomic adds to accumulate their outputs.

Read the sourceSign in to suggest

Sources

One ranked edition, every morning

The stories that matter today. Free, cancel anytime.

Telegram @aidr_today