Mixture-of-Experts kernel engineering on Amazon SageMaker AI

AWS engineers detailed kernel optimizations for fused Mixture-of-Experts models on Amazon SageMaker AI, including Swap-AB for WGMMA utilization, Triton backend routing for FP8 quantization, and the elimination of Triton JIT recompilation. These combined optimizations deliver up to 10% higher throughput and up to 9% faster Time to First Token on H200 GPUs.