SteerDistill: Quantizing LLM Agents via Closed-Loop Teacher Steering

SteerDistill is a quantization-aware distillation method where a full-precision teacher guides a student to revise failed responses. Across five agentic benchmarks and three models, SteerDistill exceeds the strongest quantized baseline by 1.67--2.18 points in average score under W4A16.