Diagnosing the Reference Gap: What Visual Scaffolds Can and Cannot Fix in Multimodal Reasoning

Multimodal large language models struggle to reason reliably over visual content due to a reference gap. ReGap-Bench is a paired benchmark of five visual reasoning tasks. Task-matched references improved accuracy by up to 25\%.