Deep Search in Real-World Web Environments

The OpenDS task and OpenDS-World benchmark have been introduced to evaluate deep search agents in real-world web environments. The benchmark consists of 200 challenging tasks requiring agents to autonomously explore the live web, integrate evidence from multiple sources, and determine unique factual answers, with human verification ensuring evidence validity and answer uniqueness.