The authors designed browser-based tasks in which an agent searches the live web and produces a specified document, spreadsheet, or slide deck in Google Workspace.
Web agents struggle to turn search results into usable artifacts
The KNOWS benchmark tests whether browser agents can research live web information and assemble it into coherent documents, spreadsheets, and presentations.
Academic
University of Utah
Research Digest··2 min read
Gill and colleagues introduce KNOWS, a benchmark of long, open-ended workflows spanning web research, information synthesis, interface navigation, and artifact creation in Google Workspace.
Why this paper
From University of Utah
In one line
Frontier computer-use agents fully complete fewer than 3% of long-horizon web tasks requiring synthesis and artifact creation, and visual/spatial failures often make partial artifacts unusable.
What we could check
- ·No code link found
- ·No weights link found
- ·No dataset link found
- ·No compute details found
- ·No stated limitations found
- ✓Reports numbers on named benchmarks
Observed from the paper text and links we have. Absence here means we did not find it, not that it does not exist.
§