The authors used 1,570 interaction traces to construct 50 app environments.
Reconstructing app behavior before coding improves simulated GUI agent training
Trace2World builds source-linked app simulations from interaction recordings, reproducing 91.1% of evaluated workflows and improving agents’ performance on real devices.
Chinese Tech
Zezhou Wang · Hanzhang Zhou · Panrong Tong · Quyu Kong · Pengxiang Li · Steven Hoi · +2 more
Nanjing University · Alibaba Token Hub, Alibaba Group · Beijing Institute of Technology
Research Digest··2 min read
Wang and colleagues introduce Trace2World, a system that reconstructs an app’s behavior from recorded interactions before generating a runnable training environment.
§