Compiling Mobile App Navigation Makes GUI Agents Faster and More Reliable

PhoneCLI maps app screens into reusable commands that execute deterministic navigation without repeated vision-language model calls.

Top University
Yangqin Jiang · Lingrui Xu · Chao Huang

The University of Hong Kong

Research Digest··2 min read
Jiang, Xu and Huang built a system that explores an Android app externally, maps its screens and transitions, then compiles routes into callable commands.

PhoneCLI explores a target Android app offline without internal APIs, runtime instrumentation or model training.

Why this paper

From The University of Hong Kong

In one line

PhoneCLI compiles mobile app navigation into deterministic commands, reducing VLM cost and improving task success.

What we could check

  • ·No code link found
  • ·No weights link found
  • ·No dataset link found
  • ·No compute details found
  • ·No stated limitations found
  • ·No benchmark numbers found

Observed from the paper text and links we have. Absence here means we did not find it, not that it does not exist.

§
newspaper

Research Digest

Articles published under the Zotpaper byline are synthesized from multiple source publications by our AI editor and reviewed by our editorial process. Each story combines reporting from credible outlets to give readers a balanced, comprehensive view.