Tools & MCP

Tool ecosystems, MCP, function calling

8 articles

Tools & MCP

Structured software interfaces outperform screenshot-and-click control for AI agents

Xie and Chen replace visual GUI control with an agent-facing layer that represents application state as JSON and exposes semantically meaningful, code-executable actions. On 380 single- and multi-application tasks, closed models using ASIL achieved more than 80% strict success while averaging fewer than five actions per task, far exceeding screenshot-based control under the tested conditions.

29 Aug 2026
Tools & MCP

Open-source image model rivals closed systems on minimal budget

The authors introduce Boogu-Image-0.1, a family of open-source multimodal models that unify understanding and generation. By strengthening the system's understanding capability through a better multimodal encoder, agentic prompt rewriting, and inference-time scaling, the model matches or surpasses existing open-source models and approaches closed-source systems, all with a theoretical training cost of roughly $400K.

15 July 2026
Tools & MCP

VLMs improve spatial reasoning by actively imagining novel views with a world simulator

The authors propose Astra, an agentic spatial reasoning framework that combines two components: a world simulator (Astra-WM) that generates novel-view images from context images and natural-language camera motions, and an RL-trained VLM policy (Astra-VL) that decides when to query the simulator. Trained with view consistency tuning and a two-phase RL curriculum, Astra improves spatial reasoning benchmarks by 9–10 points over direct VLM answering, demonstrating that effective world-model-augmented reasoning requires learning when, where, and how to imagine.

5 June 2026