code as action
Have a language model write a concrete program instead of blurting out a result, then let a normal interpreter run it. Arithmetic, layout, motion, and tool calls happen exactly as computed. Vague instructions become precise, editable, reusable code. The model does the high-level reasoning; the code does the low-level action.
The papers find this separation consistently helps. Agents that generate executable scripts beat direct answering, with large accuracy gains in medical calculations and better visual composition. Code is often not written once: agents run, inspect, revise, or choose among reusable tools after each step. Formal verification also becomes possible, and frameworks expose code as a shared interface, so both people and models control behavior through familiar Python instead of task-specific abstractions.
- Papers
- 29
- Released code
- 2
- First seen
- May 2026
- Latest
- Nov 2026
26 papers in the last two months, against 2 in the two before.
Start here
Three papers to read first, in the order they came out- 1Open agent stack improves computer tasks beyond GUI-only control
OpenGCUA with code execution and model-driven decisions improves task scores by 19.6 points on OSWorld-v2.
Oct 2026 - 2Game engine expertise and verification feedback boost AI 3D scene completion from 18% to 48%
Language instructions can drive controllable Unreal Engine worlds through agent-generated code with verification and localized repair, preserving persistent scene and timeline state.
Oct 2026 - 3Video generators can better follow physics with code-built scene drafts
Video-Coder improves video generation by having an AI agent write and execute code to build a 3D scene before rendering the final video.
Nov 2026
How fast it is moving
Often studied with
agent skillsLearned capabilities that enable AI agents to perform specialized tasks with improved effectiveness.7 togetheragentic evaluationMeasuring AI agents' performance in complex tasks, highlighting failures in planning, monitoring, and real7 togetheragent harnessA system that structures, verifies, monitors, or controls how an AI agent interacts with external tools, environments, or execution runs.6 togetherWho is working on it
The papers
Most central to this idea first, not most recent.
- Big Techcs.CV
Video generators can better follow physics with code-built scene drafts
Video-Coder improves video generation by having an AI agent write and execute code to build a 3D scene before rendering the final video.
University of Central Florida, University of Würzburg · Nov 2026
- Big Techcs.MA
Game engine expertise and verification feedback boost AI 3D scene completion from 18% to 48%
Language instructions can drive controllable Unreal Engine worlds through agent-generated code with verification and localized repair, preserving persistent scene and timeline state.
Tongji University, Microsoft Research Asia · Oct 2026
- Chinese Techcs.CV
Open agent stack improves computer tasks beyond GUI-only control
OpenGCUA with code execution and model-driven decisions improves task scores by 19.6 points on OSWorld-v2.
Alibaba Token Hub, Alibaba Group · Oct 2026
- Industrycs.AI
Programmatic code specifies agent behavior, improving robustness and efficiency
ABCAgent specifies FM agent behavior as editable Python code for robust and efficient task execution.
Uniphore · Oct 2026
- Top Universitycs.RO
Robot agents improve by building and reusing executable motion tools
URAI improves robot manipulation by letting agents create reusable motion tools, execute them locally, and make model-level decisions between tool calls.
Hexafuture Inc., Peking University · Oct 2026
- Big Techcs.AI
Python objects become AI agents in new NVIDIA framework
NVIDIA Object-Oriented Agents (NOOA) defines agents as Python objects with methods as actions and docstrings as prompts.
NVIDIA · July 2026
- Independentcs.CV
Code-driven agents generate images via sketching and texturing stages
GenClaw stages image generation into conceptualize, sketch (via code), and color, enabling direct canvas manipulation and interpretability.
May 2026
- Chinese Techcs.CV
Code simulations teach video generators realistic physics with little data
Executable code as privileged context in on-policy self-distillation dramatically improves physical plausibility in video generation.
HKUST, Alibaba Group · Nov 2026
- Industrycs.RO
Benchmark reveals when robotic agents truly learn and when they just retry
Self-improving robot agents do not necessarily learn from experience; apparent gains can come from retries or luck, and learned skills do not always transfer.
Luma AI · Oct 2026
- Top Universitycs.RO
Coding agents synthesize robot planners that generalize to unseen instances
Coding agents outperform hand-engineered planners on generalized task and motion planning problems by synthesizing reusable programs.
Fondazione Bruno Kessler, Carnegie Mellon University · Sept 2026
- Chinese Techcs.CVcode
Stateful code revision improves programmable image and video generation
MaLiang-Harness bridges the program-to-visual gap by enabling MLLMs to iteratively construct, inspect, and revise executable visual programs for image and video generation.
National University of Singapore, Fudan University · Sept 2026
- Chinese Techcs.AI
Training LLMs to write code boosts medical calculation accuracy by 20-30 points
Generating executable code for deterministic calculation improves medical-calculation accuracy in 7B and 8B language models by 20 to 30 percentage points.
Carnegie Mellon University, Tencent YouTu Lab · Sept 2026
- Big Techcs.RO
Coding agents teach humanoid robots new whole-body skills without retraining
A single frozen Metatron checkpoint supports walking, recovery, object pickup, and sitting on a real humanoid through code-defined prompts.
NVIDIA, Dollhouse Robotics · Oct 2026
- Chinese Techcs.CV
Sparse aerial photos become persistent, agent-editable 3D city models
Sparse aerial observations can be converted into persistent, agent-operable 3D cities with metric geometry, road connectivity, and editable entity identities.
Nanjing University, Shanghai Artificial Intelligence Laboratory · Oct 2026
- Big Techcs.AI
Terminal-only control improves digital agents across web, desktop and CAD
A terminal-only harness using bash commands outperforms GUI harnesses across web, desktop, and CAD tasks.
Microsoft Research, National University of Singapore · Oct 2026
- Chinese Techcs.CVcode
Multi-agent framework generates spatial QA data via code execution
Exemplar2VQA uses multi-agent coding to synthesize large-scale spatial QA data, improving MLLM performance.
East China Normal University, Shanghai Jiao Tong University · Sept 2026
- Independentcs.AI
Reusable code skills help language agents act and learn efficiently
Code-based skills nearly triple game progression and reduce inference cost by 86% in NetHack language agents.
Sept 2026
- Research Labcs.AI
LLMs generate generalized plans with machine-checked completeness proofs
LLMs can generate generalized plans and formal proofs that the plans solve all domain instances.
Saarland University, German Research Center for Artificial Intelligence (DFKI) · Sept 2026
- Chinese Techcs.CV
Executable code gives generative worlds persistent rules and evolving state
CoDeR combines explicit code-based world rules with diffusion video generation to enable open-ended world simulation.
USTC, TongYi Lab · Sept 2026
- Top Universitycs.AI
Structured software interfaces outperform screenshot-and-click control for AI agents
ASIL replaces screenshot-and-click with structured JSON observations and semantic actions, achieving over 80% success on 380 tasks with fewer than five actions each.
X-LANCE Lab, Shanghai Jiao Tong University · Aug 2026
- Top Universitycs.RO
Robot agents using open models can beat a published proprietary baseline
An open-weight agent, using a unified harness without privileged inputs, surpasses a proprietary model on a robot manipulation benchmark.
Tsinghua University, UC Berkeley · Nov 2026
- Big Techcs.HC
AI agents can repeat tasks consistently when successful runs become code
FlashScript compiles successful agent runs into neuro-symbolic programs with identical tool calls, lower token cost, and reuse on unseen instances.
University of Southern California, Microsoft · Oct 2026
- Big Techcs.AI
LLM-generated semantic diversity boosts zero-shot cooperation in multi-agent systems
PopGen uses LLMs to generate semantically diverse agents, improving zero-shot cooperation with unseen partners.
EPFL, UC Berkeley · Oct 2026
- Chinese Techcs.CL
Agent control over candidate processing improves search agent performance
Programmatic Search Agents improve search by letting agents control how retrieved candidates are processed and presented.
Zhejiang University, Yuanbao Team, Tencent · Oct 2026
- Big Techcs.CL
Jointly evolving algorithmic plans and code yields fast hybrid optimizers
HeurEvo jointly evolves algorithmic plans, code, and reusable components to design hybrid solver-augmented heuristics that perform well under tight runtime budgets.
Purdue University, Microsoft Research · Oct 2026
- Chinese Techcs.AI
Survival sandbox benchmark evaluates autonomous agents on sustained goal execution
ASIWorld is a survival sandbox benchmark that evaluates agents by task outcomes, execution behavior, and survival costs.
Lightspeed Studios, Tencent, The Hong Kong University of Science and Technology · Oct 2026
- Big Techcs.RO
Simulation-first framework lets coding agents learn real robot skills in 10 minutes
SimEX lets coding agents learn real robot skills by first practicing in simulation and then adapting with only 10 minutes of physical trials.
Amazon FAR, University of Texas at Austin · Oct 2026
- Chinese Techcs.CV
Benchmark shows AI agents struggle with fine-grained 3D spatial coherence in Blender
Current visual agents profoundly struggle with fine-grained 3D spatial coherence and accurate structural reproduction in Blender.
Zhejiang University, Alibaba Group · Oct 2026
- Independentcs.SE
Enterprise agents struggle when facts are hidden across business systems
Enterprise agents struggle on benchmark questions whose answers depend on facts implied across data sources, not explicitly stated.
Sept 2026
Concepts are extracted from each paper and reused across the corpus, so this page grows on its own as the desk reads.