Small language models (SLMs) on resource-constrained edge devices like satellites often ignore prompt-based instructions to plan before acting. The authors introduce PTC-Decoder, a plug-and-play framework that forces the model to invoke a plan as the first output step and uses a deterministic automaton to constrain tool names during decoding, while leaving parameter generation free. Tested on 200 real remote-sensing satellite tasks across 7 SLMs, the method achieved a statistically significant mean performance gain of +1.21 (p < 0.01). This offers a lightweight, training-free way to improve step-level reliability in offline agent systems.
Hard decoding constraints improve small models’ tool use at the edge
The framework forces an initial planning call and restricts tool-name generation without retraining the underlying model.
Top University
Shanghai Jiao Tong University · Shanghai Landfun Information Technology
Research Digest··2 min read
In one line
Forcing SLMs to output plan and tool names through decoding constraints improves multi-step agent task reliability on edge devices.
Read it as
Yu, Mu and Wu introduce PTC-Decoder, an inference-time framework for small language model agents operating offline under tight memory constraints.
The authors tested seven small language models, ranging from 0.6 billion to 2 billion parameters, on 200 real remote-sensing satellite tasks.
How it works
before and afterThe Daily Edition
The front page in your inbox each weekday morning: the lead, the picks, and why each one earned its place.