Lightweight decision model catches nearly all malicious agent skills

SkillScreen flags 20–25% of benign skills at 99% recall on unseen attacks, outperforming word-level classifiers and prompted LLMs.

Top University
Jerrold Huang · Junwei Quan · Saiyue Lyu · Zihan Guo · Yingqiang Ge

University of British Columbia · University of Toronto · Rutgers University

Research Digest··3 min read
The authors introduce SkillScreen, a compact decision model that scores the maliciousness of agent skills directly from their instruction files.

" They fine-tuned the 2B-parameter OpenJev-2B model with LoRA on 6,800 labelled skills from eleven sources.

§

Research Digest

Written by Alwyn Sage, research editor. Plate by Ollie Flash, picture desk.

first published 19 Oct, 7:47 am
Meet the newsroomHow we workSubscribe