Study of 1.53 million agent skills finds about one in seventeen tells agents to skip approval or checks

arXiv · Research preprint

Read the source (opens in a new tab)
What happened
Timofey Sanko and Yuan Tian of Queen's University in Canada posted a preprint on October 27, 2026 analyzing 1.53 million English agent skills, the SKILL.md instruction files agents load on demand.
Key points
  • About 88,000 skills contain a directive that loosens oversight, such as proceeding without approval or bypassing checks with --no-verify; 70.1% of these directives apply unconditionally.
  • Skills that run shell code, install packages or use sudo have 1.7 to 1.8 times the odds of carrying such a directive, and do not add more safeguards to compensate.
  • A few upstream skills spread most of them: 2.4% of the skill families carrying loosening account for half of all copies of such skills.
  • Open-source skill scanners catch at most 46% of these directives, with precision below 0.4; the same LLM prompted with the authors' codebook catches 61%.
Evidence
Research preprint, not peer reviewed. The counts come from a detector the authors trained on 2,097 hand-labeled units and ran over skills from public GitHub repositories.

See it in the latest record