Agent self-modifies at runtime
ID |
agent-self-modifies-at-runtime |
Severity |
high |
Remediation Complexity |
medium |
Remediation Risk |
low |
Remediation Effort |
medium |
OWASP LLM |
LLM06:2025 — Excessive Agency |
OWASP ASI |
ASI10:2026 (secondary ASI06:2026) |
OWASP AST |
AST01:2026 |
Family |
LLM06 — Excessive Agency |
Red-team vectors |
Sandbox Escape / RCE, Prompt Injection |
Tags |
ai_security |
Description
Agent or skill code rewrites its own source, manifest, system prompt, or tool registry at runtime. Self-modification lets an agent escape its declared, reviewed configuration — and is especially dangerous when the written content derives from model output (a prompt-injection path into the agent’s own instructions). This is the SkillSpector rogue-agent self-modification class (RA2).
Phase-1 ships the AST fallback (a write to a self / manifest / system-prompt path) at reduced confidence; the Phase-1.5 TaintFlowDetector upgrades it to flow-confirmed (LLM output → self-config write). Writes to ordinary data / output paths produce no finding. Scoped to agent/skill artefacts.