Why AI Agents Are Not Digital Employees: Control Mechanisms and Organizational Risks Explained

Alexey Lapunov from TECHNONIKOL Digital's information security department explains why AI agents require extensive surrounding governance structures to function as reliable digital workers. Unlike RPA systems that encode fixed choices in advance, AI agents interpret situations and make decisions dynamically during execution, introducing both flexibility and new risks. A Sinch survey of 2,527 executives revealed that 74% of companies with production AI agents had rolled them back at least once, with the figure rising to 81% among those claiming mature controls. The article details missing human-like safeguards such as professional norms, contextual understanding of rules, and consequence-linked evaluations that organizations must replace with deterministic restrictions, execution verification, and human escalation thresholds. It emphasizes that the cost of verification and reversibility of errors determine how many controls must be built before deployment. Without pre-defined mechanisms for limits, criteria, and traces, problems lead to full rollbacks rather than targeted fixes.

HabrTranslated from Russian

Read at source

Alexey Lapunov from the information security and systems administration department at TECHNONIKOL Digital examines why AI agents cannot be treated as digital employees without substantial additional governance structures.

While RPA automated repetitive tasks by hard-coding choices that remained fixed across runs, AI agents interpret context and select actions in real time. This capability enables handling of previously human-only work but also exposes any undefined organizational boundaries as potential action paths.

Organizations normally rely on several built-in human elements: pre-hire qualification checks, professional norms absorbed through training and culture, contextual understanding of both written and unwritten rules, and the direct link between performance evaluation and personal consequences such as rewards or authority. These elements arrive with the employee and do not require separate construction.

AI agents lack these defaults. Limits based on knowledge or interface access that suffice for humans fail for agents given broader toolsets. Evaluation-to-consequence feedback loops that shape human behavior before actions occur must be replaced by external mechanisms for agents.

The required controls fall into three categories: deterministic restrictions that technically prevent unauthorized actions, execution verification covering both results and methods used to achieve them, and human decision gates triggered when risk exceeds an acceptable threshold.

The volume of controls needed depends on verification cost and error reversibility. In software development, existing tests, compilation, and commit rollbacks already provide cheap verification, allowing greater agent autonomy. In legal documents or high-stakes decisions, expensive verification and irreversible outcomes demand more pre-action restrictions.

A Sinch survey of 2,527 executives found 74% of organizations running production AI agents had performed at least one rollback, rising to 81% among those with supposedly mature monitoring. Lapunov argues mature monitoring simply detects issues earlier; without pre-built, adjustable mechanisms for limits, criteria, and traces, organizations default to full rollbacks instead of targeted corrections.

To become a true digital employee, an agent must be embedded in a task-specific construction of restrictions, verification processes, and escalation rules. These organizational elements cannot be purchased with any platform or model and must be defined before the first pilot using questions about autonomous decisions, technical impossibilities, acceptance criteria, required execution traces, and human intervention thresholds.

Meridian digestThe week's most consequential security stories, distilled into one briefing.See the digest

More in AI Security

Logical Argument Claims Full Alignment of Superintelligent AGI Is Fundamentally Impossible
Claude Account Bans Linked to IP Reputation, Device Environment and Payment Channels, But No Confirmed Formula
Local LLMs in AppSec: What Open Tools and Models Can Handle in Application Security