Back to blog
Governance
14 min read

Agentic Drift: The Silent Risk of AI Systems in Production

Behavioral drift in AI agents is not a bug. It is an emergent property of stochastic systems in open environments. Understanding the phenomenon is the prerequisite for controlling it.

SP

Steve P.

Research, Hikari Blue · March 11, 2026

In December 2025, researchers at Google DeepMind documented a phenomenon practitioners had already observed in the field: AI agents deployed in production drift. Not suddenly. Not in ways detectable by standard metrics. Slowly, imperceptibly, until a breaking point.

The term "agentic drift" describes this gradual divergence of an AI agent's behavior from its expected behavior at deployment time.

Why agents drift

The phenomenon has three documented causes in the literature.

1. Distribution shift

Production data gradually diverges from training data. Quinonero-Candela et al. (2009, "Dataset Shift in Machine Learning", MIT Press) formalized this problem over fifteen years ago. With LLMs, the phenomenon is amplified: the input space is natural language itself, and language evolves.

2. Feedback loops

When an agent acts on its environment and that environment then feeds its future inputs, feedback loops emerge. Sculley et al. (2015, "Hidden Technical Debt in Machine Learning Systems", NIPS) identified this mechanism as one of the primary sources of invisible technical debt in ML systems.

3. Indirect prompt injection

With RAG architectures, agents ingest external content that can subtly modify their behavior. Greshake et al. (2023, "Not What You've Signed Up For", arXiv:2302.12173) demonstrated that this attack surface is largely underestimated.

Measuring drift

The fundamental problem is that drift is invisible to classic technical metrics. Latency remains stable. Error rates don't budge. Throughput is constant. But decisions change.

Two complementary approaches enable drift detection:

Longitudinal behavioral analysis. Compare decision distributions over sliding time windows. If a classification agent approved 72% of requests in January and approves 89% in March, the distribution has changed, even if each individual decision seems correct.

Semantic audit trail. Beyond technical logging, capture the decisional context: what information the agent consulted, what reasoning it followed, what confidence it has in its response. This is what the EU AI Act calls "logs sufficiently detailed to enable traceability" (Regulation 2024/1689, Article 12).

The cost of inaction

McKinsey (2024, "The State of AI") reports that 65% of companies using generative AI in production lack a formal drift detection mechanism. Among those that do, 78% rely solely on technical metrics that fail to capture semantic drift.

The cost is not hypothetical. In 2024, Air Canada was found liable after an AI chatbot invented a non-existent refund policy. The court ruled that the company was responsible for its agent's statements, whether or not they conformed to official policy.

Drift is inevitable. Loss of control is not.

References

  • Quinonero-Candela, J. et al. (2009). Dataset Shift in Machine Learning. MIT Press.
  • Sculley, D. et al. (2015). Hidden Technical Debt in Machine Learning Systems. NIPS 2015.
  • Greshake, K. et al. (2023). arXiv:2302.12173.
  • EU AI Act, Regulation (EU) 2024/1689, Article 12.
  • McKinsey & Company (2024). The State of AI in Early 2024.
  • Ready to structure your AI governance?

    Talk to our team