Agentic AI governance frameworks are already obsolete

Q: Why are current AI governance frameworks inadequate for agentic AI systems?

Governance frameworks built around values like fairness and transparency were designed for predictive models — systems that are testable, bounded, and stable. Agentic AI systems autonomously select which tools to call and in what sequence, creating risk surfaces that standard assessment processes were never designed to handle. When a third-party orchestrating agent is involved, an organization loses visibility into how that agent was built and governed.

Q: What is the Ethical Nightmare Challenge and how do organizations use it?

The Ethical Nightmare Challenge is a governance method that organizes risk management around avoiding concrete bad outcomes rather than pursuing abstract principles. Cross-functional teams composed of data scientists, compliance officers, and risk leads follow a shared process to identify their organization's specific nightmares, score and prioritize them, and build resources to address them before deployment. The method applies consistently across project teams, departments, and executive leadership.

Q: How should banks and regulated enterprises approach multi-agent AI risk?

Regulated enterprises should treat third-party agent connections as a distinct risk category requiring context-specific assessment. Standard control lists are structurally incomplete for agentic systems because agents are context-sensitive, vary in their tool configurations, and can delegate to external systems that an organization did not build, test, or govern.

Agentic AI governance frameworks designed for predictive models cannot track the risk surface created by autonomous systems that select their own tools, call third-party agents, and act without human checkpoints. Regulated enterprises need a governance model that avoids concrete bad outcomes.

Reid Blackman

Founder & CEO, Virtue | AI Author and Advisor

Virtue Consultants

What you'll take away from this session

Agentic AI breaks existing governance assumptions

Standard governance controls assume testable, bounded systems. Agentic AI decides for itself which tools to call and in what order, making monitoring, intervention, and human-in-the-loop assumptions structurally unreliable.

Third-party agents can be an unassessed risk

Connecting your system to an external orchestrating agent means losing visibility into how that agent was built, tested, and governed. Most organizations are not treating this as the risk decision it is.

Anchor governance in “Ethical Nightmares”

Organizations must define their “Ethical Nightmares,” concrete failures they want to avoid, instead of anchoring AI governance around abstract principles like fairness or transparency. Clearly identifying these bad outcomes gives development teams guardrails to build against and provides regulators with a transparent framework to evaluate.

Three questions align every organization level

Any level of an organization — project team, department, or board — can answer the same three questions and get complementary, actionable results: What are our AI ethical nightmares? What resources will we build to avoid them? How will we train people to use those resources?

Proactive risk teams replace reactive review gates

Ethical Nightmare Challenge (ENC) teams are cross-functional groups trained on a shared method to surface risks early. They work at the site of complexity, building resources to avoid nightmares before deployment.

Reid Blackman shares how current AI governance practices are failing because values-based frameworks were designed for stability and cannot keep pace with agentic AI. As autonomous systems decide for themselves which tools to call and in what order, the risk surface expands faster than any policy document can track. For banks and other regulated enterprises navigating agentic AI governance, that gap between policy and deployment is where regulatory exposure lives.

The session introduces the Ethical Nightmare Challenge, where organizations build cross-functional teams trained on a shared method to identify and address the specific bad outcomes they need to avoid. Multi-agent architectures, particularly those involving third-party agents, are a governance problem that most organizations have not scoped correctly. The ENC model shifts model risk management from a review gate to an embedded problem-solving capability applicable at every level, from the project team to the board.

FAQ

Why are current AI governance frameworks inadequate for agentic AI systems?

What is the Ethical Nightmare Challenge and how do organizations use it?

How should banks and regulated enterprises approach multi-agent AI risk?

Transform the work that matters most

See how Domino helps the world’s most regulated enterprises build, scale, and govern AI-powered applications.

Watch demo Talk to an expert