QuestionFinancial ServicesAI GovernanceConsumer Duty

How should firms monitor AI-assisted customer journeys under Consumer Duty?

9 April 2026
Answered by Rohit Parmar-Mistry

Short answer

Choose the customer-journey signals, thresholds, review cadence and escalation owner for the actual product and risk. Test a threshold breach and record the response. Have the responsible reviewer establish the applicable monitoring duties separately.

Detailed answer

Plan the Review of AI-Assisted Customer Journeys

Choose the customer-journey signals, thresholds, review cadence and escalation owner for the actual product and risk. Test a threshold breach and record the response. Have the responsible reviewer establish the applicable monitoring duties separately.

Review the whole customer journey as well as the AI component. A pre-launch test will not show what happens after volumes, prompts, channels or customer needs change; retain samples that help the owner investigate those changes.

What firms should do in practice

Firms should monitor AI-assisted journeys using a combination of outcome metrics, journey diagnostics and governance triggers. The aim is to detect signs of consumer harm early, investigate them quickly and make changes before poor outcomes become systemic.

  • Track outcome quality: complaint rates, drop-off rates, abandonments, conversion anomalies, unsuitable product take-up, repeat contacts and remediation volumes.
  • Track friction and confusion: unusual dwell times, looping journeys, repeat question patterns, escalation spikes and failed handoffs to human support.
  • Track vulnerability indicators: signals that customers may need additional support, clearer wording, channel changes or human intervention.
  • Track segmentation effects: whether certain customer cohorts experience worse outcomes, slower resolution or more friction than others.
  • Track content and decision drift: changes in AI outputs, prompts, retrieval sources or business rules that may alter customer treatment.
  • Track incidents and near misses: not just confirmed harm, but recurring weak signals that suggest controls are degrading.

Book an AI Risk & Efficiency Audit

The controls that matter most

Define the indicators that warrant investigation, who reviews them and what happens next. A dashboard is useful only if someone can act on a failed handoff, a confused customer or a repeated error.

In practice, the most useful controls are:

  • Outcome-led KPIs: measures tied to customer understanding, suitability, timeliness and support, rather than only technical accuracy.
  • Journey-level testing: regular sampling of end-to-end experiences across channels, products and customer types.
  • Human escalation design: a clear route to human review when the AI journey shows uncertainty, repeated friction or vulnerability signals.
  • Change governance: approval and testing standards for prompt changes, workflow changes, model swaps and content updates.
  • Root-cause review: a process for linking complaints, QA findings, MI and operational incidents back to the AI component and the wider journey.

Connect a monitoring finding to a recorded action. If a script causes confusion or a triage step delays support, investigate the cause, record the change and check a fresh sample after the fix.

How to monitor for consumer harm early

Early detection depends on combining lagging and leading indicators. Complaint data matters, but by the time complaints rise, the issue may already be embedded. Firms should also watch for earlier warning signs such as abnormal journey exits, repeated clarifications, sentiment shifts, higher transfer rates, failed completions and unusual behaviour for vulnerable segments.

Choose monitoring methods to suit the journey’s customer impact and the evidence available. The following are options for the owner to assess, not a prescribed FCA monitoring schedule:

  • risk-based journey reviews, with weekly or monthly checks considered where the volume and potential harm justify them
  • sample-based QA of transcripts, decisions or recommendations
  • cohort analysis by segment, product and channel
  • board-ready MI on outcome trends and exceptions
  • incident triggers for rapid investigation where harm risk rises

The point is not to create excessive monitoring overhead. It is to focus attention on the journeys where AI can materially shape customer outcomes and where small failures can scale quickly.

Governance expectations for regulated firms

For a regulated firm, assign ownership of customer-impacting AI use and connect monitoring to escalation and remediation. This is an operating-control proposal, not confirmation that a particular arrangement satisfies Consumer Duty.

For each high-impact journey, name an owner, set review triggers and retain the intervention record. Ask suppliers what evidence they can share about quality, changes and incidents, and identify what the firm still needs to test itself.

Explore Managed AI Governance & Support

A simple operating model firms can adopt

A workable approach is to classify AI-assisted journeys by customer impact, then apply proportionate monitoring. High-impact journeys, such as product recommendation, claims support, complaints handling or vulnerability-related interactions, should get tighter thresholds and more frequent review. Lower-risk internal support journeys can sit under lighter oversight.

Each monitored journey should have:

  • a named business owner
  • a defined set of outcome and friction metrics
  • vulnerability and fairness checks where relevant
  • an escalation path to operations, risk and compliance
  • a documented remediation playbook

This connects the AI review to the customer journey. Keep a record of the owner’s reasoning and the checks performed; the existence of a monitoring template is not evidence of a good outcome.

Conclusion

Use outcomes, friction, vulnerability signals and changes in outputs to decide where to investigate. Record the escalation, fix and follow-up check. Confirm the applicable regulatory expectations separately from this suggested operating model.

See Implementation Projects

Need a controlled AI route for a regulated team?

If this issue affects a live financial, insurance or advisory workflow, we can help you separate useful AI opportunities from conduct, data, supplier and governance risks.

Frequently asked questions

Does Consumer Duty require firms to monitor AI after launch?

Where AI affects a customer journey, ongoing checks can reveal problems that launch testing missed. Confirm the applicable Consumer Duty requirements and use those alongside the journey’s risk assessment to set the monitoring plan.

What metrics are most useful for spotting consumer harm early?

Complaint trends matter, but earlier signals often include drop-off rates, repeat contacts, escalation spikes, confusion patterns, failed handoffs and worse outcomes for certain customer cohorts.

Should firms rely on vendor assurance for AI monitoring?

Use vendor assurance as one input. Decide what the firm must check itself, who can escalate a concern and how it will record and review a fix.

Which AI-assisted journeys need the strongest oversight?

Journeys with the greatest customer impact, such as recommendations, service triage, complaints handling and vulnerability-related interactions, usually need the tightest controls.

Discuss your next step

Talk through your situation with Rohit, or take the assessment if you need a first read.