QuestionAI GovernanceImplementationProfessional Services

How should AI decision logic be version-controlled?

16 September 2026
Answered by Rohit Parmar-Mistry

Short answer

Version the model, prompts, rules and data dependencies separately, with an owner and release record for each change that could alter a decision.

Detailed answer

Why AI decision logic needs version control

Version the model, prompts, rules and data dependencies separately, with an owner and release record for each change that could alter a decision.

An unrecorded change makes it harder to check an output or investigate a problem. A partner, compliance lead or client reviewer needs to know whether the output came from the approved workflow or from an experiment edited last week.

The practical answer is a controlled change record

Keep prompts, policies, routing rules, evaluation criteria, approval thresholds, model choices and retrieval sources in a controlled record. Changes to any of these can affect a decision; notes in an individual's account are not a shared change history.

For each version, record the change, reason, approver, affected workflows, test evidence and activation date. Retain older versions for investigation and rollback, particularly where AI supports regulated advice, compliance review, client communications, file triage or quality assurance.

Check whether your AI workflow has enough evidence

What needs to be version-controlled

A model name alone is not enough. The register should also include system instructions, reusable prompts, user templates, data sources, retrieval rules, scoring or classification logic, escalation thresholds, access permissions, redaction steps and required human review points.

Where the AI tool is embedded in a case management, CRM, finance, claims or document workflow, version the surrounding process as well. Record what the model was asked to do, the data it could access, the actions it could recommend and who had to check the result before it reached a client or external system.

How to structure the control process

Start with a named owner for each AI-assisted workflow. Then create a lightweight change request for any material edit to prompts, rules, source data, vendor settings, output format or review criteria. In the request, explain the reason for the change, expected benefit, risks and test cases used before release.

For low-risk internal summarisation, a short documented review may be enough. For client-facing, regulated or confidential work, require stronger evidence: test outputs, exception examples, reviewer sign-off, data protection checks and a clear rollback plan.

Set up an AI governance operating rhythm

What auditors and clients will expect to see

Link each output to the workflow version active when it was produced. Retain the workflow and prompt versions, source data reference, model or tool configuration, reviewer identity, timestamp, decision outcome and any exception notes.

Have the responsible reviewers identify the applicable requirements for the legal, audit, financial or insurance activity. Test whether the version record links the exact decision logic to its approval and use; tracing that history does not by itself establish compliant supervision or a defensible outcome.

Common mistakes to avoid

Common gaps include unrecorded edits to shared prompts or automation rules, a policy that does not describe the live workflow, and versioned code with no history of the operational settings that shape its output.

Test beyond the examples that make a new prompt look better. It may still increase confidentiality risk, produce invented answers or encourage overconfident wording. Before release, test against edge cases, sensitive data scenarios, unclear instructions and examples where a human reviewer should reject or escalate the answer.

A simple implementation pattern

Use a central workflow register, even if the first version is a spreadsheet or project tracker. Give each AI workflow a unique ID, owner, risk tier, approved use case, data classification, current version and review cadence. Store prompts and rules in a controlled repository or configuration store, with change history and reviewer notes.

For higher-risk workflows, add automated logging around each run. Capture the input category, version ID, output reference, reviewer decision and final action. Avoid storing unnecessary client data in the log itself. Keep the log limited to what reviewers need for investigation.

Build controlled AI workflows with audit trails

Conclusion

Before an AI workflow enters routine client or operational use, record its live version, change reason, approver, supporting evidence and investigation or rollback route.

These records give partners, compliance teams and reviewers a change history to inspect rather than relying on memory or screenshots.

Frequently asked questions

Do prompts really need version control?

Yes, if they influence client work, regulated decisions, compliance checks or operational actions. A prompt change can alter the output, so material edits need a record.

Is a spreadsheet enough for version control?

It can be enough for an early, low-risk register if ownership, approval, dates and evidence are clear. Higher-risk workflows usually need stronger controls, change history and run-level logging.

Should every AI experiment go through approval?

No. Internal experiments can stay lightweight if they do not use sensitive data or affect live work. Approval becomes important when the workflow touches client data, advice, regulated processes or external outputs.

What is the most important evidence to keep?

Keep the active version ID, change reason, approver, test evidence, data source reference, reviewer decision and final action. Those records help a later reviewer trace the decision.

Discuss your next step

Talk through your situation with Rohit, or take the assessment if you need a first read.