The Trust Contract · 1 of 5
The Rules Are Being Written
AI rules are moving from policy debate to market structure, shifting advantage toward firms that can prove control, trust, and accountability.
The real decision is not whether new AI rules will arrive; it is whether the organization treats them as a late compliance burden or an early design constraint. The stakes are capital speed, customer trust, liability, and freedom to operate. Rules are now being written in law, procurement, insurance, litigation, platform policy, and industry standards at the same time. That makes the moment awkward but valuable: the requirements are not fully settled, yet the direction is clear enough to shape investment before costs harden.
Compliance Is Becoming Market Design
The bet is that trust will become part of the product, not an after-the-fact control; the risk is funding AI systems that perform well in pilots but cannot be sold, insured, audited, or defended at scale. This matters now because the first wave of AI adoption rewarded speed, while the next wave will reward evidence.
Rules exist because AI shifts decision-making power away from visible human judgment and into systems that can be hard to inspect. A bank’s fraud model can freeze legitimate payments. A hospital’s readmission model can redirect care. A factory’s downtime model can trigger maintenance that stops production. A retailer’s markdown model can change margins across thousands of items. A public agency’s caseload model can alter who waits and who gets help first.
The practical question is not whether regulation is good or bad. It is which operating model will still work when performance claims must be backed by provenance, auditability, human accountability, and evidence of monitoring. The choice to weigh is whether AI investment is being evaluated only for output quality, or also for the proof needed to keep using it.
The Rulebook Has More Than One Author
The bet is that the binding rules will not come from regulators alone; the risk is watching one formal law while missing the private rules that determine market access. In practice, banks, hospitals, manufacturers, retailers, and public agencies will face a layered rulebook written by lawmakers, courts, insurers, customers, auditors, standards bodies, and platform providers.
Formal regulation sets the regulatory perimeter: which uses are restricted, which require stronger evidence, and which are prohibited. But procurement can move faster than law. A large buyer may require a model card before signing a contract. An insurer may price coverage based on incident thresholds. A court may establish liability through a single dispute. A cloud or model provider may change access terms after a safety incident.
The strategic move is to map where permission actually comes from. In some markets, public regulation will dominate. In others, the decisive gate will be a hospital network’s purchasing standard, a financial institution’s third-party risk process, or a government tender requirement. The point to watch is where informal expectations become de facto rules before statute catches up.
Control Is Moving Upstream
The bet is that the cheapest point to manage AI risk is before deployment; the stake is whether control is built into the investment case or paid for later through rework, delay, and reputational damage. Once a model is embedded in lending, staffing, care, pricing, logistics, or claims handling, changing it becomes a business interruption, not a technical adjustment.
Many organizations started with use-case enthusiasm: better fraud detection, faster triage, lower maintenance costs, sharper demand forecasting. The rule-writing phase changes the sequence. The question becomes whether the proposed use has a defensible purpose, acceptable data rights, known failure modes, human escalation, monitoring, and a clear owner when outcomes go wrong.
This is not a call for paralysis. It is a case for earlier sorting. Low-impact productivity tools can move with lighter oversight. Systems that influence rights, money, safety, access to services, employment, care, or public trust need stronger gates. The decision to make is where to set the threshold between experimentation and operational dependence.
Liability Will Follow Dependence
The bet is that accountability will attach to the business decision, not only to the model provider; the risk is assuming that outsourcing technology also outsources responsibility. As AI systems become part of credit decisions, clinical workflows, plant operations, hiring screens, product recommendations, and public services, failures will be judged against foreseeable harm and available controls.
A weak defense is easy to imagine: the model was complex, the vendor supplied it, the data looked reasonable, and the outcome was unexpected. That may not be enough. If a hospital uses a readmission model, the relevant question will be whether patients were monitored fairly and escalation existed. If a factory relies on predictive maintenance, the question will be whether unsafe recommendations were caught before equipment failed. If a retailer’s pricing model creates systematic customer harm, the issue will not end with model accuracy.
The second-order effect is a change in contracting. Indemnities, audit rights, data-use restrictions, incident reporting, and evidence retention will become more valuable than broad performance claims. The point to decide is how much operational responsibility should sit with suppliers, and how much must remain under direct control because the brand, license, or public mandate cannot be delegated.
Evidence Becomes a Unit Cost
The bet is that the economics of AI will be shaped by the cost of proof; the stake is whether business cases include the full expense of staying compliant over time. Model performance may create the first ROI case, but assurance, documentation, monitoring, remediation, and periodic review determine whether the return survives scale.
This changes capital allocation. A cheap model that requires heavy manual review may not be cheap. A high-performing system that lacks provenance may be slower to approve than a slightly less capable system with stronger records. A customer-service agent that answers quickly but cannot be monitored for prohibited claims may carry hidden conduct risk. A public agency tool that reduces backlog but cannot show fairness across groups may lose legitimacy.
Conformity assessment, assurance cases, and model cards sound like governance artifacts, but they are also commercial assets. They reduce friction in sales, procurement, audits, insurance, and incident response. The metric to watch is not only cost per prediction or cost per task, but cost per trusted decision.
- A bank may accept a slower fraud model if it produces clearer adverse-action evidence.
- A hospital may delay a readmission model until escalation duties are unambiguous.
- A factory may favor a vendor that can prove performance across equipment types, not only in a demo.
- A retailer may reject a markdown engine that improves margin but creates opaque customer treatment.
The Real Decisions Are Portfolio Decisions
The bet is that not every AI use deserves the same level of investment; the risk is treating all use cases as either harmless experiments or existential threats. The valuable discipline is portfolio sorting: which systems should scale fast, which should wait, which should be redesigned, and which should be avoided because the control burden overwhelms the return.
A practical portfolio view separates internal productivity from customer-impacting decisions, and separates advisory outputs from automated actions. A drafting tool for internal reports is not the same as a claims-denial system. A maintenance recommendation reviewed by an engineer is not the same as an automated shutdown. A caseload triage tool used to prompt review is not the same as one that determines access to services.
Timing matters. Moving early can shape standards, build trust, and capture learning. Moving too early in high-risk use can lock in expensive architecture or invite scrutiny before controls are mature. Waiting can preserve capital but may concede data advantages and operating learning to faster competitors. The decision is where early movement creates compounding advantage, and where restraint preserves option value.
- Scale when the use is valuable, explainable enough for the context, and monitored against real outcomes.
- Redesign when the business value is strong but data rights, human oversight, or evidence are weak.
- Delay when rules are likely to change the economics and the competitive penalty is modest.
- Exit when the use depends on opacity, disputed data, or harm that cannot be credibly controlled.
Optionality Comes From Reversible Design
The bet is that the winning position is not perfect prediction of future rules, but the ability to adapt without restarting; the stake is preserving strategic freedom as the rulebook tightens. The firms best placed for the next phase will be those that can change models, suppliers, controls, and approval evidence without breaking the operating model.
Reversible design has business consequences. Modular supplier choices reduce dependence on one provider’s policies. Clear data rights prevent future disputes. Documented assumptions make reviews faster when regulation changes. Human escalation paths preserve trust when automation fails. Outcome monitoring turns incidents into learning rather than surprise.
This is where risk management and strategy meet. Excess control can slow adoption and dilute ROI. Too little control can strand investment and damage trust. The point is not to eliminate uncertainty, but to buy options: the ability to scale a strong use case, pause a weak one, switch a supplier, or satisfy a new conformity assessment without major disruption.
Key takeaways
- AI rules are being shaped by law, contracts, insurance, litigation, standards, and platform policy at the same time.
- The main strategic risk is not regulation itself, but stranded AI investment that cannot be audited, defended, or scaled.
- Control is cheapest before deployment; once AI is embedded in operations, governance changes become business interruptions.
- Evidence is becoming a unit cost, making provenance, auditability, monitoring, and assurance part of the ROI case.
- Portfolio discipline matters: scale, redesign, delay, or exit use cases based on value, risk, timing, and reversibility.
- Optionality comes from systems and contracts that can adapt as rules harden without forcing a restart.
Glossary
- Regulatory perimeter
- The boundary that determines which activities fall under a rule and which remain outside it.
- Provenance
- The traceable origin and history of data, content, or model inputs used to support a decision.
- Auditability
- The ability to reconstruct how a system was built, approved, used, monitored, and changed.
- Conformity assessment
- A structured check that a system meets specified legal, technical, or operational requirements before or during use.
- Assurance case
- A documented argument, supported by evidence, that a system is acceptably safe, reliable, and controlled for its intended use.
- Model card
- A concise record describing a model’s purpose, limits, data considerations, performance, and known risks.
- Systemic risk
- A risk that can spread beyond one system or organization because many parties depend on similar tools, data, suppliers, or decisions.