Why human-in-the-loop is the only viable model for AI in regulated clinical trials

Every AI platform targeting regulated industries claims to keep humans in the loop. Most mean that a human can look at what the AI produced before it is committed. That is not the same as requiring documented human approval. 21 CFR Part 11, ICH E6(R3), and the FDA's AI guidance for clinical trials all require that AI outputs be reviewed and approved by a qualified human before influencing clinical records — and that review must be documented, attributed, and immutable.

A genuine human-in-the-loop architecture has four properties: proposals not commitments (nothing commits without explicit approval), confidence-stratified review, revision capability with attribution, and an immutable record of the full exchange. The compliance test is simple: can the AI commit an output to a clinical record without explicit human approval? The answer must be no, unconditionally.