# Why trials fail: underpowered, wrong endpoint, control arm drift, subgroup fishing, crossover

Source: https://onco.cc/terms/trial-failure-modes/  
OnCo record `trial-failure-modes` (Term). Data CC BY-NC 4.0, attribute "Data from OnCo (onco.cc)"; commercial use needs a licence.

## TL;DR

Trials fail for a short list of reasons that recur: too few patients for the real effect, an endpoint that does not track what matters, a control arm that did better than the planners assumed, a benefit that was only ever a subgroup illusion, and control patients receiving the experimental drug anyway.

## Summary

Most negative trials are negative because the drug does not work. But a substantial minority fail for reasons that have nothing to do with the treatment, and reading the failure modes is part of reading the result. Underpowering: the sample size was built on an effect estimated from a small early study, which by selection tends to be inflated (the winner's curse), and the true, smaller effect could not be detected. DREAM3R, sized on encouraging single-arm and phase 2 data, was stopped early without meeting its survival endpoint. Wrong endpoint: the primary endpoint was a surrogate that does not predict benefit in that setting, or was too early. UKCTOCS found ovarian cancers earlier without reducing deaths; TROPION-Breast01 met progression-free survival and missed overall survival, and was approved on the former. Wrong dose, a cousin: RTOG 0617 tested 74 Gy against the standard 60 Gy and patients on the higher dose lived shorter.

Control arm drift: the standard of care improves during a five-year trial, or the control arm is delivered better inside a trial than in the historical data used to plan it, and the assumed gap closes. ACT IV found both its vaccine and control arms outperformed historical expectations, and CONVERT's arms both beat historical controls, which is why single-arm results compared with history should be trusted less than they usually are and why ANNOUNCE and ATLANTIS, confirmatory trials of drugs approved on small early studies, showed no survival benefit. Subgroup fishing: a trial that misses overall reports a positive subgroup, and the more subgroups examined the more certain it is that one will be positive by chance; the preoperative progesterone trial at Tata Memorial found a benefit only in node-positive women and its authors rightly called for confirmation rather than claiming a result. Crossover contamination: control patients receive the experimental drug at progression, so a real survival difference is diluted; VISION, PSMAfore, TheraP and CodeBreaK 200 all show clear progression gains with little or no survival difference after crossover.

There are quieter failure modes too. Non-adherence and dropout pull any comparison towards no difference, which flatters a non-inferiority trial and sinks a superiority one. Protocol choices can decide the verdict: BELINDA's long manufacturing interval and strict week-twelve event definition erased an effect that two similar CAR-T trials found. Informative censoring biases progression-free survival when patients leave for reasons linked to their outcome. And a trial can fail to fail: a result that is statistically significant but clinically trivial, a technically negative trial whose confidence interval nonetheless excludes any meaningful harm, or a positive result in a population that no longer exists because the standard has moved on. The failure museum on this site collects the trials in the corpus that did not work and the lesson each taught.

## Fields

- Kind: Term
- Last checked: 2026-09-17
- Also known as: trial failure; failed trial; failed trials; negative trial; negative trials; why trials fail; why the trial failed; underpowered; underpowered trial; wrong endpoint; wrong comparator; control arm drift; control arm underperformed; control arm outperformed; control arm did better than expected; historical control comparison; regression to the mean; winner's curse; subgroup fishing; cherry-picked subgroup; post-hoc subgroup; crossover contamination; contamination; diluted effect; treatment dilution; non-adherence; poor adherence; dropout; loss to follow-up; lost to follow-up; immature data; did not replicate; failed to replicate; phase 2 signal did not hold; informative censoring; technically negative

## Sources

- Wikipedia: https://en.wikipedia.org/wiki/Publication_bias
- Wikipedia: https://en.wikipedia.org/wiki/Publication_bias
- CONSORT statement: reporting randomised trials: https://www.consort-statement.org/
- ICH E9 and E9(R1): statistical principles for clinical trials and the estimand framework: https://www.ich.org/page/efficacy-guidelines

## Connected records

- terms: [Confirmatory trial](https://onco.cc/terms/confirmatory-trial/), [Control arm and comparator (investigator's choice)](https://onco.cc/terms/control-arm/), [Crossover in trials](https://onco.cc/terms/crossover/), [Enrichment and biomarker-stratified designs](https://onco.cc/terms/biomarker-stratified-design/), [External and synthetic control arms](https://onco.cc/terms/external-control-arm/), [Futility analysis (stopped for futility)](https://onco.cc/terms/futility/), [Intention-to-treat (ITT) and per-protocol analysis](https://onco.cc/terms/intention-to-treat/), [Kaplan-Meier curve, censoring and proportional hazards](https://onco.cc/terms/kaplan-meier-curve/), [Non-inferiority margin and equivalence trials](https://onco.cc/terms/non-inferiority-margin/), [Non-inferiority trial](https://onco.cc/terms/non-inferiority/), [Phase 1, 2 and 3 trials](https://onco.cc/terms/trial-phases/), [Pragmatic trial](https://onco.cc/terms/pragmatic-trial/), [Pre-specified vs post-hoc analysis](https://onco.cc/terms/prespecified-vs-post-hoc/), [Progression-free survival (PFS)](https://onco.cc/terms/pfs/), [Randomised trial](https://onco.cc/terms/randomised-trial/), [Real-world evidence](https://onco.cc/terms/real-world-evidence/), [Seamless, adaptive and Bayesian trial designs](https://onco.cc/terms/seamless-adaptive/), [Single-arm trial](https://onco.cc/terms/single-arm/), [Statistical power, sample size and re-estimation](https://onco.cc/terms/sample-size-re-estimation/), [Statistical significance (P values, alpha, multiplicity)](https://onco.cc/terms/statistical-significance/), [Subgroup analysis (forest plots)](https://onco.cc/terms/subgroup-analysis/), [Surrogate endpoint](https://onco.cc/terms/surrogate-endpoint/), [Surrogate endpoint validation: which stand-ins have earned trust](https://onco.cc/terms/surrogate-validation/), [Trial protocol and statistical analysis plan](https://onco.cc/terms/trial-protocol/), [Trial registration and results reporting (ClinicalTrials.gov, EU CTR)](https://onco.cc/terms/trial-registration/)
- fronts: [Drug Discovery Platforms](https://onco.cc/fronts/drug-discovery/)
- trials: [ACT IV](https://onco.cc/trials/act-iv/), [ANNOUNCE](https://onco.cc/trials/announce/), [ATLANTIS](https://onco.cc/trials/atlantis/), [BELINDA](https://onco.cc/trials/belinda/), [CodeBreaK 200](https://onco.cc/trials/codebreak-200/), [CONVERT](https://onco.cc/trials/convert/), [DREAM3R](https://onco.cc/trials/dream3r/), [RTOG 0617](https://onco.cc/trials/rtog-0617/), [Single-injection depot progesterone before breast surgery (Tata Memorial)](https://onco.cc/trials/progesterone-preop-tmh/), [TheraP (ANZUP 1603)](https://onco.cc/trials/therap/), [TROPION-Breast01](https://onco.cc/trials/tropion-breast01/), [UKCTOCS](https://onco.cc/trials/ukctocs/), [VISION](https://onco.cc/trials/vision/)
- bottlenecks: [Trial design, endpoints and cost](https://onco.cc/bottlenecks/b-trial-design/)

---
JSON: https://onco.cc/api/v1/entities/trial-failure-modes.json