OnCo
bottlenecksBottleneck

Weak real-world evidence and registries

We do not reliably know what happens to patients after approval, so we cannot tell which drugs deliver in practice.

Regulatory approval, increasingly on surrogate endpoints and single-arm trials, is meant to be followed by confirmation in practice, but the systems to do that are weak. Of cancer drugs given accelerated approval in the US over a quarter-century, only a minority later showed an overall survival benefit in a confirmatory trial, and many confirmatory studies used the same surrogate as the original approval. Post-marketing commitments are often delayed or unmet. Population cancer registries record incidence, stage and death but rarely treatment or recurrence, and treatment datasets such as the NHS SACT are the exception rather than the rule. Real-world effectiveness in older, sicker, more diverse patients is frequently lower than trial efficacy, and without linked outcome data neither payers nor clinicians can tell which drugs deliver. Regulatory frameworks for real-world evidence, national treatment registries and clinico-genomic databases are the building blocks; completeness and outcome capture remain the gap.

majordata knowledge68 ideas to fix it
How big the problem is
19 of 93 (20%)
Cancer drug indications granted FDA accelerated approval 1992-2017 that later demonstrated an overall survival benefit in a confirmatory trial
About half
Cancer drug indications approved by the EMA 2009-2013 still lacking evidence of survival or quality-of-life benefit after a median 5.4 years
Root causes
  • Population registries were designed for incidence and mortality surveillance, not treatment and outcomes.
  • Sponsors have little incentive to complete confirmatory trials quickly once a drug is on the market.
  • Real-world data lack structured capture of progression, response and toxicity.
  • Confounding by indication makes non-randomised comparisons unreliable without careful design.
  • Regulators have historically been reluctant to withdraw approvals on the basis of missing or negative confirmatory data.
What is already being tried
  • The FDA Real-World Evidence Framework (2018, under the 21st Century Cures Act) and Oncology Center of Excellence Project Confirm track and publish the status of accelerated approvals and confirmatory trials.
  • The Flatiron Health-Foundation Medicine clinico-genomic database links sequencing to longitudinal outcomes for tens of thousands of patients and has supported FDA decisions.
  • The EMA's DARWIN EU network runs real-world studies across European data sources for regulatory questions.
  • The NHS Systemic Anti-Cancer Therapy (SACT) dataset records every systemic therapy episode in England with outcomes, and the Cancer Drugs Fund uses it for managed-access re-evaluation.
  • SEER-Medicare linkage and the NCI SEER programme provide population-level treatment and survival for US patients over 65.
  • ASCO's TAPUR and registry trials generate prospective evidence for off-label targeted therapy.
What breaking it looks like
Every approved cancer drug has post-approval effectiveness and safety data published within three years from national treatment registries, accelerated approvals are confirmed or withdrawn on schedule, and real-world survival is tracked and reported alongside trial results in guidelines.

Ideas to fix it

68top
early clinicaldatalarge cost
A global federated real-world evidence network at regulatory grade

Connect hospital records across countries so that questions about how treatments work in real patients can be answered in weeks without moving the data, to a standard regulators accept.

early clinicalpolicylarge cost
A national cancer data space with one legal front door

Instead of asking twenty hospitals for permission, a researcher would apply once to a single national body that can grant access to all cancer records under one set of rules.

early clinicaldatamedium cost
A national late-effects registry linking treatment exposures to outcomes decades later

We know surprisingly little about what happens to cancer survivors twenty years on. Linking their treatment records to later health records would show which treatments cause which problems and who needs watching.

early clinicaldatalarge cost
A national residual-disease weather service: serial blood tests for every curatively treated patient, pooled

After surgery or curative treatment, everyone gets regular blood tests for leftover cancer DNA, and the pooled results power forecasts of who will relapse and trials of acting early.

early clinicalregulatorsmall cost
A pre-registered standard for emulating trials with real-world data

When researchers use hospital records to ask 'would drug A have beaten drug B in a trial', they should follow a published recipe and register their plan first, so the answer can be trusted.

early clinicalregulatorsmall cost
A public rulebook for when an external or synthetic control arm is acceptable

Sometimes a trial cannot randomise, so the new drug is compared with past patients' records. Clear published rules on when that is allowed, and how it must be done, would replace case-by-case guesswork.

speculativedatasmall cost
A public tracker of how long each country takes to adopt new evidence

Measure and publish, for every practice-changing result, how long it takes before most eligible patients in each country and hospital actually receive it.

speculativeresearchmedium cost
A real-world sequencing analysis within a year of every new approval

Trials tell us a drug works but not where it fits among the others. Commit to answering 'which order' from hospital data within a year of each approval.

early clinicaldatamedium cost
A registry of every treatment sequence patients actually receive, with outcomes

Record, for every patient, the order of treatments and what happened, so that the most common sequences can be compared and the worst ones flagged.

early clinicalpayermedium cost
A structured registry for every off-label cancer drug use

Doctors often use cancer drugs outside their approved use based on a hunch or a small study. Record what happens every time so the hunches become evidence.

speculativedatamedium cost
A ten-year cohort of incidental findings to calibrate follow-up guidelines

Scans find unexpected lumps in the adrenal, thyroid, pancreas and lung. Nobody knows how many matter. A national cohort following them for ten years would tell us whom to watch.

early clinicalclinicsmall cost
A tumour board assistant that cites its evidence and tracks outcomes

Give every tumour board a tool that pulls up the relevant trials and guideline lines for each case with citations, records what was decided, and later shows how the patient did.

early clinicaldatamedium cost
A video-based surgical quality registry linking assessed skill to cancer outcomes

Surgeons' skill affects whether cancer comes back, but nobody measures it. Recording operations and rating them, increasingly with AI, then linking ratings to outcomes, would make surgical quality visible and improvable.

early clinicalregulatorlarge cost
After approval, a pragmatic trial in the patients the pivotal trial excluded

Drugs are approved on trials of fit, younger patients and then given to everyone. A required follow-on trial in older, sicker and more diverse patients would show whether the benefit holds in real life.

preclinical evidencedatamedium cost
An automated pipeline emulating trials of every common drug against every cancer

Millions of people take common drugs and some get cancer. Running standardised analyses across whole-country records could rank which old drugs deserve a real trial.

early clinicalresearchmedium cost
An international consortium pooling the outcome of every treated child with cancer

Childhood cancers are rare, so no one country sees enough cases. Pool the treatment and outcome of every child treated anywhere into one governed dataset.

early clinicalresearchmedium cost
An open library pairing completed cancer trials with real-world emulations

Build a public collection where every major cancer trial has a matching analysis done on hospital data, so we learn exactly when real-world evidence can be trusted and when it cannot.

speculativedatamedium cost
An organotropism atlas that predicts where a cancer will spread

Different cancers favour different organs, and so do different patients. A model that predicts which organ is at risk could target surveillance and prevention.

being tested at scaledatamedium cost
Automatic weekly linkage of cancer registries to deaths, prescriptions and imaging

Connect the cancer registry to death records, pharmacy records and scan reports automatically every week, so we always know what happened to every patient without anyone filling in a form.

early clinicalregulatorsmall cost
Cheap long-term survival follow-up by linking trial participants to registries

Trials often stop following patients once the main result is in, so we never learn whether the drug extended life. Linking participants to national death and cancer registries costs almost nothing and would answer that question.

early clinicalresearchmedium cost
Confirm or refute the harm of antioxidant supplements during chemotherapy

Half of patients take antioxidant vitamins during chemotherapy. One good observational study suggests they raise recurrence by 40%. Patients deserve a definitive answer, and it can be obtained cheaply by adding supplement tracking to trials already running.

being tested at scalepayermedium cost
Coverage-with-evidence registries for MR-guided and adaptive radiotherapy

Radiotherapy machines that adapt to the tumour each day cost far more than standard ones and their benefit is unproven. Payers would fund them only within registries and trials that measure whether they help.

early clinicaldatasmall cost
Emulate combination trials from real-world data to triage which ones to run

Many combinations are already used off-label. Careful analysis of what happened to those patients can rule out the pairs that clearly do not help before spending money on trials.

early clinicaldatasmall cost
Emulate the trial in real-world data first to decide which trials to run

Before spending millions on a randomised trial, analyse existing patient records as if the trial had already happened. If the answer is obvious or the question is unanswerable, skip or redesign the trial.

being tested at scalepolicysmall cost
Evaluate alcohol minimum unit pricing against cancer incidence

Scotland and Wales put a floor under the price of alcohol. Deaths from liver disease have already fallen. Cancer takes longer to show, so someone has to keep measuring for a decade.

speculativeregulatormedium cost
Every patient on an accelerated-approval drug enrolled in a registry until confirmation

Drugs approved early on promising but unproven results would have every treated patient followed in a registry, so we know within two years whether the promise held.

early clinicalpayermedium cost
Every tumour genomic report machine-readable and deposited nationally

Genetic test results for tumours are mostly PDFs. Require labs to also send a computer-readable version to a national store, so variants can be linked to what treatments worked.

early clinicalresearchsmall cost
Follow every trial participant for 30 years through registry linkage

Trials stop following patients after a few years, so late side effects and late relapses are missed. Link trial participants to national records so follow-up continues automatically for decades.

early clinicalregulatormedium cost
Good practice standards and inspection for real-world data sources

Trials are inspected to check the data are real and traceable. Do the same for the hospital databases used to make regulatory decisions.

early clinicaldatasmall cost
Link bariatric and GLP-1 registries to cancer registries in every country that has both

Millions of people have had weight-loss surgery or now take weight-loss drugs. Linking those records to cancer registries would show, cancer by cancer, how much reversing obesity prevents, for almost no cost.

being tested at scaledatalarge cost
Link every national cancer registry to tumour genomics

Join the national list of who got cancer to the genetic profile of each tumour, so we can see for the whole population which mutations matter and which drugs work for them.

early clinicaldatasmall cost
Linked prescribing and outcome data to find drug interactions with cancer therapy

Use joined-up pharmacy and hospital records to spot when a common everyday medicine makes a cancer drug work worse or cause more harm.

speculativephilanthropymedium cost
Make a population cancer registry a condition of every cancer aid programme

You cannot fix what you cannot count. Every donor-funded cancer programme should fund and require a population-based cancer registry so results can be measured over time.

speculativeregulatorsmall cost
Mandatory interval-cancer audit for every blood-based screening test

When a screening test misses a cancer, we should know. Linking every negative result to the cancer registry and publishing what was missed, by stage, should be a condition of use.

speculativeregulatorsmall cost
Mandatory public reporting of vein-to-vein time and failure rate per CAR-T product

Patients and doctors cannot see how long each CAR-T maker takes or how often manufacturing fails. Publishing this would create pressure to get faster and more reliable.

speculativeregulatormedium cost
Mandatory real-world reporting for patients excluded from pivotal trials

Older, frailer and sicker patients are usually kept out of trials but make up most of those treated. Require companies to report how these patients do in practice.

early clinicalregulatormedium cost
Mandatory staged registries for new surgical techniques before wide adoption

New operations and surgical devices spread by enthusiasm, not evidence. Every new technique would have to be entered in a registry that tracks patients through defined stages before it can be widely used and paid for.

speculativeregulatorsmall cost
Map trial case report forms to the registry standard so trial and routine data join

Trials and hospital records describe the same things in different languages. Publish the translation so trial patients can be followed for life in routine data and trial results compared with routine care.

speculativepayermedium cost
No mCODE, no payment: tie oncology reimbursement to a minimal structured record

Hospitals would only be paid for cancer treatment if they record a small, standard set of facts (diagnosis, stage, biomarkers, treatment, outcome) in a shared format that any computer can read.

speculativeregulatormedium cost
One international registry, not one per country, for conditional approvals

When a drug is approved early, each country often demands its own follow-up study. A single shared registry would answer the safety questions faster and better.

speculativephilanthropysmall cost
One outcome record for every donated or discounted cancer drug pack

Companies and charities give or discount cancer drugs in poorer countries, but nobody records whether the patients did well. Make a simple outcome record part of every programme.

early clinicalresearchsmall cost
Open, benchmarked algorithms for lines of therapy and progression from routine data

Publish the exact rules used to work out from messy hospital records which treatment a patient was on and when it stopped working, and test them all on the same data.

speculativepayersmall cost
Pay for residual disease tests only inside a trial or registry

Leftover-cancer blood tests are being sold faster than evidence that acting on them helps. Paying for them only when the result is recorded would generate the missing evidence.

being tested at scalepayermedium cost
Payers fund cancer drugs conditionally on a registry with a pre-specified analysis

When a health system pays for a new, uncertain cancer drug, it would require that every patient's outcome is recorded and that a pre-agreed analysis decides whether payment continues.

speculativeregulatormedium cost
Post-marketing safety monitoring stratified by ancestry and sex, with label updates

Once a drug is in wide use, real-world records could be checked routinely for whether side effects differ by ancestry or sex, since trials were too small in those groups to notice. Findings would go into the label.

speculativepolicysmall cost
Pre-registration and results reporting for real-world cancer studies

Just as clinical trials must be registered before they start, studies using hospital data should be registered too, so the failed or unwelcome ones cannot quietly disappear.

being tested at scalepolicymedium cost
Public country dashboards for the three WHO breast cancer targets

The WHO set three simple goals for breast cancer: most cancers found early, diagnosis within 60 days, and most patients finishing treatment. Every country should publish how it is doing on each, every year.

speculativedatasmall cost
Public data-quality scorecards for every cancer centre

Publish a simple report card showing how complete, timely and standard each hospital's cancer data are, so poor recording becomes visible and fixable.

early clinicalresearchmedium cost
Randomise inside the cancer registry: registry-based trials for everyday questions

National cancer registries already collect the outcome data. Adding a randomisation button lets doctors compare two standard treatments across thousands of patients at a fraction of the usual cost.

early clinicaldatamedium cost
Randomise inside the registry that already follows every patient

Rare cancer patients are already tracked in registries. Offering randomisation inside the registry makes trials far cheaper and lets almost anyone take part.

early clinicalregulatorsmall cost
Real-world dose intensity and toxicity monitoring to revise labelled doses

Track how much of each cancer drug patients actually receive and how often they need to reduce it, and use that to change the official dose when the label is too high.

early clinicalpayermedium cost
Reassess cancer drug prices at three years using real-world outcomes

Set the price of a new cancer drug provisionally, then adjust it up or down after three years depending on how well patients actually did.

speculativedatasmall cost
Record and publish the symptom-to-diagnosis interval for every cancer, by hospital

How long people wait between first noticing something wrong and being diagnosed is barely measured. Recording it routinely and publishing it by hospital would expose where the system loses time.

early clinicalclinicmedium cost
Record what happens when doctors use cancer drugs off-label

Cancer drugs are often prescribed outside their approved use based on hope or small studies. Capturing outcomes of these uses would reveal which ones fail so they can be stopped.

early clinicalresearchmedium cost
Registry-based randomised trials for oncology comparative effectiveness

Use the cancer registry itself as the trial machine: randomise patients at diagnosis, then let the registry collect the outcomes for a fraction of the usual cost.

speculativeclinicmedium cost
Registry-embedded randomisation of treatment order in routine care

When two approved drugs are both reasonable next steps and nobody knows which should come first, let the clinic flip a coin and record what happens.

early clinicalresearchsmall cost
Require genetic and target-trial evidence before funding any repurposing phase 3

The big metformin cancer trial failed after years and millions, despite strong observational hints. Cheaper checks on causality should be passed before funding the next one.

speculativeregulatormedium cost
Require post-approval evidence in patients over 75 and update labels accordingly

New cancer drugs are approved on trials of younger, fitter patients, then given mostly to older ones. Regulators should require real-world safety and benefit data in the over-75s and put it on the label.

early clinicaldatamedium cost
Send the code to the data: a federated analytics network of cancer centres

Hospitals keep their records at home; researchers send in a programme that runs at each hospital and only the summary results come back.

early clinicalindustrysmall cost
Simulate eligibility against real-world data before every protocol is locked

Before a trial is finalised, run its entry rules against records of real patients with that cancer and report what fraction would qualify. If it is under half, explain why.

early clinicalregulatorsmall cost
Standards for external control arms built from federated real-world data

When a trial has no comparison group, the comparison is sometimes built from old patient records. Set rules for how that is done so the answer is not rigged.

early clinicalclinicsmall cost
Structured, coded radiology reports for cancer response instead of free text

Radiologists would record tumour measurements and response in tick-box, coded form rather than prose, so progression is machine-readable across every scan.

speculativepolicymedium cost
Treat resistance like an infectious disease and run national surveillance

Countries track how bacteria become resistant to antibiotics and publish it. Doing the same for cancer drugs would show which escape routes are becoming common and where.

being tested at scalepolicylarge cost
Universal tumour and germline sequencing at diagnosis feeding a shared learning system

Sequence every cancer at diagnosis, along with the patient's inherited genes, and pool the results with treatments and outcomes so every patient teaches the system how to treat the next.

early clinicalresearchmedium cost
Validate real-world progression against central imaging review

Real-world studies say a drug 'stopped working' based on clinic notes. Check how often that matches a proper scan review, and fix the definitions so the two agree.

early clinicaldatamedium cost
Validate real-world progression endpoints so pragmatic trials can use them

Pragmatic trials want to use the progression dates recorded in ordinary clinic notes instead of expensive protocol scans. Checking how well those routine records match formal trial measurements would show when that shortcut is safe.

early clinicaldatasmall cost
Watch routine care for drug combinations that quietly make cancer treatment worse

Some everyday medicines, such as antibiotics or steroids, seem to blunt immunotherapy. Automatically scanning health records for such harmful pairs would catch them years earlier.

early clinicalresearchmedium cost
Wearable activity data as a validated real-world endpoint

Step counts and sleep from a wristband could show whether a cancer treatment is helping or harming daily life. Prove they track survival and quality of life, then use them in real-world studies.

What relieves it today

1top

Key papers

1top

Connected

91top

Pages like this

not linked directly; found by shared links

technologies

1

companies

3

institutions

9

terms

4

ideas

68
A global federated real-world evidence network at regulatory gradeA national cancer data space with one legal front doorA national late-effects registry linking treatment exposures to outcomes decades laterA national residual-disease weather service: serial blood tests for every curatively treated patient, pooledA pre-registered standard for emulating trials with real-world dataA public rulebook for when an external or synthetic control arm is acceptableA public tracker of how long each country takes to adopt new evidenceA real-world sequencing analysis within a year of every new approvalA registry of every treatment sequence patients actually receive, with outcomesA structured registry for every off-label cancer drug useA ten-year cohort of incidental findings to calibrate follow-up guidelinesA tumour board assistant that cites its evidence and tracks outcomesA video-based surgical quality registry linking assessed skill to cancer outcomesAfter approval, a pragmatic trial in the patients the pivotal trial excludedAn automated pipeline emulating trials of every common drug against every cancerAn international consortium pooling the outcome of every treated child with cancerAn open library pairing completed cancer trials with real-world emulationsAn organotropism atlas that predicts where a cancer will spreadAutomatic weekly linkage of cancer registries to deaths, prescriptions and imagingCheap long-term survival follow-up by linking trial participants to registriesConfirm or refute the harm of antioxidant supplements during chemotherapyCoverage-with-evidence registries for MR-guided and adaptive radiotherapyEmulate combination trials from real-world data to triage which ones to runEmulate the trial in real-world data first to decide which trials to runEvaluate alcohol minimum unit pricing against cancer incidenceEvery patient on an accelerated-approval drug enrolled in a registry until confirmationEvery tumour genomic report machine-readable and deposited nationallyFollow every trial participant for 30 years through registry linkageGood practice standards and inspection for real-world data sourcesLink bariatric and GLP-1 registries to cancer registries in every country that has bothLink every national cancer registry to tumour genomicsLinked prescribing and outcome data to find drug interactions with cancer therapyMake a population cancer registry a condition of every cancer aid programmeMandatory interval-cancer audit for every blood-based screening testMandatory public reporting of vein-to-vein time and failure rate per CAR-T productMandatory real-world reporting for patients excluded from pivotal trialsMandatory staged registries for new surgical techniques before wide adoptionMap trial case report forms to the registry standard so trial and routine data joinNo mCODE, no payment: tie oncology reimbursement to a minimal structured recordOne international registry, not one per country, for conditional approvalsOne outcome record for every donated or discounted cancer drug packOpen, benchmarked algorithms for lines of therapy and progression from routine dataPay for residual disease tests only inside a trial or registryPayers fund cancer drugs conditionally on a registry with a pre-specified analysisPost-marketing safety monitoring stratified by ancestry and sex, with label updatesPre-registration and results reporting for real-world cancer studiesPublic country dashboards for the three WHO breast cancer targetsPublic data-quality scorecards for every cancer centreRandomise inside the cancer registry: registry-based trials for everyday questionsRandomise inside the registry that already follows every patientReal-world dose intensity and toxicity monitoring to revise labelled dosesReassess cancer drug prices at three years using real-world outcomesRecord and publish the symptom-to-diagnosis interval for every cancer, by hospitalRecord what happens when doctors use cancer drugs off-labelRegistry-based randomised trials for oncology comparative effectivenessRegistry-embedded randomisation of treatment order in routine careRequire genetic and target-trial evidence before funding any repurposing phase 3Require post-approval evidence in patients over 75 and update labels accordinglySend the code to the data: a federated analytics network of cancer centresSimulate eligibility against real-world data before every protocol is lockedStandards for external control arms built from federated real-world dataStructured, coded radiology reports for cancer response instead of free textTreat resistance like an infectious disease and run national surveillanceUniversal tumour and germline sequencing at diagnosis feeding a shared learning systemValidate real-world progression against central imaging reviewValidate real-world progression endpoints so pragmatic trials can use themWatch routine care for drug combinations that quietly make cancer treatment worseWearable activity data as a validated real-world endpoint

collections

5

key papers

1