The Burden of the "False-Negatives" in Clinical Development

Analyses of Current and Alternative Scenarios and Corrective Measures

T. Burt, K. S. Button, H. H.Z. Thom, R. J. Noveck, Marcus R Munafò

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

The "false-negatives" of clinical development are the effective treatments wrongly determined ineffective. Statistical errors leading to "false-negatives" are larger than those leading to "false-positives," especially in typically underpowered early-phase trials. In addition, "false-negatives" are usually eliminated from further testing, thereby limiting the information available on them. We simulated the impact of early-phase power on economic productivity in three developmental scenarios. Scenario 1, representing the current status quo, assumed 50% statistical power at phase II and 90% at phase III. Scenario 2 assumed increased power (80%), and Scenario 3, increased stringency of alpha (1%) at phase II. Scenario 2 led, on average, to a 60.4% increase in productivity and 52.4% increase in profit. Scenario 3 had no meaningful advantages. Our results suggest that additional costs incurred by increasing the power of phase II studies are offset by the increase in productivity. We discuss the implications of our results and propose corrective measures.

Original languageEnglish
Article number12478
Number of pages10
JournalClinical and Translational Science
Volume10
Issue number6
Early online date4 Jul 2017
DOIs
Publication statusPublished - 2017

Fingerprint

Productivity
Economics
Costs and Cost Analysis
Profitability
Testing
Costs

ASJC Scopus subject areas

  • Neuroscience(all)
  • Medicine(all)
  • Biochemistry, Genetics and Molecular Biology(all)
  • Pharmacology, Toxicology and Pharmaceutics(all)

Cite this

The Burden of the "False-Negatives" in Clinical Development : Analyses of Current and Alternative Scenarios and Corrective Measures. / Burt, T.; Button, K. S.; Thom, H. H.Z.; Noveck, R. J.; Munafò, Marcus R.

In: Clinical and Translational Science, Vol. 10, No. 6, 12478, 2017.

Research output: Contribution to journalArticle

@article{8ca54792a0a343c395f698485038f2a6,
title = "The Burden of the {"}False-Negatives{"} in Clinical Development: Analyses of Current and Alternative Scenarios and Corrective Measures",
abstract = "The {"}false-negatives{"} of clinical development are the effective treatments wrongly determined ineffective. Statistical errors leading to {"}false-negatives{"} are larger than those leading to {"}false-positives,{"} especially in typically underpowered early-phase trials. In addition, {"}false-negatives{"} are usually eliminated from further testing, thereby limiting the information available on them. We simulated the impact of early-phase power on economic productivity in three developmental scenarios. Scenario 1, representing the current status quo, assumed 50{\%} statistical power at phase II and 90{\%} at phase III. Scenario 2 assumed increased power (80{\%}), and Scenario 3, increased stringency of alpha (1{\%}) at phase II. Scenario 2 led, on average, to a 60.4{\%} increase in productivity and 52.4{\%} increase in profit. Scenario 3 had no meaningful advantages. Our results suggest that additional costs incurred by increasing the power of phase II studies are offset by the increase in productivity. We discuss the implications of our results and propose corrective measures.",
author = "T. Burt and Button, {K. S.} and Thom, {H. H.Z.} and Noveck, {R. J.} and Munaf{\`o}, {Marcus R}",
year = "2017",
doi = "10.1111/cts.12478",
language = "English",
volume = "10",
journal = "Clinical and Translational Science",
issn = "1752-8054",
publisher = "Wiley",
number = "6",

}

TY - JOUR

T1 - The Burden of the "False-Negatives" in Clinical Development

T2 - Analyses of Current and Alternative Scenarios and Corrective Measures

AU - Burt, T.

AU - Button, K. S.

AU - Thom, H. H.Z.

AU - Noveck, R. J.

AU - Munafò, Marcus R

PY - 2017

Y1 - 2017

N2 - The "false-negatives" of clinical development are the effective treatments wrongly determined ineffective. Statistical errors leading to "false-negatives" are larger than those leading to "false-positives," especially in typically underpowered early-phase trials. In addition, "false-negatives" are usually eliminated from further testing, thereby limiting the information available on them. We simulated the impact of early-phase power on economic productivity in three developmental scenarios. Scenario 1, representing the current status quo, assumed 50% statistical power at phase II and 90% at phase III. Scenario 2 assumed increased power (80%), and Scenario 3, increased stringency of alpha (1%) at phase II. Scenario 2 led, on average, to a 60.4% increase in productivity and 52.4% increase in profit. Scenario 3 had no meaningful advantages. Our results suggest that additional costs incurred by increasing the power of phase II studies are offset by the increase in productivity. We discuss the implications of our results and propose corrective measures.

AB - The "false-negatives" of clinical development are the effective treatments wrongly determined ineffective. Statistical errors leading to "false-negatives" are larger than those leading to "false-positives," especially in typically underpowered early-phase trials. In addition, "false-negatives" are usually eliminated from further testing, thereby limiting the information available on them. We simulated the impact of early-phase power on economic productivity in three developmental scenarios. Scenario 1, representing the current status quo, assumed 50% statistical power at phase II and 90% at phase III. Scenario 2 assumed increased power (80%), and Scenario 3, increased stringency of alpha (1%) at phase II. Scenario 2 led, on average, to a 60.4% increase in productivity and 52.4% increase in profit. Scenario 3 had no meaningful advantages. Our results suggest that additional costs incurred by increasing the power of phase II studies are offset by the increase in productivity. We discuss the implications of our results and propose corrective measures.

UR - http://www.scopus.com/inward/record.url?scp=85021803017&partnerID=8YFLogxK

UR - http://dx.doi.org/10.1111/cts.12478

U2 - 10.1111/cts.12478

DO - 10.1111/cts.12478

M3 - Article

VL - 10

JO - Clinical and Translational Science

JF - Clinical and Translational Science

SN - 1752-8054

IS - 6

M1 - 12478

ER -