Skip to main content

Hypothetico-Deductive Reasoning in Direct Oral Anticoagulant Trial Meta-Analyses: A Meta-Epidemiological Study

In brief

Anticoagulant meta-analyses had a 40% nominal chance of at least one false positive

In 93 meta-analyses of direct oral anticoagulant trials, the median nominal chance of at least one false-positive result was 40% under a global-null model assuming independent tests. Only 2.2% reported managing multiple-testing risk, and 30.1% of conclusions showed spin; this is a theoretical measure of exposure, not the chance that a published conclusion is false.

Journal
Fundamental & clinical pharmacology (Q2)
Published
1 November 2026
Study design
Systematic review / meta-analysis of RCTs
Evidence level
Level 1, High (CEBM 1a)
Authors
Quentin Remy, Arthur Gougeon, Paul Riallin, Rémy Boussageon, Jean-Christophe Lega
PMID
43023449
DOI
10.1111/fcp.70118

Why clinicians should know about it

  • Picked for Epidemiology (top studies of the week, 15 November 2026): Meta-epidemiological assessment of multiplicity, reporting, and bias

Abstract

BACKGROUND: Direct oral anticoagulants (DOAC) have become standard therapy for thrombosis prevention since 2008. Meta-analyses (MAs) of randomized controlled trials (RCT) are considered high-level evidence supporting clinical guidelines. However, methodological biases may yield false-positive findings, particularly through inadequate hypothesis formulation, multiple testing without alpha-risk correction, and selective outcome reporting. No study has systematically assessed the risk of false positives in MA evaluating DOAC through hypothetico-deductive reasoning. OBJECTIVE: This study aimed to assess methodological features relevant to confirmatory inference in MA of RCTs evaluating DOACs, including hypothesis specification and multiplicity management, and to quantify nominal exposure to type I error under specified assumptions. METHODS: Following a pre-specified protocol, we conducted a meta-epidemiological study using embase and PubMed databases. We included MA of RCT evaluating four EMA-approved DOAC. Two independent authors performed study selection. For each MA, we calculated the nominal family-wise probability of at least one type I error under the global null hypothesis, assuming independent tests. We assessed the presence of directional hypotheses, primary outcome definition, pre-specified protocols, sensitivity analyses, and spin in conclusions. RESULTS: Ninety-three MA were included (mean 34 118 patients; seven RCT per MA). The median nominal family-wise type I error probability was 40%, and only 2.2% of MAs reported alpha-risk management, 26.9% had pre-specified protocols, and 14.0% reported directional hypotheses. Only 5.4% combined a clearly specified directional hypothesis with a single primary objective and well-defined outcome. Spin was present in 30.1% of conclusions. CONCLUSION: Most MAs showed substantial uncorrected nominal exposure to multiplicity; this estimate is a theoretical indicator and not the probability that a published conclusion is false. Many MAs also lacked explicit hypotheses and frequently exhibited spin. Strengthening reliability requires integrating genuine hypothetico-deductive approaches and adapting methodological guidelines.

Abstract as published, via PubMed.

View on PubMedFull text at the publisherOpen in the app

For healthcare professionals. The summary is generated by AI from the published abstract, and the evidence level is assigned automatically from the study design on the Oxford CEBM hierarchy. Neither is medical advice. Read the full paper before changing practice.