Skip to main content

Quality, Power, and Fragility of Randomized Controlled Trials in ANCA-Associated Vasculitis: A Systematic Review

In brief

Five patient outcome changes often sufficed to alter AAV trial findings

In a review of 56 randomized trials, the median number of patient outcomes that had to change to alter a finding was five. Although 61% of trials were rated high quality, 20 of 35 trials reporting a power calculation did not enroll enough patients; in 5 of 13 trials assessed, losses to follow-up or withdrawals exceeded the fragility count.

Journal
American journal of kidney diseases : the official journal of the National Kidney Foundation (Q1)
Published
20 November 2026
Study design
Systematic review / meta-analysis of RCTs
Evidence level
Level 1, High (CEBM 1a)
Authors
Vanja Ivković, Annette Bruchfeld, Lauren Floyd, Sarah Soyeon Oh, Peong Gang Park, Kate I Stevens, et al.
PMID
43064054
DOI
10.1053/j.ajkd.2026.07.025

Why clinicians should know about it

  • Picked for Nephrology (top studies of the week, 22 November 2026): Systematic review assesses evidence robustness in ANCA vasculitis trials

Abstract

RATIONALE & OBJECTIVE: Randomized controlled trials (RCTs) changed the management of ANCA-associated vasculitides (AAV). However, their quality and statistical power to detect the outcomes vary. This study aimed to evaluate the robustness of RCTs in AAV regarding quality and statistical power as well as the stability of trial findings, termed fragility. STUDY DESIGN: Systematic review of RCTs published up to May 1, 2025. SETTING & STUDY POPULATIONS: RCTs evaluating therapies in AAV. SELECTION CRITERIA FOR STUDIES: Reports of the primary findings of RCTs' in which over 50% of participants had AAV. DATA EXTRACTION: Screening was performed by two authors and extraction by one, with verification of extracted information implemented for 20% of trials. RCT quality was assessed using the modified Jadad score (mJS). Reporting of statistical sample size calculations or power analysis was recorded. The Fragility Index (FI) and Reverse FI (RFI) were calculated for each trial as the number of participants whose outcome would have needed to switch from event to non-event, or vice versa, to change the RCT result and interpretation. ANALYTICAL APPROACH: Continuous variables were described by mean and standard deviation (SD) or by median and interquartile range. Between-group comparisons were conducted using the Student's t-test or Mann-Whitney U-test. Categorical variables were described as counts and percentages. Between-group comparisons were conducted using ANOVA, the Kruskal-Wallis test, and Fisher's Exact test, with correlations tested using Pearson's correlation coefficient or Spearman's rank correlation, depending the normality of the distribution. Linear regression was used to test associations between variables. RESULTS: Four (7%) RCTs were of poor quality, 18 (32%) were of moderate quality, and 34 (61%) were of high quality. RCT quality improved over time and was associated with larger RCTs. Thirty-five (63%) RCTs reported sample size or power calculation, of which 20 (57%) did not enroll sufficient patients. The median FI of all RCTs was 5.0 (25th to 75th percentile: 1.0 to 5.0, min-max: 0 to 10). A total of 5 (38%) RCTs had a higher number of patients lost to follow-up, withdrawn, or dropped out than the FI. The median RFI was 5.0 (25th to 75th percentile: 3.0 to 7.3, min-max: 1 to 16). LIMITATIONS: Not all trials reported all the characteristics studied. CONCLUSION: Most trials in AAV were of good quality, but were small, frequently underpowered, and highly fragile. A shift in the outcomes of only five participants on average, often fewer than the number of participants lost to follow-up, would have been sufficient to change findings.

Abstract as published, via PubMed.

View on PubMedFull text at the publisherOpen in the app

For healthcare professionals. The summary is generated by AI from the published abstract, and the evidence level is assigned automatically from the study design on the Oxford CEBM hierarchy. Neither is medical advice. Read the full paper before changing practice.