Quality, Power, and Fragility of Randomized Controlled Trials in ANCA-Associated Vasculitis: A Systematic Review
In brief
Five patient outcome changes often sufficed to alter AAV trial findings
In a review of 56 randomized trials, the median number of patient outcomes that had to change to alter a finding was five. Although 61% of trials were rated high quality, 20 of 35 trials reporting a power calculation did not enroll enough patients; in 5 of 13 trials assessed, losses to follow-up or withdrawals exceeded the fragility count.
- Journal
- American journal of kidney diseases : the official journal of the National Kidney Foundation (Q1)
- Published
- 20 November 2026
- Study design
- Systematic review / meta-analysis of RCTs
- Evidence level
- Level 1, High (CEBM 1a)
- Authors
- Vanja Ivković, Annette Bruchfeld, Lauren Floyd, Sarah Soyeon Oh, Peong Gang Park, Kate I Stevens, et al.
- PMID
- 43064054
- DOI
- 10.1053/j.ajkd.2026.07.025
Why clinicians should know about it
- Picked for Nephrology (top studies of the week, 22 November 2026): Systematic review assesses evidence robustness in ANCA vasculitis trials
Abstract
RATIONALE & OBJECTIVE: Randomized controlled trials (RCTs) changed the management of ANCA-associated vasculitides (AAV). However, their quality and statistical power to detect the outcomes vary. This study aimed to evaluate the robustness of RCTs in AAV regarding quality and statistical power as well as the stability of trial findings, termed fragility. STUDY DESIGN: Systematic review of RCTs published up to May 1, 2025. SETTING & STUDY POPULATIONS: RCTs evaluating therapies in AAV. SELECTION CRITERIA FOR STUDIES: Reports of the primary findings of RCTs' in which over 50% of participants had AAV. DATA EXTRACTION: Screening was performed by two authors and extraction by one, with verification of extracted information implemented for 20% of trials. RCT quality was assessed using the modified Jadad score (mJS). Reporting of statistical sample size calculations or power analysis was recorded. The Fragility Index (FI) and Reverse FI (RFI) were calculated for each trial as the number of participants whose outcome would have needed to switch from event to non-event, or vice versa, to change the RCT result and interpretation. ANALYTICAL APPROACH: Continuous variables were described by mean and standard deviation (SD) or by median and interquartile range. Between-group comparisons were conducted using the Student's t-test or Mann-Whitney U-test. Categorical variables were described as counts and percentages. Between-group comparisons were conducted using ANOVA, the Kruskal-Wallis test, and Fisher's Exact test, with correlations tested using Pearson's correlation coefficient or Spearman's rank correlation, depending the normality of the distribution. Linear regression was used to test associations between variables. RESULTS: Four (7%) RCTs were of poor quality, 18 (32%) were of moderate quality, and 34 (61%) were of high quality. RCT quality improved over time and was associated with larger RCTs. Thirty-five (63%) RCTs reported sample size or power calculation, of which 20 (57%) did not enroll sufficient patients. The median FI of all RCTs was 5.0 (25th to 75th percentile: 1.0 to 5.0, min-max: 0 to 10). A total of 5 (38%) RCTs had a higher number of patients lost to follow-up, withdrawn, or dropped out than the FI. The median RFI was 5.0 (25th to 75th percentile: 3.0 to 7.3, min-max: 1 to 16). LIMITATIONS: Not all trials reported all the characteristics studied. CONCLUSION: Most trials in AAV were of good quality, but were small, frequently underpowered, and highly fragile. A shift in the outcomes of only five participants on average, often fewer than the number of participants lost to follow-up, would have been sufficient to change findings.
Abstract as published, via PubMed.
For healthcare professionals. The summary is generated by AI from the published abstract, and the evidence level is assigned automatically from the study design on the Oxford CEBM hierarchy. Neither is medical advice. Read the full paper before changing practice.