Interobserver Agreement for Classifying Infections in Emergency Department Patients Using Modified Centers for Disease Control and Prevention Criteria
In brief
ED infection classification framework achieves 90% agreement among physicians
In a study of 1,062 Dutch emergency department patients with suspected infection, a CDC-based adjudication tool produced very high reproducibility-88.9% agreement for infection diagnosis, 90.1% for pathogen identification, and 93.4% for sepsis classification. These results suggest the tool can reliably standardize infection and sepsis coding in large observational studies, though its performance outside the Netherlands remains to be tested.
- Journal
- Open forum infectious diseases (Q1)
- Published
- 24 July 2026
- Study design
- Prospective / inception cohort
- Evidence level
- Level 2, Moderate (CEBM 2b)
- Authors
- Oren Turgman, Evelien Reijnders, Sebastiaan C M Joosten, Susanne E Doeleman, Aryna Kolodyazhna, Floris M C de Vries, et al.
- PMID
- 42542778
- DOI
- 10.1093/ofid/ofag466
Why clinicians should know about it
- Picked for Emergency Medicine (paper of the day, 3 August 2026).
Abstract
BACKGROUND: To develop and evaluate a standardized emergency department (ED) adapted framework based on Centers for Disease Control (CDC) surveillance definitions and modified SOFA assessment for reproducible infection and sepsis classification in patients with suspected infection on the ED. METHODS: As part of the prospective cohort study BIOSEP, adults presenting to the ED with suspected infection and a Modified Early Warning Score ≥2 were consecutively enrolled between 2022 and 2026 at 4 Dutch hospitals. All enrolled patients in this study were retrospectively adjudicated through post hoc review of their electronic health records. Each case was independently assessed by 2 blinded physicians for plausibility of infection, infection diagnosis, causative pathogen, and sepsis occurrence. Disagreements were resolved by a third blinded reviewer. Interobserver agreement was quantified using Cohen's kappa and Gwet's agreement coefficients (gAC). RESULTS: In total, 1062 ED patients were included with 1145 infection episodes. Interobserver agreement for infection diagnosis was 88.9%, and agreement statistics were classified as very good with Cohen's κ of 0.87 (95% CI 0.85-0.89) and a gAC1 of 0.89 (0.87-0.91). Agreement for causative pathogens was 90.1% (κ 0.89 [0.87-0.92]; gAC1 0.97 [0.95-0.98]), and for sepsis occurrence 93.4% (κ 0.80 [0.76-0.85]; gAC1 0.92 [0.90-0.94]). Agreement for plausibility of infection was also high (87.9%; weighted κ 0.87 [0.85-0.89]; gAC2 0.92 [0.90-0.93]). CONCLUSIONS: Our ED-adapted adjudication framework based on CDC surveillance definitions yields high interobserver agreement for infection and sepsis classification across a heterogeneous ED population, supporting its use in large-scale observational research.
Abstract as published, via PubMed.
For healthcare professionals. The summary is generated by AI from the published abstract, and the evidence level is assigned automatically from the study design on the Oxford CEBM hierarchy. Neither is medical advice. Read the full paper before changing practice.