AI-Based Delirium Risk Prediction Compared With the Validated 4AT-Score Screening Tool in Patients With Trauma: Prospective Cohort Study
In brief
AI tool flagged 87% of delirium cases, versus 28% with 4AT
In a prospective study of 2,002 trauma ward patients, an AI tool using electronic health record data identified 165 of 189 patients who later developed delirium as at-risk, compared with 5 identified by the 4AT screening score. The AI tool was less accurate at ruling out delirium in patients who did not develop it, and whether its earlier warnings improve care or outcomes remains unknown.
- Journal
- JMIR formative research (Q2)
- Published
- 21 October 2026
- Study design
- Prospective / inception cohort
- Evidence level
- Level 2, Moderate (CEBM 2b)
- Authors
- Klaus Franceschini, Marisa Valentini, Andreas Leithner, Diether Kramer, Stefanie Jauk, Lena Delia Lorenzer, et al.
- PMID
- 42906075
- DOI
- 10.2196/104907
Why clinicians should know about it
- Picked for Health Informatics (top studies of the week, 25 October 2026): Prospective real-world evaluation of EHR-derived AI delirium decision support
Abstract
BACKGROUND: Delirium is a complex neuropsychiatric syndrome whose severe and lasting consequences in hospitalized patients are largely considered preventable. Prevention primarily relies on the early identification of high-risk patients prior to syndrome onset. However, this remains challenging in clinical practice due to the absence of a diagnostic gold standard and the considerable administrative burden associated with established screening tools such as the 4AT score. OBJECTIVE: The aim of this study is to compare the 4AT score with an established AI-supported prognostic tool in applied clinical practice. Our goal is to demonstrate that shifting from a purely diagnostic approach toward AI-supported delirium risk prediction enables more efficient clinical workflows, reduces misclassification rates, facilitates earlier and more targeted interventions, and ultimately improves long-term patient outcomes. METHODS: In this prospective study, a total of 2002 patients from a trauma ward were screened and assessed for delirium risk using the 4AT score and the AI-based tool at admission, on the evening of admission, and on the following day, with each assessment predicting the risk of delirium occurrence at any point during the remainder of the hospital stay. The AI tool based its predictions on clinical data automatically derived from electronic health records. The AI-based tool applied a previously developed and validated random forest model (not developed as part of this study). RESULTS: Of the 2002 processed patients, the AI prediction tool correctly predicted 87.3% (165/189) of patients with delirium onset as at-risk, compared to an early detection rate of 28.0% (5/189) achieved by the 4AT score. Moreover, the AI-based tool correctly classified 73.9% (1340/1813) patients without delirium as not-at-risk, compared to 96.3% (1746/1813) for the 4AT score. Therefore, the AI-based tool achieved very good delirium predictions, with an area under the receiver operating characteristic curve of 0.884 (95% CI 0.8634-0.9039). CONCLUSIONS: The AI-based delirium prognostic tool demonstrated superior early predictive capacity for delirium risk at admission, compared with the 4AT score. The AI-based tool enables proactive risk management and targeted risk reduction.
Abstract as published, via PubMed.
For healthcare professionals. The summary is generated by AI from the published abstract, and the evidence level is assigned automatically from the study design on the Oxford CEBM hierarchy. Neither is medical advice. Read the full paper before changing practice.