The model, developed by researchers at the Icahn School of Medicine at Mount Sinai, has been integrated into hospital operations, helping health care providers identify and manage delirium, a condition that can affect up to one-third of hospitalized patients.
The study, the first to show that an AI-powered delirium risk assignment model can not only perform well in a laboratory setting but also deliver real-world benefits in clinical practice, was published in the May 7, 2025 online issue of JAMA Network Open.
Delirium is a sudden and severe state of confusion that carries life-threatening risks and often goes undetected in hospitalized patients. Without treatment, it can prolong hospital stays, raise mortality risk, and worsen long-term outcomes. Until now, AI-driven delirium prediction models have struggled to demonstrate tangible improvements in patient care, say the investigators.
"The motivation behind our study at Mount Sinai was clear. Current AI-based delirium prediction models haven’t yet shown real-world benefits for patient care," said senior corresponding study author Joseph Friedman, MD, Founder and Director of Delirium Services for the Mount Sinai Health System and Professor of Psychiatry, and Neuroscience, at the Icahn School of Medicine at Mount Sinai. "We wanted to change that by creating a model that accurately calculates delirium risk in real time and integrates smoothly into clinical workflows, helping hospital staff catch and treat more patients with delirium who might otherwise be overlooked."
Rather than building an AI model in isolation and testing it later in hospitals, the research team worked closely with Mount Sinai clinicians and hospital staff from the start. This "vertical integration" approach allowed them to refine the model in real time, ensuring it was both effective and practical for clinical use.
When deployed at Mount Sinai, the AI model dramatically improved delirium detection, resulting in:
- A 400 percent increase in identified cases without increasing time spent screening patients
- Safer prescribing by reducing the use of potentially inappropriate medications in older adults
- Strong, reliable performance in a real-world hospital setting
In their study, which involved more than 32,000 patients admitted to The Mount Sinai Hospital in New York City, the researchers used the AI model to analyze a combination of structured data and clinicians’ notes from electronic health records. It used machine learning to identify chart data patterns associated with a high risk of delirium and applied natural language processing to identify patterns from the language of chart notes written by hospital staff. This approach captures staff observations of subtle mental status changes in patients who are delirious or at heightened risk. An individual staff member writing a note may be unaware at that time that their clinical observations are helping to improve the AI model’s accuracy.
Notably, the model was tested in a highly diverse patient population with a wide range of medical and surgical conditions - far broader than the narrow groups typically included in studies of machine learning-based delirium risk prediction models.
The tool significantly improved monthly delirium detection rates - from 4.4 to 17.2 percent - allowing for earlier intervention. Patients identified also received lower doses of sedative medications, potentially reducing side effects and improving overall care.
"Our model isn’t about replacing doctors - it's about giving them a powerful tool to streamline their work," says Dr. Friedman. "By doing the heavy lifting of analyzing vast amounts of patient data, our machine learning approach allows health care providers to focus their expertise on diagnosing and treating patients more effectively and with greater precision."
While the AI model has delivered strong results at The Mount Sinai Hospital, and testing is underway at other Mount Sinai locations, validation will be needed at other hospital systems to evaluate its performance in different settings and adjust if needed.
"This research demonstrates the quantum leaps we are achieving by building AI-driven clinical decision support into hospital operations. We are improving patient safety and outcomes by bringing the right team to the right patient at the right time so patients receive specialized care tailored to their needs," says study co-author David L. Reich MD, Chief Clinical Officer of the Mount Sinai Health System and President of The Mount Sinai Hospital. "To become a learning health system, we must continue this pathway of developing, testing, deploying, and fine-tuning AI-tools that are seamlessly integrated into health care workflows. Previously, we found that AI clinical decision support works in addressing malnutrition and clinical deterioration, where Mount Sinai's use of real-time AI alerts to predict declining health, accelerated treatment and reduced hospital deaths."
Friedman JI, Parchure P, Cheng FY, Fu W, Cheertirala S, Timsina P, Raut G, Reina K, Joseph-Jimerson J, Mazumdar M, Freeman R, Reich DL, Kia A.
Machine Learning Multimodal Model for Delirium Risk Stratification.
JAMA Netw Open. 2025 May 1;8(5):e258874. doi: 10.1001/jamanetworkopen.2025.8874