Patients' Affinity for AI Messages Drops if they Know the Technology was Used

In a Duke Health-led survey, patients who were shown messages written either by artificial intelligence (AI) or human clinicians indicated a preference for responses drafted by AI over a human. That preference was diminished, though not erased, when told AI was involved.

The study, publishing March 11 in JAMA Network Open, showed high overall satisfaction with communications written both by AI and humans, despite their preference for AI. This suggests that letting patients know AI was used does not greatly reduce confidence in the message.

"Every health system is grappling with this issue of whether we disclose the use of AI and how," said senior author Anand Chowdhury, M.D., assistant professor in the Department of Medicine at Duke University School of Medicine. "There is a desire to be transparent, and a desire to have satisfied patients. If we disclose AI, what do we lose? That is what our study intended to measure."

Chowdhury and colleagues sent a series of surveys to members of the Duke University Health System patient advisory committee. This is a group of Duke Health patients and community members who help inform how Duke Health communicates with and cares for patients. More than 1,400 people responded to at least one of the surveys.

The surveys focused on three clinical topics, including routine medication refill request (a low seriousness topic), medication side effect question (moderate seriousness), and potential cancer on imaging (high seriousness).

Human responses were provided by a multidisciplinary team of physicians who were asked to write a realistic response to each survey scenario based on how they typically draft responses to patients. The generative AI responses were written using ChatGPT and were reviewed for accuracy by the study physicians who made minimal changes to the responses.

For each survey, participants were asked to review a vignette that presented one of the clinical topics. Each vignette included a response from either AI or human clinicians, along with either a disclosure or no disclosure telling them who the author was. They were then asked to rate their overall satisfaction with the response, usefulness of the information, and how cared for they felt during the interaction.

Comparing authors, patients preferred AI-drafted messages by an average difference of 0.30 points on 5-point scale for satisfaction. The AI communications tended to be longer, included more details, and likely seemed more empathetic than human-drafted messages.

"Our study shows us that patients have a slight preference for messages written by AI, even though they are slightly less satisfied when the disclosure informs them that AI was involved," said first author Joanna S. Cavalier, M.D., assistant professor in the Department of Medicine at Duke University School of Medicine.

When they looked at the difference in satisfaction when participants were told AI was involved, disclosing AI led to lower satisfaction, though not by much: 0.1 points on the 5-point scale. Regardless of the actual author, patients were overall more satisfied with messages when they were not told AI was involved in drafting the response.

"These findings are particularly important in the context of research showing that patients have higher satisfaction when they can connect electronically with their clinicians," Chowdhury said.

"At the same time, clinicians express burnout when their in-basket is full, making the use of automated tools highly attractive to ease that burden," Chowdhury said. "Ultimately these findings give us confidence to use technologies like this to potentially help our clinicians reduce burnout, while still doing the right thing and telling our patients when we use AI."

Cavalier JS, Goldstein BA, Ravitsky V, Bélisle-Pipon JC, Bedoya A, Maddocks J, Klotman S, Roman M, Sperling J, Xu C, Poon EG, Chowdhury A.
Ethics in Patient Preferences for Artificial Intelligence-Drafted Responses to Electronic Messages.
JAMA Netw Open. 2025 Mar 3;8(3):e250449. doi: 10.1001/jamanetworkopen.2025.0449

Most Popular Now

Integrating Care Records is Good. Using …

Opinion Article by Dr Paul Deffley, Chief Medical Officer, Alcidion. A single patient record already exists in the NHS. Or at least, that’s a perception shared by many. A survey of...

Should AI Chatbots Replace Your Therapis…

The new study exposes the dangerous flaws in using artificial intelligence (AI) chatbots for mental health support. For the first time, the researchers evaluated these AI systems against clinical standards...

AI could Help Pathologists Match Cancer …

A new study by researchers at the Icahn School of Medicine at Mount Sinai, Memorial Sloan Kettering Cancer Center, and collaborators, suggests that artificial intelligence (AI) could significantly improve how...

AI Detects Early Signs of Osteoporosis f…

Investigators have developed an artificial intelligence-assisted diagnostic system that can estimate bone mineral density in both the lumbar spine and the femur of the upper leg, based on X-ray images...

AI Model Converts Hospital Records into …

UCLA researchers have developed an AI system that turns fragmented electronic health records (EHR) normally in tables into readable narratives, allowing artificial intelligence to make sense of complex patient histories...

AI Sharpens Pathologists' Interpret…

Pathologists' examinations of tissue samples from skin cancer tumours improved when they were assisted by an AI tool. The assessments became more consistent and patients' prognoses were described more accurately...

AI Tool Detects Surgical Site Infections…

A team of Mayo Clinic researchers has developed an artificial intelligence (AI) system that can detect surgical site infections (SSIs) with high accuracy from patient-submitted postoperative wound photos, potentially transforming...

Forging a Novel Therapeutic Path for Pat…

Rett syndrome is a devastating rare genetic childhood disorder primarily affecting girls. Merely 1 out of 10,000 girls are born with it and much fewer boys. It is caused by...

Mayo Clinic's AI Tool Identifies 9 …

Mayo Clinic researchers have developed a new artificial intelligence (AI) tool that helps clinicians identify brain activity patterns linked to nine types of dementia, including Alzheimer's disease, using a single...

AI Detects Fatty Liver Disease with Ches…

Fatty liver disease, caused by the accumulation of fat in the liver, is estimated to affect one in four people worldwide. If left untreated, it can lead to serious complications...

AI Matches Doctors in Mapping Lung Tumor…

In radiation therapy, precision can save lives. Oncologists must carefully map the size and location of a tumor before delivering high-dose radiation to destroy cancer cells while sparing healthy tissue...

Meet Your Digital Twin

Before an important meeting or when a big decision needs to be made, we often mentally run through various scenarios before settling on the best course of action. But when...