Ask Chat GPT about Your Radiation Oncology Treatment

Cancer patients about to undergo radiation oncology treatment have lots of questions. Could ChatGPT be the best way to get answers?

A new Northwestern Medicine study tested a specially designed ChatGPT to see if it could successfully provide answers to patients' common questions about radiation oncology. Patients may be too overwhelmed to address all their concerns during a clinical visit or forget what the physician told them.

The study showed ChatGPT's responses to 115 common radiation oncology patient questions was on par or exceeded answers from professional societies in terms of accuracy, completeness and conciseness in a majority of cases.

"The goal of this project is to empower patients," said first author Dr. Amulya Yalamanchili, a Northwestern Medicine radiation oncology resident. "This is a really technical field that can be hard to understand. All this information can be overwhelming to patients. If they have cancer in a sensitive area, they may not feel comfortable asking what their life will look like long term. The hope is patients can educate themselves with ChatGPT before and after they see a physician."

The AI may also reduce clinician workload and potentially reduce burnout, Yalamanchili said, as the incidence of newly diagnosed cancer cases climbs and the demands on provider time continue to increase.

The paper will be published April 2 in JAMA Network Open.

More than 60% of cancer patients - 500,000 per year - require some form of radiation oncology treatment, according to the National Cancer Institute.

While ChatGPT performed well overall, several responses were concerning, the scientists said. One was that it used language at a college reading level, which is more complex than professional society websites. The others were that it omitted details about a specialized technology for brain tumors and failed to mention the tiny tattoos sometimes used to position the patient for radiation treatments.

The concerns are being addressed by the Northwestern scientists, who stress that this technology needs ongoing refinement and training in specialized medical domains.

"The study highlights the potential of AI-driven technologies, such as ChatGPT, to provide accurate and comprehensive responses to patient queries in the field of radiation oncology, but we need to make these AI chatbot responses easier for people to understand," said corresponding author Peng (Troy) Teo, an instructor of radiation oncology at Northwestern University Feinberg School of Medicine. "These AI chatbots could serve as valuable tools for assisting health care providers in answering patient questions, particularly in contexts where access to expert advice may be limited."

Next, Northwestern scientists are developing and testing an in-house app using Generative AI to answer patient questions about radiation oncology treatment.

"We're exploring how these advanced AI chat systems can do more than just deliver quick, accurate and personalized information about radiation oncology treatment," said Dr. Bharat Mittal, chair of radiation oncology at Feinberg and a co-author of the paper. "We're also examining how they can be integrated into daily routines of patient care, ensuring care is more efficient and precise."

The title of the article is "Quality of Large Language Model Responses to Radiation Oncology Patient Care Questions."

Yalamanchili A, Sengupta B, Song J, Lim S, Thomas TO, Mittal BB, Abazeed ME, Teo PT.
Quality of Large Language Model Responses to Radiation Oncology Patient Care Questions.
JAMA Netw Open. 2024 Apr 1;7(4):e244630. doi: 10.1001/jamanetworkopen.2024.4630

Most Popular Now

Herefordshire and Worcestershire Health …

Herefordshire and Worcestershire Health and Care NHS Trust has successfully implemented Alcidion's Miya Precision platform to streamline bed management workflow across seven community hospitals in Worcestershire. The trust delivers community...

With Huge Patient Dataset, AI Accurately…

Scientists have designed a new artificial intelligence (AI) model that emulates randomized clinical trials at determining the treatment options most effective at preventing stroke in people with heart disease. The model...

A Shortcut for Drug Discovery

For most human proteins, there are no small molecules known to bind them chemically (so called "ligands"). Ligands frequently represent important starting points for drug development but this knowledge gap...

New Horizon Europe Funding Boosts Europe…

The European Commission has announced the launch of new Horizon Europe calls, with a substantial funding pool of over €112 million. These calls are aimed primarily at pioneering projects in...

Cleveland Clinic Study Finds AI can Deve…

Cleveland Clinic researchers developed an artficial intelligence (AI) model that can determine the best combination and timeline to use when prescribing drugs to treat a bacterial infection, based solely on...

New AI-Technology Estimates Brain Age Us…

As people age, their brains do, too. But if a brain ages prematurely, there is potential for age-related diseases such as mild-cognitive impairment, dementia, or Parkinson's disease. If "brain age...

Radboud University Medical Center and Ph…

Royal Philips (NYSE: PHG, AEX: PHIA), a global leader in health technology, and Radboud University Medical Center have signed a hospital-wide, long-term strategic partnership that delivers the latest patient monitoring...

GPT-4, Google Gemini Fall Short in Breas…

Use of publicly available large language models (LLMs) resulted in changes in breast imaging reports classification that could have a negative effect on patient management, according to a new international...

ChatGPT fails at heart risk assessment

Despite ChatGPT's reported ability to pass medical exams, new research indicates it would be unwise to rely on it for some health assessments, such as whether a patient with chest...

Study Shows ChatGPT Failed when Challeng…

With artificial intelligence (AI) poised to become a fundamental part of clinical research and decision making, many still question the accuracy of ChatGPT, a sophisticated AI language model, to support...

Virtual Reality Shows Promise in Fightin…

A new study published in JMIR Mental Health sheds light on the promising role of virtual reality (VR) in treating major depressive disorder (MDD). Titled "Examining the Efficacy of Extended...

AXREM and Highland Marketing Partner to …

AXREM represents member companies that collectively provide UK hospitals with most of their diagnostic medical imaging technology, and radiotherapy equipment. The association has seen substantial growth in recent years, with membership...