Can ChatGPT be Counted On?

A study in the Journal of The National Cancer Institute Cancer Spectrum looked at chatbots and artificial intelligence (AI), as they become popular resources for cancer information. They found these resources give accurate information when asked about common cancer myths and misconceptions. In the first study of its kind, Skyler Johnson, MD, physician-scientist at Huntsman Cancer Institute and assistant professor in the department of radiation oncology at the University of Utah (the U), evaluated the reliability and accuracy of ChatGPT's cancer information.

Using the National Cancer Institute's (NCI) common myths and misconceptions about cancer, Johnson and his team found that 97% of the answers were correct. However, this finding comes with some important caveats, including a concern amongst the team that some of the ChatGPT answers could be interpreted incorrectly. "This could lead to some bad decisions by cancer patients. The team suggested caution when advising patients about whether they should use chatbots for information about cancer," says Johnson.

The study found reviewers were blinded, meaning they didn’t know whether the answers came from the chatbot or the NCI. Though the answers were accurate, reviewers found ChatGPT's language was indirect, vague, and in some cases, unclear.

"I recognize and understand how difficult it can feel for cancer patients and caregivers to access accurate information," says Johnson. "These sources need to be studied so that we can help cancer patients navigate the murky waters that exist in the online information environment as they try to seek answers about their diagnoses."

Incorrect information can harm cancer patients. In a previous study by Johnson and his team published in the Journal of the National Cancer Institute, they found that misinformation was common on social media and had the potential to harm cancer patients.

The next steps are to evaluate how often patients are using chatbots to seek out information about cancer, what questions they are asking, and whether AI chatbots provide accurate answers to uncommon or unusual questions about cancer.

The study was supported by the National Institutes of Health/National Cancer Institute including P30 CA042014 and Huntsman Cancer Foundation.

Johnson SB, King AJ, Warner EL, Aneja S, Kann BH, Bylund CL.
Using ChatGPT to evaluate cancer myths and misconceptions: artificial intelligence and cancer information.
JNCI Cancer Spectr. 2023 Mar 1;7(2):pkad015. doi: 10.1093/jncics/pkad015

Most Popular Now

Northern Lincolnshire and Goole NHS Foun…

Northern Lincolnshire and Goole NHS Foundation Trust (NLAG) has launched new NHS App features to transform the way patients access and manage their appointments within the NHS. The programme, known...

Genomics England Deploys Sectra Imaging …

Genomics England has completed installation of an enterprise imaging system that will help to support a world-pioneering initiative for cancer research. The programme is linking whole genome sequencing, pathology and...

Orion Health Strengthens French Business…

Orion Health is strengthening its presence in France with the appointment of digital health industry heavyweight, Tristan Debove, to lead its operations. Tristan Debove has more than 25 years of experience...

AI Approach may Help Detect Alzheimer's …

Although investigators have made strides in detecting signs of Alzheimer's disease using high-quality brain imaging tests collected as part of research studies, a team at Massachusetts General Hospital (MGH) recently...

AI Predicts Cancer Patient Survival by R…

A team of researchers from the University of British Columbia and BC Cancer have developed an artificial intelligence (AI) model that predicts cancer patient survival more accurately and with more...

Virtual Reality Games can be Used as a T…

Virtual reality gamers (VR game) who finished it faster than their fellow gamers also have higher levels of general intelligence and processing capacity. This was the result of a study...

Will Future Computers Run on Human Brain…

A "biocomputer" powered by human brain cells could be developed within our lifetime, according to Johns Hopkins University researchers who expect such technology to exponentially expand the capabilities of modern...

Detecting Anaemia Earlier in Children Us…

Researchers at UCL and University of Ghana have successfully predicted whether children have anaemia using only a set of smartphone images. The study, published in PLOS ONE, brought together researchers and...

AI can Help Optimize CT Scan X-Ray Radia…

Computed tomography (CT) is one of the most powerful and well-established diagnostic tools available to modern medicine. An increasing number of people have been opting for CT scans, raising concerns...

Study Reveals Smartphone Spyware Apps ar…

Smartphone spyware apps that allow people to spy on each other are not only hard to notice and detect, they also will easily leak the sensitive personal information they...

Orion Health Appoints Mark Hindle as Vic…

Orion Health has appointed Mark Hindle as its new vice president for the UK and Ireland. Mark has joined the leading supplier of digital tools to improve healthcare experience from...