AI Predicts Cancer Patient Survival by Reading Doctor's Notes

A team of researchers from the University of British Columbia and BC Cancer have developed an artificial intelligence (AI) model that predicts cancer patient survival more accurately and with more readily available data than previous tools.

The model uses natural language processing (NLP) - a branch of AI that understands complex human language - to analyze oncologist notes following a patient’s initial consultation visit - the first step in the cancer journey after diagnosis. By identifying characteristics unique to each patient, the model was shown to predict six-month, 36-month and 60-month survival with greater than 80 per cent accuracy. The findings were published today in JAMA Network Open.

"Predicting cancer survival is an important factor that can be used to improve cancer care," said lead author Dr. John-Jose Nunez, a psychiatrist and clinical research fellow with the UBC Mood Disorders Centre and BC Cancer. "It might suggest health providers make an earlier referral to support services or offer a more aggressive treatment option upfront. Our hope is that a tool like this could be used to personalize and optimize the care a patient receives right away, giving them the best outcome possible."

Traditionally, cancer survival rates have been calculated retrospectively and categorized by only a few generic factors such as cancer site and tissue type. Despite familiarity with these rates, it can be challenging for oncologists to accurately predict an individual patient’s survival due to the many complex factors that influence patient outcomes.

The model developed by Dr. Nunez and his collaborators, which includes researchers from BC Cancer and UBC’s departments of computer science and psychiatry, is able to pick up on unique clues within a patient’s initial consultation document to provide a more nuanced assessment. It is also applicable to all cancers, whereas previous models have been limited to certain cancer types.

"The AI essentially reads the consultation document similar to how a human would read it," said Dr. Nunez. "These documents have many details like the age of the patient, the type of cancer, underlying health conditions, past substance use, and family histories. The AI brings all of this together to paint a more complete picture of patient outcomes."

The researchers trained and tested the model using data from 47,625 patients across all six BC Cancer sites located across British Columbia. To protect privacy, all patient data remained stored securely at BC Cancer and was presented anonymously. Unlike chart reviews by human research assistants, the new AI approach has the added benefit of maintaining complete confidentiality of patient records.

"Because the model is trained on B.C. data, that makes it a potentially powerful tool for predicting cancer survival here in the province," said Dr. Nunez.

In the future, the technology could be applied in cancer clinics across Canada and around the world.

"The great thing about neural NLP models is that they are highly scalable, portable and don’t require structured data sets," said Dr. Nunez. "We can quickly train these models using local data to improve performance in a new region. I would suspect that these models provide a good foundation anywhere in the world where patients are able to see an oncologist."

Dr. Nunez is a recipient of the 2022/23 UBC Institute of Mental Health Marshall Fellowship, and is also supported by funding from the BC Cancer Foundation. In another stream of work, Dr. Nunez is examining how to facilitate the best-possible psychiatric and counselling care for cancer patients using advanced AI techniques. He envisions a future where AI is integrated into many aspects of the health system to improve patient care.

"I see AI acting almost like a virtual assistant for physicians," said Dr. Nunez. "As medicine gets more and more advanced, having AI to help sort through and make sense of all the data will help inform physician decisions. Ultimately, this will help improve quality of life and outcomes for patients."

Nunez JJ, Leung B, Ho C, Bates AT, Ng RT.
Predicting the Survival of Patients With Cancer From Their Initial Oncology Consultation Document Using Natural Language Processing.
JAMA Netw Open. 2023 Feb 1;6(2):e230813. doi: 10.1001/jamanetworkopen.2023.0813

Most Popular Now

Collective Intelligence can Help Reduce …

An estimated 250,000 people die from preventable medical errors in the U.S. each year. Many of these errors originate during the diagnostic process. A powerful way to increase diagnostic accuracy...

Software Created from 'Building Blo…

New 'building-block' approaches to the creation of digital tools which include data and artificial intelligence (AI) could play a key role in improving the running of hospital wards and disease...

How could Technology Better Support Pati…

The NHS exists to serve patients. But more could be done to make their experience a key focus when it comes to technology adoption, senior NHS delegates told a recent...

"Showtime" for Digital Health …

13 - 16 November 2023, Düsseldorf, Germany. A hundred start-ups and more than 120 high-calibre professional speakers: These are just the "naked" facts which this year's MEDICA CONNECTED HEALTHCARE FORUM will...

Artificial Intelligence: Unexpected Resu…

Artificial intelligence (AI) is on the rise. Until now, AI applications generally have "black box" character: How AI arrives at its results remains hidden. Prof. Dr. Jürgen Bajorath, a cheminformatics...

Philips Program Developing AI-Powered Ul…

Royal Philips (NYSE: PHG, AEX: PHIA), a global leader in health technology, today announced it has received a second round of funding from the Bill & Melinda Gates Foundation to...

CGM Continues to Drive Digitization in H…

CompuGroup Medical SE & Co. KGaA (CGM), one of the world's leading e-health providers, successfully progressed the digitization in healthcare during the first three quarters in 2023. CGM supports physicians...

Wolverhampton's New 10-Year EPR Dea…

The Royal Wolverhampton NHS Trust (RWT) has just signed a 10-year contract with System C for an integrated electronic patient record (EPR) system, which will replace the trust's in-house built...

Printed Robots with Bones, Ligaments, an…

3D printing is advancing rapidly, and the range of materials that can be used has expanded considerably. While the technology was previously limited to fast-curing plastics, it has now been...

Orchestrating the New World of AI in Hea…

Orion Health's UK and Ireland Customer Conference 2023 focused on the future potential and immediate, practical application of AI to healthcare - and gave delegates a first look at the...

Researchers Take New AI Approach to Anal…

Researchers at Karolinska Institutet and SciLifeLab in Sweden have combined artificial intelligence (AI) techniques used in satellite imaging and community ecology to interpret large amounts of data from tumour tissue...

AI identifies Non-Smokers at High Risk f…

Using a routine chest X-ray image, an artificial intelligence (AI) tool can identify non-smokers who are at high risk for lung cancer, according to a study being presented next week...