Dr. AI, What's My Diagnosis?

One in nine women in the developed world will be diagnosed with breast cancer at some point in her life. The prevalence of breast cancer is increasing, an effect caused in part by the modern lifestyle and increased lifespans. Thankfully, treatments are becoming more efficient and more personalized. However, what isn't increasing - and is in fact decreasing - is the number of pathologists, or the doctors whose specialization is examining body tissues to provide the specific diagnosis necessary for personalized medicine. A team of researchers at the Technion - Israel Institute of Technology have therefore made it their quest to turn computers into effective pathologists’ assistants, simplifying and improving the human doctor's work. Their new study was recently published in Nature Communications.

The specific task that Dr. Gil Shamai and Amir Livne from the lab of Professor Ron Kimmel from the Henry and Marilyn Taub Faculty of Computer Science at the Technion set out to achieve lies within the realm of immunotherapy. Immunotherapy has been gaining prominence in recent years as an effective, sometimes even game-changing, treatment for several types of cancer. The basis of this form of therapy is encouraging the body's own immune system to attack the tumor. However, such therapy needs to be personalized as the correct medication must be administered to the patients who stand to benefit from it based on the specific characteristics of the tumor.

Multiple natural mechanisms prevent our immune systems from attacking our own bodies. These mechanisms are often exploited by cancer tumors to evade the immune system. One such mechanism is related to the PD-L1 protein - some tumors display it, and it acts as a sort of password by erroneously convincing the immune system that the cancer should not be attacked. Specific immunotherapy for PD-L1 can persuade the immune system to ignore this particular password, but of course would only be effective when the tumor expresses the PD-L1.

It is a pathologist's task to determine whether a patient’s tumor expresses PD-L1. Expensive chemical markers are used to stain a biopsy taken from the tumor in order to obtain the answer. The process is non-trivial, time-consuming, and at times inconsistent. Dr. Shamai and his team took a different approach. In recent years, it has become an FDA-approved practice for biopsies to be scanned so they can be used for digital pathological analysis. Amir Livne, Dr. Shamai and Prof. Kimmel decided to see if a neural network could use these scans to make the diagnosis without requiring additional processes. "They told us it couldn’t be done," the team said, "so of course, we had to prove them wrong."

Neural networks are trained in a manner similar to how children learn: they are presented with multiple tagged examples. A child is shown many dogs and various other things, and from these examples forms an idea of what "dog" is. The neural network Prof. Kimmel's team developed was presented with digital biopsy images from 3,376 patients that were tagged as either expressing or not expressing PD-L1. After preliminary validation, it was asked to determine whether additional clinical trial biopsy images from 275 patients were positive or negative for PD-L1. It performed better than expected: for 70% of the patients, it was able to confidently and correctly determine the answer. For the remaining 30% of the patients, the program could not find the visual patterns that would enable it to decide one way or the other. Interestingly, in the cases where the artificial intelligence (AI) disagreed with the human pathologist’s determination, a second test proved the AI to be right.

"This is a momentous achievement," Prof. Kimmel explained. "The variations that the computer found - they are not distinguishable to the human eye. Cells arrange themselves differently if they present PD-L1 or not, but the differences are so small that even a trained pathologist can’t confidently identify them. Now our neural network can."

This achievement is the work of a team comprised of Dr. Gil Shamai and graduate student Amir Livne, who developed the technology and designed the experiments, Dr. António Polónia from the Institute of Molecular Pathology and Immunology of the University of Porto, Portugal, Professor Edmond Sabo and Dr. Alexandra Cretu from Carmel Medical Center in Haifa, Israel, who are expert pathologists that conducted the research, and with the support of Professor Gil Bar-Sela, head of oncology and hematology division at Haemek Medical Center in Afula, Israel.

"It's an amazing opportunity to bring together artificial intelligence and medicine," Dr. Shamai said. "I love mathematics, I love developing algorithms. Being able to use my skills to help people, to advance medicine - it's more than I expected when I started out as a computer science student." He is now leading a team of 15 researchers, who are taking this project to the next level.

"We expect AI to become a powerful tool in doctors' hands," shared Prof. Kimmel. "AI can assist in making or verifying a diagnosis, it can help match the treatment to the individual patient, it can offer a prognosis. I do not think it can, or should, replace the human doctor. But it can make some elements of doctors’ work simpler, faster, and more precise."

Shamai G, Livne A, Polónia A, Sabo E, Cretu A, Bar-Sela G, Kimmel R.
Deep learning-based image analysis predicts PD-L1 status from H&E-stained histopathology images in breast cancer.
Nat Commun. 2022 Nov 8;13(1):6753. doi: 10.1038/s41467-022-34275-9

Most Popular Now

AI-Powered CRISPR could Lead to Faster G…

Stanford Medicine researchers have developed an artificial intelligence (AI) tool to help scientists better plan gene-editing experiments. The technology, CRISPR-GPT, acts as a gene-editing “copilot” supported by AI to help...

Groundbreaking AI Aims to Speed Lifesavi…

To solve a problem, we have to see it clearly. Whether it’s an infection by a novel virus or memory-stealing plaques forming in the brains of Alzheimer’s patients, visualizing disease processes...

AI Spots Hidden Signs of Depression in S…

Depression is one of the most common mental health challenges, but its early signs are often overlooked. It is often linked to reduced facial expressivity. However, whether mild depression or...

ChatGPT 4o Therapeutic Chatbot 'Ama…

One of the first randomized controlled trials assessing the effectiveness of a large language model (LLM) chatbot 'Amanda' for relationship support shows that a single session of chatbot therapy...

AI Tools Help Predict Severe Asthma Risk…

Mayo Clinic researchers have developed artificial intelligence (AI) tools that help identify which children with asthma face the highest risk of serious asthma exacerbation and acute respiratory infections. The study...

AI Model Forecasts Disease Risk Decades …

Imagine a future where your medical history could help predict what health conditions you might face in the next two decades. Researchers have developed a generative AI model that uses...

AI Model Indicates Four out of Ten Breas…

A project at Lund University in Sweden has trained an AI model to identify breast cancer patients who could be spared from axillary surgery. The model analyses previously unutilised information...

AI Distinguishes Glioblastoma from Look-…

A Harvard Medical School–led research team has developed an AI tool that can reliably tell apart two look-alike cancers found in the brain but with different origins, behaviors, and treatments. The...

Smart Device Uses AI and Bioelectronics …

As a wound heals, it goes through several stages: clotting to stop bleeding, immune system response, scabbing, and scarring. A wearable device called "a-Heal," designed by engineers at the University...

Overcoming the AI Applicability Crisis a…

Opinion Article by Harry Lykostratis, Chief Executive, Open Medical. The government’s 10 Year Health Plan makes a lot of the potential of AI-software to support clinical decision making, improve productivity, and...

Dartford and Gravesham Implements Clinis…

Dartford and Gravesham NHS Trust has taken a significant step towards a more digital future by rolling out electronic test ordering using Clinisys ICE. The trust deployed the order communications...