We could Soon Use AI to Detect Brain Tumors

A new paper in Biology Methods and Protocols, published by Oxford University Press, shows that scientists can train artificial intelligence (AI) models to distinguish brain tumors from healthy tissue. AI models can already find brain tumors in MRI images almost as well as a human radiologist.

Researchers have made sustained progress in artificial intelligence (AI) for use in medicine. AI is particularly promising in radiology, where waiting for technicians to process medical images can delay patient treatment. Convolutional neural networks are powerful tools that allow researchers to train AI models on large image datasets to recognize and classify images. In this way the networks can "learn" to distinguish between pictures. The networks also have the capacity for "transfer learning." Scientists can reuse a model trained on one task for a new, related project.

Although detecting camouflaged animals and classifying brain tumors involves very different sorts of images, the researchers involved in this study believed that there was a parallel between an animal hiding through natural camouflage and a group of cancerous cells blending in with the surrounding healthy tissue. The learned process of generalization - the grouping of different things under the same object identity - is essential to understanding how network can detect camouflaged objects. Such training could be particularly useful for detecting tumors.

In this retrospective study of public domain MRI data, the researchers investigated how neural network models can be trained on brain cancer imaging data while introducing a unique camouflage animal detection transfer learning step to improve the networks' tumor detection skills.

Using MRIs from public online repositories of cancerous and healthy control brains (from sources including Kaggle, the Cancer Imaging Archive of NIH National Cancer Institute, and VA Boston Healthcare System), the researchers trained the networks to distinguish healthy vs cancerous MRIs, the area affected by cancer, and the cancer appearance prototype (what type of cancer it looks like). The researchers found that the networks were almost perfect at detecting normal brain images, with only 1-2 false negatives, and distinguishing between cancerous and healthy brains. The first network had an average accuracy of 85.99% at detecting brain cancer, the other had an accuracy rate of 83.85%.

A key feature of the network is the multitude of ways in which its decisions can be explained, allowing for increased trust in the models from medical professionals and patients alike. Deep models often lack transparency, and as the field grows the ability to explain how networks perform their decisions becomes important. Following this research, the network can generate images that show specific areas in its tumor-positive or negative classification. This would allow radiologists to cross-validate their own decisions with those of the network and add confidence, almost like a second robotic radiologist who can show the telltale area of an MRI that indicates a tumor. In the future, the researchers here believe it will be important to focus on creating deep network models whose decisions can be described in intuitive ways, so artificial intelligence can occupy a transparent supporting role in clinical environments.

While the networks struggled more to distinguish between types of brain cancer in all cases, it was still clear they had distinct internal representation in the network. The accuracy and clarity improved as the researchers trained the networks in camouflage detection. Transfer learning led to an increase in accuracy for the networks.

While the best performing proposed model was about 6% less accurate than standard human detection, the research successfully demonstrates the quantitative improvement brought on by this training paradigm. The researchers here believe that this paradigm, combined with the comprehensive application of explainability methods, promotes necessary transparency in future clinical AI research.

"Advances in AI permit more accurate detection and recognition of patterns," said the paper's lead author, Arash Yazdanbakhsh. "This consequently allows for better imaging-based diagnosis aid and screening, but also necessitate more explanation for how AI accomplishes the task. Aiming for AI explainability enhances communication between humans and AI in general. This is particularly important between medical professionals and AI designed for medical purposes. Clear and explainable models are better positioned to assist diagnosis, track disease progression, and monitor treatment."

Faris Rustom, Ezekiel Moroze, Pedram Parva, Haluk Ogmen, Arash Yazdanbakhsh.
Deep learning and transfer learning for brain tumor detection and classification.
Biology Methods and Protocols, 2024. doi: 10.1093/biomethods/bpae080

Most Popular Now

Philips Foundation 2024 Annual Report: E…

Marking its tenth anniversary, Philips Foundation released its 2024 Annual Report, highlighting a year in which the Philips Foundation helped provide access to quality healthcare for 46.5 million people around...

Giving Doctors an AI-Powered Head Start …

Detection of melanoma and a range of other skin diseases will be faster and more accurate with a new artificial intelligence (AI) powered tool that analyses multiple imaging types simultaneously...

Scientists Argue for More FDA Oversight …

An agile, transparent, and ethics-driven oversight system is needed for the U.S. Food and Drug Administration (FDA) to balance innovation with patient safety when it comes to artificial intelligence-driven medical...

New AI Transforms Radiology with Speed, …

A first-of-its-kind generative AI system, developed in-house at Northwestern Medicine, is revolutionizing radiology - boosting productivity, identifying life-threatening conditions in milliseconds and offering a breakthrough solution to the global radiologist...

AI Agents for Oncology

Clinical decision-making in oncology is challenging and requires the analysis of various data types - from medical imaging and genetic information to patient records and treatment guidelines. To effectively support...

Start-ups in the Spotlight at MEDICA 202…

17 - 20 November 2025, Düsseldorf, Germany. MEDICA, the leading international trade fair and platform for healthcare innovations, will once again confirm its position as the world's number one hotspot for...

AI Medical Receptionist Modernizing Doct…

A virtual medical receptionist named "Cassie," developed through research at Texas A&M University, is transforming the way patients interact with health care providers. Cassie is a digital-human assistant created by Humanate...

AI Detects Hidden Heart Disease Using Ex…

Mass General Brigham researchers have developed a new AI tool in collaboration with the United States Department of Veterans Affairs (VA) to probe through previously collected CT scans and identify...

Using Data and AI to Create Better Healt…

Academic medical centers could transform patient care by adopting principles from learning health systems principles, according to researchers from Weill Cornell Medicine and the University of California, San Diego. In...

AI Tool Set to Transform Characterisatio…

A multinational team of researchers, co-led by the Garvan Institute of Medical Research, has developed and tested a new AI tool to better characterise the diversity of individual cells within...

Human-AI Collectives Make the Most Accur…

Diagnostic errors are among the most serious problems in everyday medical practice. AI systems - especially large language models (LLMs) like ChatGPT-4, Gemini, or Claude 3 - offer new ways...

Highland Marketing Announced as Official…

Highland Marketing has been named, for the second year running, the official communications partner for HETT Show 2025, the UK's leading digital health conference and exhibition. Taking place 7-8 October...