New AI Tool Mimics Radiologist Gaze to Read Chest X-Rays

Artificial intelligence (AI) can scan a chest X-ray and diagnose if an abnormality is fluid in the lungs, an enlarged heart or cancer. But being right is not enough, said Ngan Le, a University of Arkansas assistant professor of computer science and computer engineering. We should understand how the computer makes its diagnosis, yet most AI systems are black boxes whose "thought process" even their creators cannot explain.

"When people understand the reasoning process and limitations behind AI decisions, they are more likely to trust and embrace the technology," Le said.

Le and her colleagues developed a transparent, and highly accurate, AI framework for reading chest X-rays called ItpCtrl-AI, which stands for interpretable and controllable artificial intelligence.

The team explained their approach in "ItpCtrl-AI: End-to-end interpretable and controllable artificial intelligence by modeling radiologists’ intentions," published in the current issue of Artificial Intelligence in Medicine.

The researchers taught the computer to look at chest X-rays like a radiologist. The gaze of radiologists, both where they looked and how long they focused on a specific area, was recorded as they reviewed chest X-rays. The heat map created from that eye-gaze dataset showed the computer where to search for abnormalities and what section of the image required less attention.

Creating an AI framework that uses a clear, transparent method to reach conclusions - in this case a gaze heat map - helps researchers adjust and correct the computer so it can provide more accurate results. In a medical context, transparency also bolsters the trust of doctors and patients in an AI-generated diagnosis.

"If an AI medical assistant system diagnoses a condition, doctors need to understand why it made that decision to ensure it is reliable and aligns with medical expertise," Le said.

A transparent AI framework is also more accountable, a legal and ethical concern in areas with high stakes, such as medicine, self-driving vehicles or financial markets. Because doctors know how ItpCtrl-AI works, they can take responsibility for its diagnosis.

"If we don't know how a system is making decisions, it’s challenging to ensure it is fair, unbiased, or aligned with societal values," Le said.

Le and her team, in collaboration with the MD Anderson Cancer Center in Houston, are now working to refine ItpCtrl-AI so it can read more complex, three-dimensional CT scans.

Trong-Thang Pham, Jacob Brecheisen, Carol C. Wu, Hien Nguyen, Zhigang Deng, Donald Adjeroh, Gianfranco Doretto, Arabinda Choudhary, Ngan Le.
ItpCtrl-AI: End-to-end interpretable and controllable artificial intelligence by modeling radiologists' intentions.
Artificial Intelligence in Medicine, 2025. doi: 10.1016/j.artmed.2024.103054

Most Popular Now

Should AI Chatbots Replace Your Therapis…

The new study exposes the dangerous flaws in using artificial intelligence (AI) chatbots for mental health support. For the first time, the researchers evaluated these AI systems against clinical standards...

AI could Help Pathologists Match Cancer …

A new study by researchers at the Icahn School of Medicine at Mount Sinai, Memorial Sloan Kettering Cancer Center, and collaborators, suggests that artificial intelligence (AI) could significantly improve how...

AI Detects Early Signs of Osteoporosis f…

Investigators have developed an artificial intelligence-assisted diagnostic system that can estimate bone mineral density in both the lumbar spine and the femur of the upper leg, based on X-ray images...

AI Tool Detects Surgical Site Infections…

A team of Mayo Clinic researchers has developed an artificial intelligence (AI) system that can detect surgical site infections (SSIs) with high accuracy from patient-submitted postoperative wound photos, potentially transforming...

AI Sharpens Pathologists' Interpret…

Pathologists' examinations of tissue samples from skin cancer tumours improved when they were assisted by an AI tool. The assessments became more consistent and patients' prognoses were described more accurately...

Meet Your Digital Twin

Before an important meeting or when a big decision needs to be made, we often mentally run through various scenarios before settling on the best course of action. But when...

NHS National Rehabilitation Centre to De…

The new NHS National Rehabilitation Centre will deploy technology to help patients to maintain their independence as they recover from life-changing injuries and illnesses and regain quality of life. Airwave Healthcare...

AI Finds Hundreds of Potential Antibioti…

Snake, scorpion, and spider venom are most frequently associated with poisonous bites, but with the help of artificial intelligence, they might be able to help fight antibiotic resistance, which contributes...

AI Tool Accurately Detects Tumor Locatio…

An AI model trained to detect abnormalities on breast MR images accurately depicted tumor locations and outperformed benchmark models when tested in three different groups, according to a study published...

AI can Accelerate Search for More Effect…

Scientists have used an AI model to reassess the results of a completed clinical trial for an Alzheimer’s disease drug. They found the drug slowed cognitive decline by 46% in...

AI Accurately Classifies Pancreatic Cyst…

Artificial intelligence (AI) models such as ChatGPT are designed to rapidly process data. Using the AI ChatGPT-4 platform to extract and analyze specific data points from the Magnetic Resonance Imaging...

Free AI Tools can Help Doctors Read Medi…

A new study from the University of Colorado Anschutz Medical Campus shows that free, open-source artificial intelligence (AI) tools can help doctors report medical scans just as well as more...