Augmented Reality may Assist Cardiologists Plan and Perform Complex Procedures

Augmented reality (AR), a technology that superimposes computer-generated information on a user's view of the real world, offers a new platform to help physicians better visualize complex medical data, particularly before and during medical procedures. A new self-contained AR device aims to provide an immersive AR experience in which surgeons can interactively explore data in three dimensions.

Jihye Jang, a PhD Candidate at the Cardiac Magnetic Resonance (MR) Center at Beth Israel Deaconess Medical Center (BIDMC), and colleagues assessed AR's potential to help cardiologists visualize myocardial scarring in the heart as they perform ventricular tachycardia ablation or other electrophysiological interventions. Myocardial scarring can occur in people who experience a heart attack and also stems from the surgical repair of congenital heart disease. The team's findings, published in PLOS ONE, demonstrate that the new augmented reality technology confers a number of advantages.

"Augmented reality allows physicians to superimpose images, such as MRI or CT scans, as a guide during therapeutic intervention," said Jang. "Our report shows exciting potential that having this complex 3D scar information through augmented reality during the intervention may help guide treatment and ultimately improve patient care. Physicians can now use AR to view 3D cardiac MR information with a touchless interaction in sterile environment."

By projecting three dimensional imagery onto a glass screen worn like a diving mask on the surgeon's face, AR provides 3D depth perception and allows surgeons to interact with the medical data without physically touching a screen or computer mouse, maintaining a sterile environment and reducing the risk of infection. In Jang and colleague's pilot study, the researchers applied the augmented reality technique as they generated holographic 3D scar in five animal models that underwent controlled infarction and electrophysiological study.

3D holographic visualization of the scar was performed to assist assessment of the complex 3D scar architecture. An operator and mapping specialist viewed the holographic 3D scar during electrophysiological study, and completed the perceived usefulness questionnaire in the six-item usefulness scale and found it useful to have scar information during the intervention. The user could interactively explore 3D myocardial scar in the augmented reality environment that allows for the combination of holographic 3D LGE data interacting with any real-world environments, such as a surgical suite or patient's body.

"Our report is one of the first efforts to test augmented reality in cardiovascular electrophysiological intervention," said Jang. "Our next steps will expand the use of AR into treatments for arrhythmia by merging the scar information with electrophysiology data."

Jang J, Tschabrunn CM, Barkagan M, Anter E, Menze B, Nezafat R.
Three-dimensional holographic visualization of high-resolution myocardial scar on HoloLens.
PLoS One. 2018 Oct 8;13(10):e0205188. doi: 10.1371/journal.pone.0205188.

Most Popular Now

Philips Foundation 2024 Annual Report: E…

Marking its tenth anniversary, Philips Foundation released its 2024 Annual Report, highlighting a year in which the Philips Foundation helped provide access to quality healthcare for 46.5 million people around...

New AI Transforms Radiology with Speed, …

A first-of-its-kind generative AI system, developed in-house at Northwestern Medicine, is revolutionizing radiology - boosting productivity, identifying life-threatening conditions in milliseconds and offering a breakthrough solution to the global radiologist...

Scientists Argue for More FDA Oversight …

An agile, transparent, and ethics-driven oversight system is needed for the U.S. Food and Drug Administration (FDA) to balance innovation with patient safety when it comes to artificial intelligence-driven medical...

Giving Doctors an AI-Powered Head Start …

Detection of melanoma and a range of other skin diseases will be faster and more accurate with a new artificial intelligence (AI) powered tool that analyses multiple imaging types simultaneously...

New Research Finds Specific Learning Str…

If data used to train artificial intelligence models for medical applications, such as hospitals across the Greater Toronto Area, differs from the real-world data, it could lead to patient harm...

AI Agents for Oncology

Clinical decision-making in oncology is challenging and requires the analysis of various data types - from medical imaging and genetic information to patient records and treatment guidelines. To effectively support...

'AI Scientist' Suggests Combin…

An 'AI scientist', working in collaboration with human scientists, has found that combinations of cheap and safe drugs - used to treat conditions such as high cholesterol and alcohol dependence...

Start-ups in the Spotlight at MEDICA 202…

17 - 20 November 2025, Düsseldorf, Germany. MEDICA, the leading international trade fair and platform for healthcare innovations, will once again confirm its position as the world's number one hotspot for...