Skin Cancer Diagnoses Using AI Are as Reliable as those Made by Medical Experts

Artificial intelligence (AI) is already widely used in medical diagnostics. An Austrian-Australian research team led by dermatologist Harald Kittler from MedUni Vienna investigated the extent to which diagnosis and therapy of pigmented skin lesions benefit from it in a realistic clinical scenario. In a study published by The Lancet Digital Health, the team compared the accuracy in diagnosis and therapy recommendation of two different algorithms in smartphone applications with that of doctors. The results show that the AI application generally performs well in diagnosis. However, doctors were clearly superior when it came to treatment decisions.

The research team tested the AI application under realistic clinical conditions in two skin cancer centres, the University Department of Dermatology at MedUni Vienna and the Sydney Melanoma Diagnostic Centre in Australia. The prospective study consisted of two scenarios, with AI being used in scenario A for changes suspicious of skin cancer and in scenario B for patients with many moles. The AI-assisted application was compared in both cases with both medical experts and less experienced physicians.

In scenario A, 172 suspicious pigmented lesions (of which 84 were malignant) were examined in 124 patients; in scenario B, the research team analysed 5,696 pigmented lesions (of which 18 were malignant) in 66 patients. Two different AI-based smartphone applications were used: a novel 7-class AI algorithm and an ISIC algorithm already used in retrospective preliminary studies. In scenario A, the 7-class AI algorithm showed equivalent diagnostic accuracy compared to the experts while it was significantly superior to the less experienced physicians. The ISIC algorithm, on the other hand, performed significantly worse compared to experts, but better than the inexperienced users.

A critical view of AI decisions

In terms of treatment decisions, the 7-class algorithm was significantly inferior to the experts but superior to the inexperienced users. The results suggest that an AI-assisted smartphone application for skin cancer diagnosis makes similarly good diagnostic decisions as experts in a real clinical scenario. When it came to treatment decisions, however, the experts were superior to the AI. Kittler: "The AI application tends to remove more benign lesions in the treatment recommendation than experts would. If you take this into account, the AI application can certainly be used. It should also be borne in mind that if it is used uncritically, too many false-positive findings would have to be clarified."

Menzies SW, Sinz C, Menzies M, Lo SN, Yolland W, Lingohr J, Razmara M, Tschandl P, Guitera P, Scolyer RA, Boltz F, Borik-Heil L, Herbert Chan H, Chromy D, Coker DJ, Collgros H, Eghtedari M, Corral Forteza M, Forward E, Gallo B, Geisler S, Gibson M, Hampel A, Ho G, Junez L, Kienzl P, Martin A, Moloney FJ, Regio Pereira A, Ressler JM, Richter S, Silic K, Silly T, Skoll M, Tittes J, Weber P, Weninger W, Weiss D, Woo-Sampson P, Zilberg C, Kittler H.
Comparison of humans versus mobile phone-powered artificial intelligence for the diagnosis and management of pigmented skin cancer in secondary care: a multicentre, prospective, diagnostic, clinical trial.
Lancet Digit Health. 2023 Oct;5(10):e679-e691. doi: 10.1016/S2589-7500(23)00130-9

Most Popular Now

Collective Intelligence can Help Reduce …

An estimated 250,000 people die from preventable medical errors in the U.S. each year. Many of these errors originate during the diagnostic process. A powerful way to increase diagnostic accuracy...

New Study Suggests ECG-AI can Detect Car…

Artificial intelligence (AI) from patient electrocardiograms (ECGs) may be an innovative solution to enhance heart disease risk assessment. Atherosclerotic cardiovascular disease - arteries narrowed or blocked by the accumulation of...

Software Created from 'Building Blo…

New 'building-block' approaches to the creation of digital tools which include data and artificial intelligence (AI) could play a key role in improving the running of hospital wards and disease...

How could Technology Better Support Pati…

The NHS exists to serve patients. But more could be done to make their experience a key focus when it comes to technology adoption, senior NHS delegates told a recent...

"Showtime" for Digital Health …

13 - 16 November 2023, Düsseldorf, Germany. A hundred start-ups and more than 120 high-calibre professional speakers: These are just the "naked" facts which this year's MEDICA CONNECTED HEALTHCARE FORUM will...

Artificial Intelligence: Unexpected Resu…

Artificial intelligence (AI) is on the rise. Until now, AI applications generally have "black box" character: How AI arrives at its results remains hidden. Prof. Dr. Jürgen Bajorath, a cheminformatics...

Philips Program Developing AI-Powered Ul…

Royal Philips (NYSE: PHG, AEX: PHIA), a global leader in health technology, today announced it has received a second round of funding from the Bill & Melinda Gates Foundation to...

CGM Continues to Drive Digitization in H…

CompuGroup Medical SE & Co. KGaA (CGM), one of the world's leading e-health providers, successfully progressed the digitization in healthcare during the first three quarters in 2023. CGM supports physicians...

Wolverhampton's New 10-Year EPR Dea…

The Royal Wolverhampton NHS Trust (RWT) has just signed a 10-year contract with System C for an integrated electronic patient record (EPR) system, which will replace the trust's in-house built...

Printed Robots with Bones, Ligaments, an…

3D printing is advancing rapidly, and the range of materials that can be used has expanded considerably. While the technology was previously limited to fast-curing plastics, it has now been...

Orchestrating the New World of AI in Hea…

Orion Health's UK and Ireland Customer Conference 2023 focused on the future potential and immediate, practical application of AI to healthcare - and gave delegates a first look at the...

Researchers Take New AI Approach to Anal…

Researchers at Karolinska Institutet and SciLifeLab in Sweden have combined artificial intelligence (AI) techniques used in satellite imaging and community ecology to interpret large amounts of data from tumour tissue...