The researchers based their study on the reinforcement learning (RL) model and integrated (human) criteria in the form of "reward tables" into the AI system. Reward tables are tools that incorporate the positive and negative consequences of clinical assessments into the decision-making process from both the physician's and the patient's perspective. On this basis, AI diagnosis results were not only rated as right or wrong, but were "rewarded" or "penalized" with a certain number of plus or minus points depending on the impact of the diagnosis or the resulting decisions.
"In this way, the AI learned to take into account not only image-based features, but also consequences of misdiagnosis in the assessment of benign and malignant skin manifestations," clarifies study leader Harald Kittler from the Department of Dermatology at MedUni Vienna. As a result, as the study shows, the accuracy of the diagnosis of skin cancer could be significantly improved: The sensitivity for melanoma, for example, was increased from 61.4 to 79.5 percent and for basal cell carcinoma from 79.4 to 87.1 percent. Overall, the use of RL increased the rate of correct diagnoses made by dermatologists by 12 percent, while the rate of optimal decisions for management and therapy of the disease increased from 57.4 to 65.3 percent.
Such improved performance of AI-based skin cancer diagnosis is also because RL reduces the AI's overconfidence in its own predictions and makes more nuanced and human-compatible suggestions. "This, in turn, helps physicians make more accurate decisions tailored to individual patients in complex medical scenarios," Harald Kittler emphasized ahead of further research on the topic. Although the current work focused mainly on skin cancer diagnosis, the basic ideas could also be used in other areas of medical decision-making.
Barata C, Rotemberg V, Codella NCF, Tschandl P, Rinner C, Akay BN, Apalla Z, Argenziano G, Halpern A, Lallas A, Longo C, Malvehy J, Puig S, Rosendahl C, Soyer HP, Zalaudek I, Kittler H.
A reinforcement learning model for AI-based decision support in skin cancer.
Nat Med. 2023 Jul 27. doi: 10.1038/s41591-023-02475-5