New Framework for Using AI in health Care Considers Medical Knowledge, Practices, Procedures, Values

Health care organizations are looking to artificial intelligence (AI) tools to improve patient care, but their translation into clinical settings has been inconsistent, in part because evaluating AI in health care remains challenging. In a new article, researchers propose a framework for using AI that includes practical guidance for applying values and that incorporates not just the tool's properties but the systems surrounding its use.

The article was written by researchers at Carnegie Mellon University, The Hospital for Sick Children, the Dalla Lana School of Public Health, Columbia University, and the University of Toronto. It is published in Patterns.

"Regulatory guidelines and institutional approaches have focused narrowly on the performance of AI tools, neglecting knowledge, practices, and procedures necessary to integrate the model within the larger social systems of medical practice," explains Alex John London, K&L Gates Professor of Ethics and Computational Technologies at Carnegie Mellon, who coauthored the article. "Tools are not neutral - they reflect our values - so how they work reflects the people, processes, and environments in which they are put to work."

London is also Director of Carnegie Mellon's Center for Ethics and Policy and Chief Ethicist at Carnegie Mellon's Block Center for Technology and Society as well as a faculty member in CMU's Department of Philosophy.

London and his coauthors advocate for a conceptual shift in which AI tools are viewed as parts of a larger "intervention ensemble," a set of knowledge, practices, and procedures that are necessary to deliver care to patients. In previous work with other colleagues, London has applied this concept to pharmaceuticals and to autonomous vehicles. The approach treats AI tools as "sociotechnical systems," and the authors' proposed framework seeks to advance the responsible integration of AI systems into health care.

Previous work in this area has been largely descriptive, explaining how AI systems interact with human systems. The framework proposed by London and his colleagues is proactive, providing guidance to designers, funders, and users about how to ensure that AI systems can be integrated into workflows with the greatest potential to help patients. Their approach can also be used for regulation and institutional insights, as well as for appraising, evaluating, and using AI tools responsibly and ethically. To illustrate their framework, the authors apply it to the development of AI systems developed for diagnosing more than mild diabetic retinopathy.

"Only a small majority of models evaluated through clinical trials have shown a net benefit," says Melissa McCradden, a Bioethicist at the Hospital for Sick Children and Assistant Professor of Clinical and Public Health at the Dalla Lana School of Public Health, who coauthored the article. "We hope our proposed framework lends precision to evaluation and interests regulatory bodies exploring the kinds of evidence needed to support the oversight of AI systems."

Melissa D McCradden, Shalmali Joshi, James A Anderson, Alex John London. A normative framework for artificial intelligence as a sociotechnical system in healthcare.
Patterns, 2023. doi: 10.1016/j.patter.2023.100864

Most Popular Now

Generative AI's Diagnostic Capabili…

The use of generative AI for diagnostics has attracted attention in the medical field and many research papers have been published on this topic. However, because the evaluation criteria were...

Diagnoses and Treatment Recommendations …

A new study led by Prof. Dan Zeltzer, a digital health expert from the Berglas School of Economics at Tel Aviv University, compared the quality of diagnostic and treatment recommendations...

Surrey and Sussex Healthcare NHS Trust g…

Surrey and Sussex Healthcare NHS Trust has marked an important milestone in connecting busy radiologists across large parts of South East England, following the successful go live of Sectra's enterprise...

AI Tool Helps Predict Relapse of Pediatr…

Artificial intelligence (AI) shows tremendous promise for analyzing vast medical imaging datasets and identifying patterns that may be missed by human observers. AI-assisted interpretation of brain scans may help improve...

Detecting Lung Cancer 4 Months Earlier a…

GPs may soon be able to identify patients with an increased risk of lung cancer up to 4 months earlier than is currently the case. The GP should be able...

Infectious Disease Surveillance Platform…

The Biothreats Emergence, Analysis and Communications Network (BEACON) leverages advanced artificial intelligence (AI), large language models (LLMs) and a network of globally based experts to rapidly collect, analyze, and disseminate...

NHS, Councils, and Housing could Share N…

A new technology partnership formally announced, could help NHS, local government, and housing organisations collaborate to create an unprecedented understanding of the risks and needs of people in their care...

AI-Powered Analysis of Stent Healing

Each year, more than three million people worldwide are treated with stents to open blocked blood vessels caused by heart disease. However, monitoring the healing process after implantation remains a...

Children's Health Ireland to Transf…

Healthcare teams responsible for paediatric care in Ireland are to save significant time in accessing important diagnostic imaging and reports, with the help of a new agreement with medical imaging...

An AI Tool Grounded in Evidence-Based Me…

A powerful clinical artificial intelligence tool developed by University at Buffalo biomedical informatics researchers has demonstrated remarkable accuracy on all three parts of the United States Medical Licensing Exam (Step...

Right Patient, Right Dose, Right Time

While artificial intelligence (AI) has shown promising potential, much of its use has remained theoretical or retrospective. Turning its potential into real-world healthcare outcomes, researchers at the Yong Loo Lin...

AXREM and BHTA Name Highland as 'Fu…

Hosted by trade associations AXREM and the British Healthcare Trades Association (BHTA), 'The Future of MedTech - Innovating for Tomorrow', will allow delegates to engage with speakers from the government...