AI Tech should Augment Physician Decision-Making, not Replace It

The use of artificial intelligence (AI) in clinical health care has the potential to transform health care delivery but it should not replace physician decision-making, says the American College of Physicians (ACP) in a new policy paper. "Artificial Intelligence in the Provision of Health Care," published in the Annals of Internal Medicine, offers recommendations on the ethical, scientific, and clinical components of AI use, and says that AI tools and systems should enhance human intelligence, not supplant it.

"AI has the potential to aid in solving some of the issues currently plaguing the health care industry, such as clinician shortages, burnout, and administrative burdens," said Isaac O. Opole, MBChB, PhD, MACP, president, ACP. "However, to ensure that we are able to realize the most benefit, with the fewest harms to patients, we need to fully understand the implications of the technology that we are implementing."

To navigate the risks and ensure best practices, ACP recommends that AI-enabled technology should be limited to a supportive role in clinical decision-making. ACP notes that when being used for clinical decision-making, the technology would more appropriately be called "augmented" intelligence, since the tools should ideally be used to assist clinicians, not replace them. The tools must be developed, tested, and used transparently, while prioritizing privacy, clinical safety, and effectiveness. The use of technology should actively work to reduce, not exacerbate, disparities, ensuring a fair and just health care system. ACP recommends that to ensure accountability and oversight of AI-enabled medical tools, there should be a coordinated federal strategy involving oversight of AI by governmental and non-governmental regulatory entities. The tools should be designed to reduce physician and other clinician burdens in support of patient care, while guided by unwavering principles of medical ethics.

Additionally, to ensure that AI tools are administered safely, ACP advises that training on AI in medicine be provided at all levels of medical education. Physicians must be able to both use the technology and remain able to make appropriate clinical decisions independently, in the case that AI decision support becomes unavailable. Lastly, efforts to quantify the environmental impacts of AI must continue and mitigation of those impacts should be considered.

"AI has already made an impact in the medical community, and ACP is excited about what it means for the future of health care," remarked Dr. Opole. "There is so much potential to use this revolutionary technology to improve clinical practices and promote health equity. As we incorporate AI into medical practice, it is essential to maintain an awareness of the clinical and ethical implications of AI technology and its impacts on patient well-being."

Daneshvar N, Pandita D, Erickson S, Sulmasy LS, DeCamp M; ACP Medical Informatics Committee and the Ethics, Professionalism and Human Rights Committee.
Artificial Intelligence in the Provision of Health Care: An American College of Physicians Policy Position Paper.
Ann Intern Med. 2024 Jun 4. doi: 10.7326/M24-0146

Most Popular Now

European Artificial Intelligence Act Com…

The European Artificial Intelligence Act (AI Act), the world's first comprehensive regulation on artificial intelligence, enters into force. The AI Act is designed to ensure that AI developed and used...

Generative AI can Not yet Reliably Read …

It may someday be possible to use Large Language Models (LLM) to automatically read clinical notes in medical records and reliably and efficiently extract relevant information to support patient care...

Patient Safety must be Central to the De…

An EPR system brings together different patient information in one place, making it easier to access for healthcare professionals. This information can include patients' own notes, test results, observations by...

AI can Help Rule out Abnormal Pathology …

A commercial artificial intelligence (AI) tool used off-label was effective at excluding pathology and had equal or lower rates of critical misses on chest X-ray than radiologists, according to a...

ChatGPT Shows Promise in Answering Patie…

The groundbreaking ChatGPT chatbot shows potential as a time-saving tool for responding to patient questions sent to the urologist's office, suggests a study in the September issue of Urology Practice®...

Survey: Most Americans Comfortable with …

Artificial intelligence (AI) is all around us - from smart home devices to entertainment and social media algorithms. But is AI okay in healthcare? A new national survey commissioned by...

What Does the EU's Recent AI Act Me…

The European Union's law on artificial intelligence came into force on 1 August. The new AI Act essentially regulates what artificial intelligence can and cannot do in the EU. A...

AI Spots Cancer and Viral Infections at …

Researchers at the Centre for Genomic Regulation (CRG), the University of the Basque Country (UPV/EHU), Donostia International Physics Center (DIPC) and the Fundación Biofisica Bizkaia (FBB, located in Biofisika Institute)...

Video Gaming Improves Mental Well-Being

A pioneering study titled "Causal effect of video gaming on mental well-being in Japan 2020-2022," published in Nature Human Behaviour, has conducted the most comprehensive investigation to date on the...

New Diabetes Research Links Blood Glucos…

As part of its ongoing exploration of vocal biomarkers and the role they can play in enhancing health outcomes, Klick Labs published a new study in Scientific Reports - confirming...

New AI Software could Make Diagnosing De…

Although Alzheimer's is the most common cause of dementia - a catchall term for cognitive deficits that impact daily living, like the loss of memory or language - it's not...

Machine learning helps identify rheumato…

A machine-learning tool created by Weill Cornell Medicine and Hospital for Special Surgery (HSS) investigators can help distinguish subtypes of rheumatoid arthritis (RA), which may help scientists find ways to...