AI Chatbots Rival Doctors in Accuracy for Back Pain Advice

A new study reveals that artificial intelligence chatbots, such as ChatGPT, may be almost as effective as consulting a doctor for advice on low back pain.

Conducted by an international team, the research sheds light on the potential of AI in addressing one of the world's leading causes of disability.

Associate Professor Bruno Tirotti Saragiotto, research co-author and Head of Physiotherapy at The University of Technology Sydney (UTS), said the study intended to evaluate how effectively AI chatbots like ChatGPT answer common questions posed by individuals experiencing low back pain.

The study, Assessing the performance of AI chatbots in answering patients' common questions about low back pain, was recently published in the journal Annals of the Rheumatic Diseases.

Low back pain affects millions globally, often prompting sufferers to seek information online.

As AI-powered chatbots become increasingly common in offering health recommendations, understanding the accuracy of their recommendations is important.

"The findings show that AI chatbots can offer advice with accuracy levels comparable to those reported by healthcare professionals in Australia," said Associate Professor Saragiotto.

The research found that AI chatbots excelled in answering questions related to suggested treatment and self-management, while risk factors had the most inaccuracies.

Questions such as "What complementary therapies like massage or acupuncture could alleviate lower back pain?" received accurate recommendations. The study also noted that AI chatbots consistently recommended exercise for preventing and managing low back pain, which is considered an accurate recommendation.

However, the study also showed that AI chatbots provided inaccurate recommendations to other commonly asked questions. For example, while poor posture does not cause low back pain, AI chatbots said that it does 88% of the time.

Another key observation was the ability of AI chatbots to recognise situations requiring medical referrals. In cases where professional care should be recommended, the AI systems advised users to consult a healthcare provider in 70-100% of instances.

"Our research indicates that AI chatbots have the potential to be a valuable resource for those seeking initial guidance on managing low back pain," said Dr Giovanni Ferreira, Research Fellow at the University of Sydney Institute for Musculoskeletal Health, and one of the authors of the study.

"It's important to note that these tools should complement, not replace, professional medical advice." said Dr Ferreira.

Despite these encouraging results, researchers identified limitations in the AI chatbots' performance. Notably, responses were often complex, with a readability level suitable for individuals with a 10th to 12th-grade or university-level education.

"While the accuracy of the AI-generated advice was impressive, we must consider the accessibility of this information," said Associate Professor Saragiotto.

"Ensuring that health guidance is understandable to a broad audience remains an important challenge in the development of AI health tools."

The research comes at a time of increasing reliance on digital health information, with many patients turning to online resources before or instead of consulting a healthcare professional.

Associate Professor Saragiotto stressed the importance of recognising both the capabilities and limitations of AI resources in managing common health concerns like low back pain.

"As AI technology continues to evolve, further research will be necessary to refine these tools and ensure they can provide accurate, accessible, and safe health information to the public," he said.

Scaff SPS, Reis FJJ, Ferreira GE, Jacob MF, Saragiotto BT.
Assessing the performance of AI chatbots in answering patients' common questions about low back pain.
Ann Rheum Dis. 2024 Sep 18:ard-2024-226202. doi: 10.1136/ard-2024-226202

Most Popular Now

Open Medical Works with Moray's Dig…

Open Medical is working with the Digital Health & Care Innovation Centre’s Rural Centre of Excellence on a referral management plan, as part of a research and development scheme to...

Generative AI on Track to Shape the Futu…

Using advanced artificial intelligence (AI), researchers have developed a novel method to make drug development faster and more efficient. In a new paper, Xia Ning, lead author of the study and...

AI could Help Improve Early Detection of…

A new study led by investigators at the UCLA Health Jonsson Comprehensive Cancer Center suggests that artificial intelligence (AI) could help detect interval breast cancers - those that develop between...

AI-Human Task-Sharing could Cut Mammogra…

The most effective way to harness the power of artificial intelligence (AI) when screening for breast cancer may be through collaboration with human radiologists - not by wholesale replacing them...

Reorganisation, Consolidation, and Cuts:…

NHS England has been downsized and abolished. Integrated care boards have been told to change function, consolidate, and deliver savings. Trusts are planning big cuts. The Highland Marketing advisory board...

Siemens Healthineers infection Control S…

Klinikum Region Hannover (KRH) has commissioned Siemens Healthineers to install infection control system (ICS) at the Klinikum Siloah hospital. The ICS aims to effectively tackle nosocomial infections and increase patient...

AI Tool Uses Face Photos to Estimate Bio…

Eyes may be the window to the soul, but a person's biological age could be reflected in their facial characteristics. Investigators from Mass General Brigham developed a deep learning algorithm...

Philips Future Health Index 2025 Report …

Royal Philips (NYSE: PHG, AEX: PHIA), a global leader in health technology, today unveiled its 2025 Future Health Index U.S. report, "Building trust in healthcare AI," spotlighting the state of...

AI-Powered Precision: Unlocking the Futu…

A team of researchers from the Department of Diagnostic and Therapeutic Ultrasonography at the Tianjin Medical University Cancer Institute & Hospital, have published a review in Cancer Biology & Medicine...

AI Model Improves Delirium Prediction, L…

An artificial intelligence (AI) model improved outcomes in hospitalized patients by quadrupling the rate of detection and treatment of delirium. The model identifies patients at high risk for delirium and...

Building Trust in Artificial Intelligenc…

A new review, published in the peer-reviewed journal AI in Precision Oncology, explores the multifaceted reasons behind the skepticism surrounding artificial intelligence (AI) technologies in healthcare and advocates for approaches...

SALSA: A New AI Tool for the Automated a…

Investigators of the Vall d'Hebron Institute of Oncology's (VHIO) Radiomics Group, led by Raquel Perez-Lopez, have developed SALSA (System for Automatic Liver tumor Segmentation And detection), a fully automated deep...