AI Chatbots Rival Doctors in Accuracy for Back Pain Advice

A new study reveals that artificial intelligence chatbots, such as ChatGPT, may be almost as effective as consulting a doctor for advice on low back pain.

Conducted by an international team, the research sheds light on the potential of AI in addressing one of the world's leading causes of disability.

Associate Professor Bruno Tirotti Saragiotto, research co-author and Head of Physiotherapy at The University of Technology Sydney (UTS), said the study intended to evaluate how effectively AI chatbots like ChatGPT answer common questions posed by individuals experiencing low back pain.

The study, Assessing the performance of AI chatbots in answering patients' common questions about low back pain, was recently published in the journal Annals of the Rheumatic Diseases.

Low back pain affects millions globally, often prompting sufferers to seek information online.

As AI-powered chatbots become increasingly common in offering health recommendations, understanding the accuracy of their recommendations is important.

"The findings show that AI chatbots can offer advice with accuracy levels comparable to those reported by healthcare professionals in Australia," said Associate Professor Saragiotto.

The research found that AI chatbots excelled in answering questions related to suggested treatment and self-management, while risk factors had the most inaccuracies.

Questions such as "What complementary therapies like massage or acupuncture could alleviate lower back pain?" received accurate recommendations. The study also noted that AI chatbots consistently recommended exercise for preventing and managing low back pain, which is considered an accurate recommendation.

However, the study also showed that AI chatbots provided inaccurate recommendations to other commonly asked questions. For example, while poor posture does not cause low back pain, AI chatbots said that it does 88% of the time.

Another key observation was the ability of AI chatbots to recognise situations requiring medical referrals. In cases where professional care should be recommended, the AI systems advised users to consult a healthcare provider in 70-100% of instances.

"Our research indicates that AI chatbots have the potential to be a valuable resource for those seeking initial guidance on managing low back pain," said Dr Giovanni Ferreira, Research Fellow at the University of Sydney Institute for Musculoskeletal Health, and one of the authors of the study.

"It's important to note that these tools should complement, not replace, professional medical advice." said Dr Ferreira.

Despite these encouraging results, researchers identified limitations in the AI chatbots' performance. Notably, responses were often complex, with a readability level suitable for individuals with a 10th to 12th-grade or university-level education.

"While the accuracy of the AI-generated advice was impressive, we must consider the accessibility of this information," said Associate Professor Saragiotto.

"Ensuring that health guidance is understandable to a broad audience remains an important challenge in the development of AI health tools."

The research comes at a time of increasing reliance on digital health information, with many patients turning to online resources before or instead of consulting a healthcare professional.

Associate Professor Saragiotto stressed the importance of recognising both the capabilities and limitations of AI resources in managing common health concerns like low back pain.

"As AI technology continues to evolve, further research will be necessary to refine these tools and ensure they can provide accurate, accessible, and safe health information to the public," he said.

Scaff SPS, Reis FJJ, Ferreira GE, Jacob MF, Saragiotto BT.
Assessing the performance of AI chatbots in answering patients' common questions about low back pain.
Ann Rheum Dis. 2024 Sep 18:ard-2024-226202. doi: 10.1136/ard-2024-226202

Most Popular Now

AI Model can Read ECGs to Identify Femal…

A new AI model can flag female patients who are at higher risk of heart disease based on an electrocardiogram (ECG). The researchers say the algorithm, designed specifically for female patients...

New AI Tool Mimics Radiologist Gaze to R…

Artificial intelligence (AI) can scan a chest X-ray and diagnose if an abnormality is fluid in the lungs, an enlarged heart or cancer. But being right is not enough, said...

Researchers Find Telemedicine may Help R…

Low-value care - medical tests and procedures that provide little to no benefit to patients - contributes to excess medical spending and both direct and cascading harms to patients. A...

AI Revolutionizes Glaucoma Care

Imagine walking into a supermarket, train station, or shopping mall and having your eyes screened for glaucoma within seconds - no appointment needed. With the AI-based Glaucoma Screening (AI-GS) network...

North Cumbria Integrated Care Signs 10-Y…

North Cumbria Integrated Care NHS Foundation Trust (NCIC) has signed a long-term agreement for use of the Alcidion Miya Precision platform, to provide an electronic patient record (EPR) for the...

AI Accelerates Discovery of Neurodevelop…

Researchers have developed an artificial intelligence (AI) approach that accelerates the identification of genes that contribute to neurodevelopmental conditions such as autism spectrum disorder, epilepsy and developmental delay. This new...

AI may Help Clinicians Personalize Treat…

Individuals with generalized anxiety disorder (GAD), a condition characterized by daily excessive worry lasting at least six months, have a high relapse rate even after receiving treatment. Artificial intelligence (AI)...

AI can Open Up Beds in the ICU

At the height of the COVID-19 pandemic, hospitals frequently ran short of beds in intensive care units. But even earlier, ICUs faced challenges in keeping beds available. With an aging...

AI Model Predicting Two-Year Risk of Com…

AFib (short for atrial fibrillation), a common heart rhythm disorder in adults, can have disastrous consequences including life-threatening blood clots and stroke if left undetected or untreated. A new study...

Accelerating NHS Digital Maturity: Paper…

Digitised clinical noting at South Tees Hospitals NHS Foundation Trust is creating efficiencies for busy doctors and nurses. The trust’s CCIO Dr Andrew Adair, deputy CCIO Dr John Greenaway, and...

Can AI Help Detect Cognitive Impairment?

Mild cognitive impairment (MCI) can be an early indicator of Alzheimer's disease or dementia, so identifying those with cognitive issues early could lead to interventions and better outcomes. But diagnosing...

Mobile App Tracking Blood Pressure Helps…

The AHOMKA platform, an innovative mobile app for patient-to-provider communication that developed through a collaboration between the School of Engineering and leading medical institutions in Ghana, has yielded positive results...