Can the AI Driving ChatGPT Help to Detect Early Signs of Alzheimer's Disease?

The artificial intelligence algorithms behind the chatbot program ChatGPT - which has drawn attention for its ability to generate humanlike written responses to some of the most creative queries - might one day be able to help doctors detect Alzheimer's Disease in its early stages. Research from Drexel University’s School of Biomedical Engineering, Science and Health Systems recently demonstrated that OpenAI's GPT-3 program can identify clues from spontaneous speech that are 80% accurate in predicting the early stages of dementia.

Reported in the journal PLOS Digital Health, the Drexel study is the latest in a series of efforts to show the effectiveness of natural language processing programs for early prediction of Alzheimer's - leveraging current research suggesting that language impairment can be an early indicator of neurodegenerative disorders.

Finding an Early Sign

The current practice for diagnosing Alzheimer's Disease typically involves a medical history review and lengthy set of physical and neurological evaluations and tests. While there is still no cure for the disease, spotting it early can give patients more options for therapeutics and support. Because language impairment is a symptom in 60-80% of dementia patients, researchers have been focusing on programs that can pick up on subtle clues - such as hesitation, making grammar and pronunciation mistakes and forgetting the meaning of words - as a quick test that could indicate whether or not a patient should undergo a full examination.

"We know from ongoing research that the cognitive effects of Alzheimer's Disease can manifest themselves in language production," said Hualou Liang, PhD, a professor in Drexel’s School of Biomedical Engineering, Science and Health Systems and a coauthor of the research. "The most commonly used tests for early detection of Alzheimer's look at acoustic features, such as pausing, articulation and vocal quality, in addition to tests of cognition. But we believe the improvement of natural language processing programs provide another path to support early identification of Alzheimer's."

A Program that Listens and Learns

GPT-3, officially the third generation of OpenAI’s General Pretrained Transformer (GPT), uses a deep learning algorithm - trained by processing vast swaths of information from the internet, with a particular focus on how words are used, and how language is constructed. This training allows it to produce a human-like response to any task that involves language, from responses to simple questions, to writing poems or essays.

GPT-3 is particularly good at "zero-data learning" - meaning it can respond to questions that would normally require external knowledge that has not been provided. For example, asking the program to write "Cliff’s Notes" of a text, would normally require an explanation that this means a summary. But GPT-3 has gone through enough training to understand the reference and adapt itself to produce the expected response.

"GPT3's systemic approach to language analysis and production makes it a promising candidate for identifying the subtle speech characteristics that may predict the onset of dementia," said Felix Agbavor, a doctoral researcher in the School and the lead author of the paper. "Training GPT-3 with a massive dataset of interviews - some of which are with Alzheimer's patients - would provide it with the information it needs to extract speech patterns that could then be applied to identify markers in future patients."

Seeking Speech Signals

The researchers tested their theory by training the program with a set of transcripts from a portion of a dataset of speech recordings compiled with the support of the National Institutes of Health specifically for the purpose of testing natural language processing programs' ability to predict dementia. The program captured meaningful characteristics of the word-use, sentence structure and meaning from the text to produce what researchers call an "embedding" - a characteristic profile of Alzheimer's speech.

They then used the embedding to re-train the program - turning it into an Alzheimer's screening machine. To test it they asked the program to review dozens of transcripts from the dataset and decide whether or not each one was produced by someone who was developing Alzheimer's.

Running two of the top natural language processing programs through the same paces, the group found that GPT-3 performed better than both, in terms of accurately identifying Alzheimer’s examples, identifying non-Alzheimer's examples and with fewer missed cases than both programs.

A second test used GPT-3’s textual analysis to predict the score of various patients from the dataset on a common test for predicting the severity of dementia, called the Mini-Mental State Exam (MMSE).

The team then compared GPT-3’s prediction accuracy to that of an analysis using only the acoustic features of the recordings, such as pauses, voice strength and slurring, to predict the MMSE score. GPT-3 proved to be almost 20% more accurate in predicting patients’ MMSE scores.

"Our results demonstrate that the text embedding, generated by GPT-3, can be reliably used to not only detect individuals with Alzheimer's Disease from healthy controls, but also infer the subject's cognitive testing score, both solely based on speech data," they wrote. "We further show that text embedding outperforms the conventional acoustic feature-based approach and even performs competitively with fine-tuned models. These results, all together, suggest that GPT-3 based text embedding is a promising approach for AD assessment and has the potential to improve early diagnosis of dementia."

Continuing the Search

To build on these promising results, the researchers are planning to develop a web application that could be used at home or in a doctor’s office as a pre-screening tool.

"Our proof-of-concept shows that this could be a simple, accessible and adequately sensitive tool for community-based testing," Liang said. "This could be very useful for early screening and risk assessment before a clinical diagnosis."

Felix Agbavor, Hualou Liang.
Predicting dementia from spontaneous speech using large language models.
PLOS Digital Health, 2022. doi: 10.1371/journal.pdig.0000168

Most Popular Now

Giving Doctors an AI-Powered Head Start …

Detection of melanoma and a range of other skin diseases will be faster and more accurate with a new artificial intelligence (AI) powered tool that analyses multiple imaging types simultaneously...

AI Agents for Oncology

Clinical decision-making in oncology is challenging and requires the analysis of various data types - from medical imaging and genetic information to patient records and treatment guidelines. To effectively support...

AI Medical Receptionist Modernizing Doct…

A virtual medical receptionist named "Cassie," developed through research at Texas A&M University, is transforming the way patients interact with health care providers. Cassie is a digital-human assistant created by Humanate...

Using Data and AI to Create Better Healt…

Academic medical centers could transform patient care by adopting principles from learning health systems principles, according to researchers from Weill Cornell Medicine and the University of California, San Diego. In...

AI Tool Set to Transform Characterisatio…

A multinational team of researchers, co-led by the Garvan Institute of Medical Research, has developed and tested a new AI tool to better characterise the diversity of individual cells within...

AI Detects Hidden Heart Disease Using Ex…

Mass General Brigham researchers have developed a new AI tool in collaboration with the United States Department of Veterans Affairs (VA) to probe through previously collected CT scans and identify...

Human-AI Collectives Make the Most Accur…

Diagnostic errors are among the most serious problems in everyday medical practice. AI systems - especially large language models (LLMs) like ChatGPT-4, Gemini, or Claude 3 - offer new ways...

Northern Ireland Completes Nationwide Ro…

Go-lives at Western and Southern health and social care trusts mean every pathology service is using the same laboratory information management system; improving efficiency and quality. An ambitious technology project to...

Highland Marketing Announced as Official…

Highland Marketing has been named, for the second year running, the official communications partner for HETT Show 2025, the UK's leading digital health conference and exhibition. Taking place 7-8 October...

MHP-Net: A Revolutionary AI Model for Ac…

Liver cancer is the sixth most common cancer globally and a leading cause of cancer-related deaths. Accurate segmentation of liver tumors is a crucial step for the management of the...

Groundbreaking TACIT Algorithm Offers Ne…

Researchers at VCU Massey Comprehensive Cancer Center have developed a novel algorithm that could provide a revolutionary tool for determining the best options for patients - both in the treatment...

The Many Ways that AI Enters Rheumatolog…

High-resolution computed tomography (HRCT) is the standard to diagnose and assess progression in interstitial lung disease (ILD), a key feature in systemic sclerosis (SSc). But AI-assisted interpretation has the potential...