AI Tool Outperforms Human Emergency Call Handlers in Identifying Stroke, New Study Shows

A team of researchers from Denmark have developed a new artificial intelligence (AI) framework to address the number of strokes that go unrecognised by human emergency call handlers.(1) The framework outperformed emergency call handlers in recognising stroke for both sexes and across all age groups studied, indicating its potential as a supplementary tool for early and precise stroke identification in the future.

The retrospective study, presented today at the European Stroke Organisation Conference (ESOC) 2023, drew from the Danish Stroke Registry and a dataset of over 1.5 million calls made to the Copenhagen Emergency Medical Services between 2015 and 2020, which included over 7000 stroke-related calls. Researchers utilised this data to train an AI framework to firstly transcribe the call audio and then predict the risk of stroke based on the transcribed text.

The results, which were evaluated on calls from 2021, revealed that the AI framework performed more effectively than emergency call handlers in identifying stroke cases. The AI framework achieved a recall (sensitivity) of 63.0% and a precision (positive predictive value) of 24.9%, which resulted in an F1 score of 35.7.* In contrast, emergency call handlers had a recall of 52.7% and precision of 17.1%, resulting in an F1 score of 25.8.

Dr Jonathan Wenstrup, one of the lead authors of the study from Copenhagen University Hospital, commented, "As one of the first points of contact for patients seeking medical assistance, emergency call handlers play a critical role in facilitating early and accurate stroke recognition. Many stroke cases can go undetected at this stage, leading to delays in treatment that can have potentially life-threatening consequences for patients."

Across Europe, stroke is the second leading cause of death and a major cause of adult disability, affecting over 1 million people each year.(2,3) As populations continue to grow and age, the number of people living with stroke is projected to increase by 27% between 2017 and 2047 in the European Union (EU).(3) Despite this, many strokes can be prevented, and if treated early, the likelihood of a positive outcome can be greatly improved.(4,5)

"With the implementation of this new, cost-effective supporting tool, we can enhance stroke identification by call handlers and ensure more patients receive appropriate and timely care, ultimately improving patient outcomes," added Dr Wenstrup.

"As with any new tool, further research and development are necessary to improve the framework's accuracy and expand its capabilities. In the future, it may be possible to train the framework directly from the call audio, bypassing the transcription step, as well as incorporating non-word audio - such as a slurred voice - into the training data. However, given the promising results of this study, it is already clear that technologies like this have the capability to completely transform stroke diagnosis and care."

About ESO

The ESO is a pan-European society of stroke researchers and physicians, national and regional stroke societies and lay organisations, founded in December 2007. The ESO is an NGO comprised of individual and organisational members. The aim of the ESO is to reduce the burden of stroke by changing the way that stroke is viewed and treated. This can only be achieved by professional and public education and making institutional changes. ESO serves as the voice of stroke in Europe, harmonising stroke management across the whole of Europe and taking action to reduce the burden.

1. Havtorn, J.D., Wenstrup J., Borgholt L., et al. A retrospective study on deep learning-enabled stroke recognition for a medical help line. Presented at the European Stroke Organisation Conference; 24 May 2023; Munich, Germany.
2. OECDiLibrary. Mortality following stroke. Available at: https://www.oecd-ilibrary.org/sites/dbabdd9d-en/index.html?itemId=/content/component/dbabdd9d-en#:~:text=Stroke%20is%20the%20second%20leading,diseases%E2%80%9D%20in%20Chapter%203) (Accessed: May 2023).
3. Wafa HA, et al. Burden of stroke in Europe: Thirty-year projections of incidence, prevalence, deaths, and disability-adjusted life years. Stroke. 2020;51(8):2418-2427.
4. American Stroke Association. Preventing Another Stroke. Available at: https://www.stroke.org/en/life-after-stroke/preventing-another-stroke (Accessed: May 2023).
5. American Stroke Association. Why Getting Quick Stroke Treatment is Important. Available at: https://www.stroke.org/en/about-stroke/types-of-stroke/is-getting-quick-stroke-treatment-important (Accessed: May 2023).

Most Popular Now

Mahana Therapeutics Signs Agreement with…

Mahana Therapeutics, a leading provider of prescription digital therapeutics, announced today that the company has entered into a multi-million-dollar distribution and marketing partnership with the Consumer Health division of Bayer...

ChatGPT can Outperform University Studen…

ChatGPT may match or even exceed the average grade of university students when answering assessment questions across a range of subjects including computer science, political studies, engineering, and psychology, reports...

NHS AI Diagnostic Funding: Five Things t…

Opinion Article by Guilherme Carvalho, Sales & Contracts Manager, Sectra. A new £21 million fund for AI was announced by the UK government in June, with the intention of providing NHS...

ChatGPT Shows Limited Ability to Recomme…

For many patients, the internet serves as a powerful tool for self-education on medical topics. With ChatGPT now at patients’ fingertips, researchers from Brigham and Women’s Hospital, a founding member...

Combining AI Models Improves Breast Canc…

Combining artificial intelligence (AI) systems for short- and long-term breast cancer risk results in an improved cancer risk assessment, according to a study published in Radiology, a journal of the...

AI Predictions for Colorectal Cancer: On…

Colorectal cancer (CRC) ranks second in leading causes of cancer-related deaths globally, according to the WHO. For the first time, researchers from Helmholtz Munich and the University of Technology Dresden...

Healthcare Chatbot: Expand Support with …

The Danish eHealth platform, sundhed.dk, has faced a substantial surge in requests from Danish citizens and has swiftly expanded its support and effectively adapt to the ongoing changes in queries due...

ChatGPT Shows 'Impressive' Acc…

A new study led by investigators from Mass General Brigham has found that ChatGPT was about 72 percent accurate in overall clinical decision making, from coming up with possible diagnoses...

WiFi SPARK's Healthcare Business Re…

Leading WiFi provider WiFi SPARK is rebranding its healthcare arm as SPARK Technology Services Limited. The new identity marks the completion of the integration of the former Hospedia bedside unit...

AI Performs Comparably to Human Readers …

Using a standardized assessment, researchers in the UK compared the performance of a commercially available artificial intelligence (AI) algorithm with human readers of screening mammograms. Results of their findings were...

ChatGPT is Debunking Myths on Social Med…

ChatGPT could help to increase vaccine uptake by debunking myths around jab safety, say the authors of a study published in the peer-reviewed journal Human Vaccines and Immunotherapeutics. The researchers asked...

Online AI-Based Test for Parkinson'…

An artificial intelligence (AI) tool developed by researchers at the University of Rochester can help people with Parkinson's disease remotely assess the severity of their symptoms within minutes. A study...