NFC Aid for the Visually and Hearing Impaired

As the proportion of senior citizens grows, their special needs are gaining momentum. Human eyesight, for example, weakens with age. VTT Technical Research Centre of Finland has been developing new NFC-based applications that make life easier for the visually impaired. A group of affected persons recently tested an innovative, speech-based item identification system and new "talking" packaging for medicine and food.

Solutions that link products and digital product info are becoming ever more common. They offer a range of possibilities for both the normal-sighted and the visually impaired. Food packaging, for example, can include links to information relevant to the individual customer, from the origins of the product to ecological aspects and possible allergy risks.

The HearMeFeelMe project, a collaborative effort by VTT, TopTunniste (Finland) Tecnalia (Spain) and Demokritos (Greece), introduced five different applications for acquiring medical information, all of them based on NFC technology (Near Field Communication). By touching the info code on the packaging with his or her mobile phone, the user downloads product and dosage information which can be heard on a phone or computer. End users participating in the project represented the Finnish Federation of the Visually Impaired (FFVI), the Caritas Foundation, Joutsen Pharmacy 6 in Oulu and SSI, a Spanish provider of geriatric services.

Speech tagging application finds most favour
The testers' favourite was Top Tunniste's Touch 'n' Tag demo, a mobile phone application that enables visually impaired users to identify everyday items, including food, with the help of voice memos. The phone must be equipped with an NFC reader. To record a memo tag, the user touches the NFC label on the packaging and dictates the information into the phone. The recording can then be listened to by touching the label again with the phone. The test run indicated that the application was most commonly used to mark food packaging. According to the majority of users, it was useful in recognising items and recalling product information. Additional benefit was seen in the possibility of recording the desired information in the user's own words.

Another demo application was developed during the HearMeFeelMe project, completed at the end of 2011. This was the so-called speaking medicine packaging. When touched, this provides spoken dosage instructions and other important information. The data was stored on the NFC chip by pharmacy staff and could be listened to by the user at home. The demo version was only available for PC, but the application is designed to run on programmable smartphones equipped with an NFC reader and a code scanner.

Not yet tested by end users was an almanac demo designed to ensure properly-timed medication, using the elderly person's own social network. This enables e.g. nurses and family members to remind the patient of scheduled doses of medicine or meetings. The user receives the reminder as a message on his or her mobile phone and replies with an NFC acknowledgement, e.g. by touching the pill dispenser with the phone, to inform the nurse or family member that the medicine was taken.

In the future, visually impaired people may use NFC applications for a variety of purposes, including item recognition, spoken product information on food or medicine packaging, personal reminders, calendars or spoken manuals for home appliances.

Latest NFC applications not yet supported by current phone models
According to VTT, transforming written information into speech is easy in technical terms and would be of great benefit to old people and visually impaired persons of all ages. However, most current mobile phones do not support advanced NFC applications. The new solutions are designed for platforms not yet on the market.

Mobile devices are usually unbeatable when it comes to everyday IT-based services, since they are always flexibly at hand and the threshold for using them is low across all age groups. Solutions designed for devices that are already part of everyday life, become popular fastest.

VTT - 70 years of technology for business and society
VTT Technical Research Centre of Finland is a leading multitechnological applied research organization in Northern Europe. VTT creates new technology and science-based innovations in co-operation with domestic and foreign partners. VTT's turnover is EUR 290 million and itspersonnel totals 3,100.

Most Popular Now

AI System Helps Doctors Identify Patient…

A new study from Vanderbilt University Medical Center shows that clinical alerts driven by artificial intelligence (AI) can help doctors identify patients at risk for suicide, potentially improving prevention efforts...

Smartphone App can Help Reduce Opioid Us…

Patients with opioid use disorder can reduce their days of opioid use and stay in treatment longer when using a smartphone app as supportive therapy in combination with medication, a...

AI's New Move: Transforming Skin Ca…

Pioneering research has unveiled a powerful new tool in the fight against skin cancer, combining cutting-edge artificial intelligence (AI) with deep learning to enhance the precision of skin lesion classification...

Leveraging AI to Assist Clinicians with …

Physical examinations are important diagnostic tools that can reveal critical insights into a patient's health, but complex conditions may be overlooked if a clinician lacks specialized training in that area...

AI can Improve Ovarian Cancer Diagnoses

A new international study led by researchers at Karolinska Institutet in Sweden shows that AI-based models can outperform human experts at identifying ovarian cancer in ultrasound images. The study is...

Predicting the Progression of Autoimmune…

Autoimmune diseases, where the immune system mistakenly attacks the body's own healthy cells and tissues, often have a preclinical stage before diagnosis that’s characterized by mild symptoms or certain antibodies...

Major EU Project to Investigate Societal…

A new €3 million EU research project led by University College Dublin (UCD) Centre for Digital Policy will explore the benefits and risks of Artificial Intelligence (AI) from a societal...

Using AI to Uncover Hospital Patients�…

Across the United States, no hospital is the same. Equipment, staffing, technical capabilities, and patient populations can all differ. So, while the profiles developed for people with common conditions may...

New AI Tool Uses Routine Blood Tests to …

Doctors around the world may soon have access to a new tool that could better predict whether individual cancer patients will benefit from immune checkpoint inhibitors - a type of...

New Method Tracks the 'Learning Cur…

Introducing Annotatability - a powerful new framework to address a major challenge in biological research by examining how artificial neural networks learn to label genomic data. Genomic datasets often contain...

From Text to Structured Information Secu…

Artificial intelligence (AI) and above all large language models (LLMs), which also form the basis for ChatGPT, are increasingly in demand in hospitals. However, patient data must always be protected...

Picking the Right Doctor? AI could Help

Years ago, as she sat in waiting rooms, Maytal Saar-Tsechansky began to wonder how people chose a good doctor when they had no way of knowing a doctor's track record...