Shape-Changing Device Helps Visually Impaired People Perform Location Task as Well as Sighted People

Researchers from Imperial College London, working with the company MakeSense Technology and the charity Bravo Victor, have developed a shape-changing device called Shape that helps people with visual impairment navigate through haptic perception - the way people understand information about objects through touch. The device, which looks like a torch, bends to indicate where a person needs to move and straightens when the user is facing the correct direction.

In a study published in Nature Scientific Reports, researchers tested how well people with visual impairment were able to locate targets in a 3D virtual reality (VR) space using Shape and vibration feedback technology - which is commonly used to help visually impaired people navigate. Sighted individuals were also recruited for the study to locate the targets in the VR space using only their natural vision.

Dr Ad Spiers, lead researcher for the study, from Imperial's Department of Electrical and Electronic Engineering, said: "The exciting thing about this study is we’ve managed to demonstrate that Shape can help people with visual impairment perform a navigation task as well as sighted people. This is something that we haven’t seen before with other navigation devices.

"Shape is unusual because it uses our ability to understand information through touch in a way that goes beyond vibration. Humans have an innate ability to feel and interpret shapes through our hands, with very little concentration. Exploiting this allows us to create a device that is simple to learn and isn’t tiring to use."

The study compared the results of 10 participants with visual impairment and 10 sighted participants, testing their ability to locate targets as quickly as possible in a controlled indoor environment, measuring the time taken to locate virtual targets and the efficiency in locating these targets.

The trial found that there was no significant difference in the performance between visually impaired participants using Shape and sighted participants using only natural vision. It also found that participants with visual impairment located targets significantly faster using Shape than with vibration technology. Feedback showed that participants with visual impairment preferred using Shape to vibration technology.

It is hoped that the device, which is believed to be the most advanced of its kind, could be the future of navigation technology for visual impairment, as the Shape device has notable advantages over current tools used to guide people with visual impairment.

Dr Robert Quinn, CEO of MakeSense Technology, said: "The impressive results from this study demonstrate the enormous potential of this technology to make life changing improvements in mobility for people with visual impairment.

"Building upon the research described in this paper, MakeSense is developing a blind wayfinding product which leverages the latest advancements in spatial artificial intelligence and computer vision without the need for interpretive training. We are aiming for our first product to be available from the end of 2025."

Currently, individuals with visual impairment most commonly use aids such as white canes or guide dogs. While guide dogs are often effective, they require expensive expert training and can cost thousands of pounds per year to keep. White canes enable navigation through a process of elimination by telling users where not to go, rather than where they should go. This process limits a user's ability to navigate freely in complex environments.

Recent developments with technology have tended to focus on using auditory interfaces, which give audio cues such as "turn left at the next corner", or vibration feedback, which alerts a user through vibration patterns that indicate where to move.

Auditory interfaces can prevent people from hearing important warning sounds of imminent hazards and can dampen users’ ability to engage fully with the world. Vibration feedback can lead to numbness after prolonged periods of use and studies have shown users can become quickly irritated and distracted by frequent vibration sensations.

In order to test the performance of Shape against vibration technology and natural sight in a controlled environment, the researchers designed a simulation of real-world navigation that reduced the possibility of significant variation between experiments.

In a real-world navigation scenario, it is expected that there would be significant variation in conditions due to changes in weather and the presence of other pedestrians or objects. It is also expected that there will often be multiple potential target options in a real-world scenario rather than the single targets which were presented individually in the experiment.

Further research is needed to understand how the Shape device performs in more variable real-world scenarios.

The Shape device was developed working with MakeSense Technology, a startup company which was co-founded at Imperial by Dr Robert Quinn - an Imperial PhD graduate in Mechanical Engineering. The company received support in its early stages from Imperial’s thriving entrepreneurial ecosystem, which aims to develop innovative solutions with the potential to change the world for better.

Following the completion of the Shape study, MakeSense has worked on developing the technology further to be used for real-world outdoor navigation. It is hoped that the device could be ready for practical use in real-world environments in the coming years.

The research published in Nature Scientific Reports was supported by funding from Innovate UK’s SMART Grant, which was awarded to MakeSense Technology Ltd, Bravo Victor, and Imperial College London.

Quinn R, Murtough S, de Winton H, Ellis-Frew B, Zane S, De Sousa J, Kempapidis T, Gomes RSM, Spiers AJ.
A shape-changing haptic navigation interface for vision impairment.
Sci Rep. 2024 Dec 10;14(1):29223. doi: 10.1038/s41598-024-79845-7

Most Popular Now

Unlocking the 10 Year Health Plan

The government's plan for the NHS is a huge document. Jane Stephenson, chief executive of SPARK TSL, argues the key to unlocking its digital ambitions is to consider what it...

Alcidion Grows Top Talent in the UK, wit…

Alcidion has today announced the addition of three new appointments to their UK-based team, with one internal promotion and two external recruits. Dr Paul Deffley has been announced as the...

AI can Find Cancer Pathologists Miss

Men assessed as healthy after a pathologist analyses their tissue sample may still have an early form of prostate cancer. Using AI, researchers at Uppsala University have been able to...

AI, Full Automation could Expand Artific…

Automated insulin delivery (AID) systems such as the UVA Health-developed artificial pancreas could help more type 1 diabetes patients if the devices become fully automated, according to a new review...

How AI could Speed the Development of RN…

Using artificial intelligence (AI), MIT researchers have come up with a new way to design nanoparticles that can more efficiently deliver RNA vaccines and other types of RNA therapies. After training...

MIT Researchers Use Generative AI to Des…

With help from artificial intelligence, MIT researchers have designed novel antibiotics that can combat two hard-to-treat infections: drug-resistant Neisseria gonorrhoeae and multi-drug-resistant Staphylococcus aureus (MRSA). Using generative AI algorithms, the research...

AI Hybrid Strategy Improves Mammogram In…

A hybrid reading strategy for screening mammography, developed by Dutch researchers and deployed retrospectively to more than 40,000 exams, reduced radiologist workload by 38% without changing recall or cancer detection...

New Training Year Starts at Siemens Heal…

In September, 197 school graduates will start their vocational training or dual studies in Germany at Siemens Healthineers. 117 apprentices and 80 dual students will begin their careers at Siemens...

Penn Developed AI Tools and Datasets Hel…

Doctors treating kidney disease have long depended on trial-and-error to find the best therapies for individual patients. Now, new artificial intelligence (AI) tools developed by researchers in the Perelman School...

Are You Eligible for a Clinical Trial? C…

A new study in the academic journal Machine Learning: Health discovers that ChatGPT can accelerate patient screening for clinical trials, showing promise in reducing delays and improving trial success rates. Researchers...

New AI Tool Addresses Accuracy and Fairn…

A team of researchers at the Icahn School of Medicine at Mount Sinai has developed a new method to identify and reduce biases in datasets used to train machine-learning algorithms...

Global Study Reveals How Patients View M…

How physicians feel about artificial intelligence (AI) in medicine has been studied many times. But what do patients think? A team led by researchers at the Technical University of Munich...