AI System that Mimics Human Gaze could be Used to Detect Cancer

A cutting-edge artificial intelligence (AI) system that can accurately predict the areas of an image where a person is most likely to look has been created by scientists at Cardiff University.

Based on the mechanics of the human brain and its ability to distinguish between different parts of an image, the researchers say the novel system more accurately represents human vision than anything that has gone before.

Applications of the new system range from robotics, multimedia communication and video surveillance to automated image editing and finding tumours in medical images.

The Multimedia Computing Research Group at Cardiff University are now planning to test the system by helping radiologists to find lesions within medical images, with the overall goal of improving the speed, accuracy and sensitivity of medical diagnostics.

The system has been presented in the journal Neuralcomputing.

Being able to focus our attention is an important part of the human visual system which allows us to select and interpret the most relevant information in a particular scene.

Scientists all over the world have been using computer software to try and recreate this ability to pick out the most salient parts of an image, but with mixed success up until now.

In their study, the team used a deep learning computer algorithm known as a convolutional neural network which is designed to mimic the interconnected web of neurons in the human brain and is modelled specifically on the visual cortex.

This type of algorithm is ideal for taking images as an input and being able to assign importance to various objects or aspects within the image itself.

In their study, the team utilised a huge database of images in which each image had already been assessed, or viewed, by humans and assigned so-called 'areas of interest' using eye-tracking software.

These images were then fed into the algorithm and using a type of AI known as deep learning, the system slowly began to learn from the images to a point where it could then accurately predict which parts of the image were most salient.

The new system was tested against seven state-of-the-art visual saliency systems that are already in use and was shown to be superior on all metrics.

Co-author of the study Dr Hantao Liu, from Cardiff University's School of Computer Science and Informatics, said: "This study has shown that our cutting-edge system, which uses the latest advances in machine learning, is superior to the existing state-of-the-art visual saliency models that currently exist.

"Being able to successfully predict where people look in natural images could unlock a wide range of applications from automatic target detection to robotics, image processing and medical diagnostics.

"Our code has been made freely available so that everyone can benefit from the research and find new ways of applying this technology to real world problems and applications.

"The next step for us is to work with radiologists to determine how these models can assist them in detecting lesions within medical images."

The code underlying the new system has been made freely available to the public and can be downloaded here.

Jianxun Lou, Hanhe Lin, David Marshall, Dietmar Saupe, Hantao Liu.
TranSalNet: Towards perceptually relevant visual saliency prediction.
Neurocomputing, Volume 494, 2022. doi: 10.1016/j.neucom.2022.04.080

Most Popular Now

AI Catches One-Third of Interval Breast …

An AI algorithm for breast cancer screening has potential to enhance the performance of digital breast tomosynthesis (DBT), reducing interval cancers by up to one-third, according to a study published...

Great plan: Now We need to Get Real abou…

The government's big plan for the 10 Year Health Plan for the NHS laid out a big role for delivery. However, the Highland Marketing advisory board felt the missing implementation...

Researchers Create 'Virtual Scienti…

There may be a new artificial intelligence-driven tool to turbocharge scientific discovery: virtual labs. Modeled after a well-established Stanford School of Medicine research group, the virtual lab is complete with an...

From WebMD to AI Chatbots: How Innovatio…

A new research article published in the Journal of Participatory Medicine unveils how successive waves of digital technology innovation have empowered patients, fostering a more collaborative and responsive health care...

New AI Tool Accelerates mRNA-Based Treat…

A new artificial intelligence (AI) model can improve the process of drug and vaccine discovery by predicting how efficiently specific mRNA sequences will produce proteins, both generally and in various...

AI also Assesses Dutch Mammograms Better…

AI is detecting tumors more often and earlier in the Dutch breast cancer screening program. Those tumors can then be treated at an earlier stage. This has been demonstrated by...

RSNA AI Challenge Models can Independent…

Algorithms submitted for an AI Challenge hosted by the Radiological Society of North America (RSNA) have shown excellent performance for detecting breast cancers on mammography images, increasing screening sensitivity while...

AI could Help Emergency Rooms Predict Ad…

Artificial intelligence (AI) can help emergency department (ED) teams better anticipate which patients will need hospital admission, hours earlier than is currently possible, according to a multi-hospital study by the...

Head-to-Head Against AI, Pharmacy Studen…

Students pursuing a Doctor of Pharmacy degree routinely take - and pass - rigorous exams to prove competency in several areas. Can ChatGPT accurately answer the same questions? A new...

NHS Active 10 Walking Tracker Users are …

Users of the NHS Active 10 app, designed to encourage people to become more active, immediately increased their amount of brisk and non-brisk walking upon using the app, according to...

New AI Tool Illuminates "Dark Side…

Proteins sustain life as we know it, serving many important structural and functional roles throughout the body. But these large molecules have cast a long shadow over a smaller subclass...

Deep Learning-Based Model Enables Fast a…

Stroke is the second leading cause of death globally. Ischemic stroke, strongly linked to atherosclerotic plaques, requires accurate plaque and vessel wall segmentation and quantification for definitive diagnosis. However, conventional...