AI Tool that may Assist Underserved Hospitals

As the fields of healthcare and technology increasingly evolve and intersect, researchers are collaborating on the best ways to use emerging technologies such as artificial intelligence (AI) to care for patients.

This includes using AI to assist in collecting and deciphering diagnostic data among medical professionals, particularly in underserved communities.

One such model, "BioMedGPT," has shown great potential to democratize healthcare and reduce disparities amongst patients. The new model has been detailed in a study in Nature Medicine.

The AI tool was developed by a collaborative team of researchers that was led by Lehigh University and included Chen Chen, an associate professor at UCF’s Center for Research in Computer Vision (CRCV).

Chen says there are many existing examples of AI used for healthcare, but many are highly specialized and may only perform limited tasks.

However, BiomedGPT can perform multiple tasks, including image classification, report generation and visual question answering, and is designed to be computationally efficient and open-sourced to foster collaboration, according to the study.

BiomedGPT could find a niche in providing easily accessible data to bolster underserved hospitals that may not have a robust number of personnel, so relying on shared knowledge from medical networks via BiomedGPT could be of great help, he says.

"In these hospitals, they may not a lot of physicians or clinicians that can address a case immediately or they don’t have enough resources to diagnosis," Chen says. "This powerful AI tool is able to provide that knowledge to help to reduce disparity in healthcare."

The model is open source, which means practitioners can use the framework and plug in their own data to collaborate and review amongst themselves in a community network.

BiomedGPT also aims to be generalist, meaning it can be more comprehensive and thorough so that it may be applied to a wider breadth of medical data and analysis, Chen says.

"BiomedGPT is a unified AI model that is able to process a variety of data and perform multiple tasks," he says. "So, this is useful, because it can be potentially can streamline the healthcare workflow, improve the diagnosis accuracy and reduce the need of multiple specialized systems. This model can even generate reasonable results on tasks or data that hadn’t been trained on before."

Chen used his computer vision and machine learning expertise to develop the AI model to understand medical images.

"My role was to figure out how we can extract useful information from visual data, especially for medical imaging and how can we integrate this information with other types of data modalities like text," Chen says. "Imaging modalities are a big part of this because in healthcare, we have a lot of imaging data such as X-rays, CT scans and MRI."

BiomedGPT can perform multiple tasks, including image classification, report generation and visual question answering, and is designed to be computationally efficient and open-sourced to foster collaboration, the researchers state in their study. A clinician can upload an image and enter queries into BiomedGPT such as "What disease does this image depict?" or "Please determine the patient’s eligibility by comparing the given patient note and clinical trial details" and receive feedback based on an existing set of provided data integrated into the AI model’s framework.

According to the study, BiomedGPT exhibits robust prediction ability with a low error rate of 3.8% in question answering and a satisfactory performance with an error rate of 8.3% in writing complex radiology reports, and competitive summarization ability with a nearly equivalent preference score to human experts,.

Chen emphasizes though that clinicians and experts ultimately are responsible for reviewing the accuracy AI predications and supplementing the data.

"We are not trying to replace the clinician, but rather to enhance or make their workflow more efficient," Chen says. "A physician can look at an AI report and perhaps for some of the less complex cases they can quickly check to see if it is correct. The human will still be involved and with their expertise, they can make the correct prediction or the diagnosis."

He says the model is designed to be computation friendly and also fully open sourced.

"This is trying to foster the collaborations with research institute hospitals to use this and also improve the model over the time," he says.

The study and analysis of BiomedGPT are promising, but there is still much to refine, Chen says.

New datasets and imaging could be integrated while there also remains more evaluations for the platform’s consideration of safety, equity and bias.

"One thing is that we are looking to incorporate is more or diverse data and modalities," he says. "For example, we can include more video data and physiological signals like EKGs and heart rate monitoring. Another direction is we want to address are some of the most important issues in healthcare AI in general, like the privacy, bias and the fairness. The bias is an important consideration in developing this kind of model to make sure that it is able to generalize well for a wider population."

The University of Georgia, Harvard University, Massachusetts General Hospital, University of Pennsylvania, Children’s Hospital of Philadelphia, University of California, Santa Cruz, The Mayo Clinic, Samsung Research America, Stanford University and UTHealth (University of Texas) also contributed to this research.

The BiomedGPT open source model is available strictly for academic research purposes here.

Zhang K, Zhou R, Adhikarla E, Yan Z, Liu Y, Yu J, Liu Z, Chen X, Davison BD, Ren H, Huang J, Chen C, Zhou Y, Fu S, Liu W, Liu T, Li X, Chen Y, He L, Zou J, Li Q, Liu H, Sun L.
A generalist vision-language foundation model for diverse biomedical tasks.
Nat Med. 2024 Nov;30(11):3129-3141. doi: 10.1038/s41591-024-03185-2

Most Popular Now

AI-Powered CRISPR could Lead to Faster G…

Stanford Medicine researchers have developed an artificial intelligence (AI) tool to help scientists better plan gene-editing experiments. The technology, CRISPR-GPT, acts as a gene-editing “copilot” supported by AI to help...

Groundbreaking AI Aims to Speed Lifesavi…

To solve a problem, we have to see it clearly. Whether it’s an infection by a novel virus or memory-stealing plaques forming in the brains of Alzheimer’s patients, visualizing disease processes...

AI Spots Hidden Signs of Depression in S…

Depression is one of the most common mental health challenges, but its early signs are often overlooked. It is often linked to reduced facial expressivity. However, whether mild depression or...

AI Model Forecasts Disease Risk Decades …

Imagine a future where your medical history could help predict what health conditions you might face in the next two decades. Researchers have developed a generative AI model that uses...

AI Tools Help Predict Severe Asthma Risk…

Mayo Clinic researchers have developed artificial intelligence (AI) tools that help identify which children with asthma face the highest risk of serious asthma exacerbation and acute respiratory infections. The study...

AI Model Indicates Four out of Ten Breas…

A project at Lund University in Sweden has trained an AI model to identify breast cancer patients who could be spared from axillary surgery. The model analyses previously unutilised information...

Smart Device Uses AI and Bioelectronics …

As a wound heals, it goes through several stages: clotting to stop bleeding, immune system response, scabbing, and scarring. A wearable device called "a-Heal," designed by engineers at the University...

AI Distinguishes Glioblastoma from Look-…

A Harvard Medical School–led research team has developed an AI tool that can reliably tell apart two look-alike cancers found in the brain but with different origins, behaviors, and treatments. The...

ChatGPT 4o Therapeutic Chatbot 'Ama…

One of the first randomized controlled trials assessing the effectiveness of a large language model (LLM) chatbot 'Amanda' for relationship support shows that a single session of chatbot therapy...

Overcoming the AI Applicability Crisis a…

Opinion Article by Harry Lykostratis, Chief Executive, Open Medical. The government’s 10 Year Health Plan makes a lot of the potential of AI-software to support clinical decision making, improve productivity, and...

Dartford and Gravesham Implements Clinis…

Dartford and Gravesham NHS Trust has taken a significant step towards a more digital future by rolling out electronic test ordering using Clinisys ICE. The trust deployed the order communications...