New Computational Model of Real Neurons could Lead to Better AI

Nearly all the neural networks that power modern artificial intelligence (AI) tools such as ChatGPT are based on a 1960s-era computational model of a living neuron. A new model developed at the Flatiron Institute's Center for Computational Neuroscience (CCN) suggests that this decades-old approximation doesn’t capture all the computational abilities that real neurons possess and that this older model is potentially holding back AI development.

The new model developed at CCN posits that individual neurons exert more control over their surroundings than previously thought. The updated neuron model could ultimately lead to more powerful artificial neural networks that better capture the powers of our brains, the model developers say. The researchers present the revolutionary model in a paper published the week of June 24 in the journal Proceedings of the National Academy of Sciences.

"Neuroscience has advanced quite a bit in these past 60 years, and we now recognize that previous models of neurons are rather rudimentary," says Dmitri Chklovskii, a group leader at the CCN and senior author of the new paper. "A neuron is a much more complex device - and much smarter - than this overly simplified model."

Artificial neural networks aim to mimic the way in which the human brain processes information and makes decisions, albeit in a much more simplified manner. These networks are built of ordered layers of 'nodes' based on the 1960s neuron model. The network starts with an input layer of nodes that receives information, then has middle layers of nodes that process the information, and then ends with an output layer of nodes that sends out the results.

Typically, a node will only pass information to the next layer if the total input it receives from the previous layer’s nodes exceeds a certain threshold. When current artificial neural networks are trained, information goes through a node in only one direction, and there’s no way for nodes to influence the information they receive from nodes earlier in the chain.

In contrast, the newly published model treats neurons as tiny 'controllers,' an engineering term for devices that can influence their surroundings based on information gathered about those surroundings. Not merely passive relays of input, our brain cells may actually work to control the state of their fellow neurons.

Chklovskii believes that this more realistic model of a neuron-as-controller could be a significant step toward improving the performance and efficiency of many machine learning applications.

"Although AI's achievements are very impressive, there are still many problems," he says. "The current applications can give you wrong answers, or hallucinate, and training them requires a lot of energy; they're very expensive. There are all these problems that the human brain seems to avoid. If we were to understand how the brain actually does this, we could build better AI."

The neuron-as-controller model was inspired by what scientists do understand about large-scale circuits in the brain made up of many neurons. Most brain circuits are thought to be organized into feedback loops, where cells later in the processing chain influence what happens earlier in the chain. Much like a thermostat maintaining the temperature of a house or building, brain circuits need to keep themselves stable to avoid overwhelming the body’s system with activity.

Chklovskii says it was not entirely intuitive that this kind of feedback control could also be realized by an individual brain cell. He and his colleagues realized that a novel form of control, known as direct data-driven control, is straightforward and efficient enough to be biologically plausible as taking place in individual cells.

"People thought of the brain as a whole or even parts of the brain as being a controller, but no one suggested that a single neuron could do that," Chklovskii says. "Control is a computationally intensive task. It's hard to think of a neuron as having enough computational capacity."

Viewing neurons as mini-controllers also explains several previously unexplained biological phenomena, Chklovskii says. For example, it's long been appreciated that there’s a lot of noise in the brain, and the purpose of this biological randomness has been debated, but the CCN team found through their modeling that certain types of noise could actually enhance neurons' performance.

More specifically, at junctions where one neuron connects to another (called ‘synapses’), there are often instances where a neuron transmits an electrical signal but the downstream coupled neuron does not get the message. Whether and when the downstream neuron receives a synaptic signal seems to be governed largely by chance. While other scientists have speculated that such randomness was just the nature of small biological systems and not important to neuron behavior, the Flatiron team found that adding noise to their model neuron allowed it to adapt to a constantly changing environment. The randomness appears to be important in replicating how real neurons function, the team found.

Chklovskii next plans to analyze types of neurons that don’t fit their new model. For example, neurons in the retina receive direct inputs from the visual environment. These neurons may not be able to control their inputs the way neurons deeper in the brain can, but they might use some of the same principles Chklovskii and his team identified: namely, these neurons might be able to predict their inputs, even if they can’t influence them.

"Control and prediction are actually very related," Chklovskii says. "You cannot control efficiently without predicting the impact of your actions in the world."

Moore JJ, Genkin A, Tournoy M, Pughe-Sanford JL, de Ruyter van Steveninck RR, Chklovskii DB.
The neuron as a direct data-driven controller.
Proc Natl Acad Sci U S A. 2024 Jul 2;121(27):e2311893121. doi: 10.1073/pnas.2311893121

Most Popular Now

AI for Real-Rime, Patient-Focused Insigh…

A picture may be worth a thousand words, but still... they both have a lot of work to do to catch up to BiomedGPT. Covered recently in the prestigious journal Nature...

A "Chemical ChatGPT" for New M…

Researchers from the University of Bonn have trained an AI process to predict potential active ingredients with special properties. Therefore, they derived a chemical language model - a kind of...

Siemens Healthineers co-leads EU Project…

Siemens Healthineers is joining forces with more than 20 industry and public partners, including seven leading stroke hospitals, to improve stroke management for patients all over Europe. With a total...

In 10 Seconds, an AI Model Detects Cance…

Researchers have developed an AI powered model that - in 10 seconds - can determine during surgery if any part of a cancerous brain tumor that could be removed remains...

Does AI Improve Doctors' Diagnoses?

With hospitals already deploying artificial intelligence to improve patient care, a new study has found that using Chat GPT Plus does not significantly improve the accuracy of doctors' diagnoses when...

AI Analysis of PET/CT Images can Predict…

Dr. Watanabe and his teams from Niigata University have revealed that PET/CT image analysis using artificial intelligence (AI) can predict the occurrence of interstitial lung disease, known as a serious...

MEDICA and COMPAMED 2024: Shining a Ligh…

11 - 14 November 2024, Düsseldorf, Germany. Christian Grosser, Director Health & Medical Technologies, is looking forward to events getting under way: "From next Monday to Thursday, we will once again...

New Medical AI Tool Identifies more Case…

Investigators at Mass General Brigham have developed an AI-based tool to sift through electronic health records to help clinicians identify cases of long COVID, an often mysterious condition that can...

NIH-Developed AI Algorithm Successfully …

Researchers from the National Institutes of Health (NIH) have developed an artificial intelligence (AI) algorithm to help speed up the process of matching potential volunteers to relevant clinical research trials...

Jane Stephenson Joins SPARK TSL as Chief…

Jane Stephenson has joined SPARK TSL as chief executive as the company looks to establish the benefits of SPARK Fusion with trusts looking for deployable solutions to improve productivity. Stephenson joins...

MEDICA 2024 and COMPAMED 2024: Medical T…

11 - 14 November 2024, Düsseldorf, Germany. "Meet Health. Future. People." is MEDICA's campaign motto for the future in the new trade fair year 2025. The aptness of the motto...

500 Patient Images per Second Shared thr…

The image exchange portal, widely known in the NHS as the IEP, is now being used to share as many as 500 images each second - including x-rays, CT, MRI...