The brain, despite its comparatively shallow structure with limited layers, operates efficiently, whereas modern AI systems are characterized by deep architectures with numerous layers. This raises the question: Can brain-inspired shallow architectures rival the performance of deep architectures, and if so, what are the fundamental mechanisms that enable this?
Neural network learning methods are inspired by the brain's functioning, yet there are fundamental differences between how the brain learns and how deep learning operates. A key distinction lies in the number of layers each employs.
Deep learning systems often have many layers, sometimes extending into the hundreds, which allows them to effectively learn complex classification tasks. In contrast, the human brain has a much simpler structure with far fewer layers. Despite its relatively shallow architecture and the slower, noisier nature of its processes, the brain is remarkably adept at handling complex classification tasks efficiently.
Research on Shallow Learning Mechanisms in the Brain
The key question driving new research is the possible mechanism underlying the brain's efficient shallow learning — one that enables it to perform classification tasks with the same accuracy as deep learning. In an article published in Physica A, researchers from Bar-Ilan University in Israel show how such shallow learning mechanisms can compete with deep learning.
Credit: Prof. Ido Kanter, Bar-Ilan University
"Instead of a deep architecture, like a skyscraper, the brain consists of a wide shallow architecture, more like a very wide building with only very few floors," said Prof. Ido Kanter, of Bar-Ilan's Department of Physics and Gonda (Goldschmied) Multidisciplinary Brain Research Center, who led the research.
"The capability to correctly classify objects increases where the architecture becomes deeper, with more layers. In contrast, the brain's shallow mechanism indicates that a wider network better classifies objects," said Ronit Gross, an undergraduate student and one of the key contributors to this work.
"Wider and higher architectures represent two complementary mechanisms," she added. Nevertheless, the realization of very wide shallow architectures, imitating the brain's dynamics, requires a shift in the properties of advanced GPU technology, which is capable of accelerating deep architecture, but fails in the implementation of wide shallow ones.
Reference: "Efficient shallow learning mechanism as an alternative to deep learning" by Ofek Tevet, Ronit D. Gross, Shiri Hodassman, Tal Rogachevsky, Yarden Tzach, Yuval Meir and Ido Kanter, 11 January 2024, Physica A: Statistical Mechanics and its Applications.
DOI: 10.1016/j.physa.2024.129513
News
AI-designed universal coronavirus vaccine clears first human trial
Key Takeaways Super-Antigen Technology: Uses AI and machine learning to analyze viral genomes, creating a single vaccine that targets essential features across entire virus families, including coronaviruses and Ebola. Human Trials & Safety: Phase [...]
Researchers Discover a Hidden Vitamin D Problem That Persists Year-Round
A new study suggests that some groups may not experience the expected seasonal boost in vitamin D levels, even during the sunniest months of the year. Many people assume that spending more time outdoors [...]
Researchers Solve the Mystery Behind a Billion-Dollar Dental Implant Disease
Researchers have uncovered why a common and costly dental implant infection often resists antibiotics. Dental implants have helped tens of millions of people regain a full set of stable, functional teeth, something traditional dentures [...]
Nanoparticles inspired by lung fluid improve therapies targeting respiratory system
The CIC biomaGUNE Center for Cooperative Research in Biomaterials has developed pulmonary surfactant nanoparticles (the blend of lipids and proteins that line the alveoli and enables breathing), which are encapsulated [...]
Scientists Finally Uncover How a “Forever Chemical” Causes Birth Defects
PFDA, a PFAS “forever chemical,” can cause craniofacial birth defects by disrupting retinoic acid regulation during fetal development, revealing the first clear molecular mechanism behind the link. Researchers have long linked perfluoroalkyl and polyfluoroalkyl substances (PFAS), [...]
Scientists Have Discovered These Deadly Parasites Are Secretly Swapping DNA
Leishmania parasites appear to evolve through widespread genetic exchange, reshaping assumptions about how they adapt and spread. A parasite long thought to spread mostly by cloning itself may be far more genetically dynamic than [...]
Stanford’s Revolutionary New Microscope Reveals Living Cells in Stunning Detail
Stanford researchers have developed a microscope that can show how nanostructures interact inside living cells at the highest resolution achieved so far. The view into living cells just got better. Stanford researchers have merged [...]
What Bundibugyo Ebola vaccines and treatments are under development
By Mariam Sunny and Jennifer Rigby May 29 (Reuters) – Global health authorities are racing to identify medical options to help contain an Ebola outbreak in eastern Democratic Republic of Congo, linked to the [...]
Why More People in Their 30s Are Suddenly Getting Colon Cancer
A major Swiss study found that colorectal cancer is becoming increasingly common in adults under 50, even as rates decline in older age groups. Researchers in Switzerland have identified a concerning trend: while colorectal [...]
Researchers Compare MS Models to Human Tissue in Search for Better Therapies
Researchers identified key differences between two widely used multiple sclerosis models, showing how each can better study myelin damage, immune responses, and repair. The findings may improve efforts to develop treatments that restore lost [...]
Scientists Discover Genetic “Off Switch” That Supercharges CAR T Cells Against Cancer
A new study reveals a possible way to make CAR T-cell therapy more durable and effective by targeting a single gene-regulating protein. CAR T-cell therapy is widely seen as a breakthrough in personalized cancer [...]
New Vitamin B12-Based Therapy Could Change How Brain Cancer Is Treated
Researchers have identified a vitamin B12–based compound that appears capable of crossing the blood–brain barrier and selectively accumulating in glioblastoma tissue. For decades, one of the biggest problems in brain cancer treatment has had [...]
Simple Fiber Supplement Cuts Knee Arthritis Pain in Just 6 Weeks, Study Finds
A daily inulin supplement may help reduce knee osteoarthritis pain while revealing a possible link between gut health, muscle function, and pain sensitivity. For millions of people living with knee osteoarthritis, managing chronic pain [...]
This Common Vitamin May Help Stop Prediabetes From Turning Into Diabetes
Vitamin D may help prevent type 2 diabetes in people with specific genetic variations, offering a possible path toward personalized diabetes prevention. More than 40% of U.S. adults have prediabetes, a condition in which [...]
Ebola, hantavirus: Is the world prepared for the next pandemic?
Funding cuts to health research and a growing antivaccine movement are making it harder than ever to respond to viruses. The World Health Organization (WHO) has declared that an Ebola outbreak in Uganda and [...]
May 2026 Healthcare News and Trends: Market Signals That Matter
Artificial intelligence is dominating headlines, telehealth has settled into a new normal, and digital health continues to promise transformation. However, much of what is being discussed in healthcare today reflects potential rather than reality. [...]
