Summary: Researchers developed a single-chip device that mimics the human eye’s capacity to capture, process, and store visual data.
This groundbreaking innovation, fueled by a thin layer of doped indium oxide, could be a significant leap towards applications like self-driving cars that require quick, complex decision-making abilities. Unlike traditional systems that need external, energy-intensive computation, this device encapsulates sensing, information processing, and memory retention in one compact unit.
As a result, it enables real-time decision-making without being hampered by processing extraneous data or being delayed by transferring information to separate processors.
Key Facts:
- The neuromorphic device uses a single layer of doped indium oxide, which is thousands of times thinner than a human hair, to mimic the human eye’s ability to capture, process, and store visual information.
- The device can retain information for more extended periods without the need for frequent electric signals to refresh the memory, significantly reducing energy consumption and improving performance.
- The scientists behind the device envisage a wide range of applications, from self-driving cars to bionic vision and advanced forensics. Future work includes extending the technology for visible and infrared light detection.
Source: RMIT University
Researchers have created a small device that ‘sees’ and creates memories in a similar way to humans, in a promising step towards one day having applications that can make rapid, complex decisions such as in self-driving cars.
The neuromorphic invention is a single chip enabled by a sensing element, doped indium oxide, that’s thousands of times thinner than a human hair and requires no external parts to operate.
RMIT University engineers in Australia led the work, with contributions from researchers at Deakin University and the University of Melbourne.
The team’s research demonstrates a working device that captures, processes and stores visual information. With precise engineering of the doped indium oxide, the device mimics a human eye’s ability to capture light, pre-packages and transmits information like an optical nerve, and stores and classifies it in a memory system like the way our brains can.
Collectively, these functions could enable ultra-fast decision making, the team says.
Team leader Professor Sumeet Walia said the new device can perform all necessary functions – sensing, creating and processing information, and retaining memories – rather than relying on external energy-intensive computation, which prevents real-time decision making.
“Performing all of these functions on one small device had proven to be a big challenge until now,” said Walia from RMIT’s School of Engineering.
“We’ve made real-time decision making a possibility with our invention, because it doesn’t need to process large amounts of irrelevant data and it’s not being slowed down by data transfer to separate processors.”
What did the team achieve and how does the technology work?
The new device was able to demonstrate an ability to retain information for longer periods of time, compared to previously reported devices, without the need for frequent electrical signals to refresh the memory. This ability significantly reduces energy consumption and enhances the device’s performance.
Their findings and analysis are published in Advanced Functional Materials.
First author and RMIT PhD researcher Aishani Mazumder said the human brain used analog processing, which allowed it to process information quickly and efficiently using minimal energy.
“By contrast, digital processing is energy and carbon intensive, and inhibits rapid information gathering and processing,” she said.
“Neuromorphic vision systems are designed to use similar analog processing to the human brain, which can greatly reduce the amount of energy needed to perform complex visual tasks compared with today’s technologies
What are the potential applications?
The team used ultraviolet light as part of their experiments, and are working to expand this technology even further for visible and infrared light – with many possible applications such as bionic vision, autonomous operations in dangerous environments, shelf-life assessments of food and advanced forensics.
“Imagine a self-driving car that can see and recognise objects on the road in the same way that a human driver can or being able to able to rapidly detect and track space junk. This would be possible with neuromorphic vision technology.”
Walia said neuromorphic systems could adapt to new situations over time, becoming more efficient with more experience.
“Traditional computer vision systems – which cannot be miniaturised like neuromorphic technology – are typically programmed with specific rules and can’t adapt as easily,” he said.
“Neuromorphic robots have the potential to run autonomously for long periods, in dangerous situations where workers are exposed to possible cave-ins, explosions and toxic air.”
The human eye has a single retina that captures an entire image, which is then processed by the brain to identify objects, colours and other visual features.
The team’s device mimicked the retina’s capabilities by using single-element image sensors that capture, store and process visual information on one platform, Walia said.
“The human eye is exceptionally adept at responding to changes in the surrounding environment in a faster and much more efficient way than cameras and computers currently can,” he said.
“Taking inspiration from the eye, we have been working for several years on creating a camera that possesses similar abilities, through the process of neuromorphic engineering.”
Support for the research
The team used the Micro Nano Research Facility and the Microscopy and Microanalysis Research Facility at RMIT.
Funding: The work was also supported by the Australian Research Council and the National Computational Infrastructure.
![](https://www.nanoappsmedical.com/wp-content/uploads/2017/05/spacer.jpg)
News
Ethics in Nanomedicine: Key Issues and Principles
Nanomedicine, a branch of nanotechnology, is revolutionizing healthcare by enabling the manipulation of materials at the nanoscale to diagnose, treat, and prevent diseases. Unlike traditional treatments, nanoparticles (NPs) are highly precise in targeting diseased [...]
A call for robust H5N1 influenza preparedness and response
As the global threat of H5N1 influenza looms with outbreaks across species and continents including the U.S., three international vaccine and public health experts say it is time to fully resource and support a [...]
Mucosal COVID-19 boosters outperform mRNA shots in preventing upper airway infections
In a recent study published in Nature Immunology, a team of researchers from the United States used non-human primate models to compare the protection conferred by an intramuscular booster dose of the bivalent messenger ribonucleic acid [...]
How Space Travel Really Changes Astronauts – From the Inside Out
International team reveals previously unknown effects on physiology that could shape the future of long-duration space missions. Researchers have discovered significant changes in the gut microbiome due to spaceflight, which affects host physiology and [...]
Breakthrough in blood stem cell development offers hope for leukemia and bone marrow failure
Melbourne researchers have made a world first breakthrough into creating blood stem cells that closely resemble those in the human body. And the discovery could soon lead to personalized treatments for children with leukemia [...]
Scientists Develop Game-Changing Needle-Free COVID-19 Intranasal Vaccine
A new mucosal COVID-19 vaccine poised to revolutionize the delivery process is especially beneficial for those with a fear of needles. A next-generation COVID-19 mucosal vaccine is set to be a game-changer not only when delivering [...]
Scientists Develop All-in-One Solution To Catch and Destroy “Forever Chemicals”
A new water treatment system developed by UBC researchers efficiently removes and destroys PFAS pollutants using a dual-action catalyst, offering a sustainable and cost-effective solution for water purification challenges. Chemical engineers at the University of [...]
New method accelerates drug discovery from years to months
Researchers from the University of Cincinnati College of Medicine and Cincinnati Children's Hospital have found a new method to increase both speed and success rates in drug discovery. The study, published Aug. 30 in [...]
A new smart mask analyzes your breath to monitor your health
Your breath can give away a lot about you. Each exhalation contains all sorts of compounds, including possible biomarkers for disease or lung conditions, that could give doctors a valuable insight into your health. [...]
Study reveals the role of blood clotting in COVID-19
In a study that reshapes what we know about COVID-19 and its most perplexing symptoms, scientists have discovered that the blood coagulation protein fibrin causes the unusual clotting and inflammation that have become hallmarks [...]
A Novel Cancer Vaccine Combining Nano-11 and ADU-S100
In a recent article published in npj Vaccines, researchers detailed the development of a novel cancer vaccine that combines a plant-derived nanoparticle adjuvant, Nano-11, with a clinically tested STING agonist, ADU-S100. The primary objective was [...]
AI spots cancer and viral infections with nanoscale precision
Researchers have developed an artificial intelligence which can differentiate cancer cells from normal cells, as well as detect the very early stages of viral infection inside cells. The findings, published today in a study [...]
Tiny shards of plastic are increasingly infiltrating our brains, study says
Human brain samples collected at autopsy in early 2024 contained more tiny shards of plastic than samples collected eight years prior, according to a preprint posted online in May. A preprint is a study which has not yet [...]
Scientists Have Discovered Strange DNA in Our Brains – and It Could Be Shortening Our Lives
According to the research, these mitochondrial DNA insertions could be linked to early death. Mitochondria in brain cells frequently insert their DNA into the nucleus, potentially impacting lifespan, as those with more insertions were found to [...]
Watch Out After a Hospital Stay: You Could Be Exposing Your Family to Superbugs
Research indicates hospitals contribute to the local spread of antibiotic-resistant infections. A recent study published in the journal Infection Control & Hospital Epidemiology by the Society for Healthcare Epidemiology of America suggests that family members of [...]
Molecular Trickery: How COVID-19 Silently Sabotages the Human Immune System
Researchers have discovered that SARS-CoV-2 manipulates the human immune system by forcing cells to produce non-functional proteins, hindering the body’s antiviral defenses. This groundbreaking study by teams from prestigious Brazilian universities highlights potential targets for new COVID-19 treatments, [...]