Summary: A new study reveals that people who are blind can recognize faces using auditory patterns processed by the fusiform face area, a brain region crucial for face processing in sighted individuals.
The study employed a sensory substitution device to translate images into sound, demonstrating that face recognition in the brain isn’t solely dependent on visual experience. Blind and sighted participants underwent functional MRI scans, showing that the fusiform face area encodes the concept of a face, irrespective of the sensory input.
This discovery challenges the understanding of how facial recognition develops and functions in the brain.
Key Facts:
- The study shows that the fusiform face area in the brain can process the concept of a face through auditory patterns, not just visually.
- Functional MRI scans revealed that this area is active in both blind and sighted individuals during face recognition tasks.
- The research utilized a specialized device to translate visual information into sound, enabling blind participants to recognize basic facial configurations.
Source: Georgetown University Medical Center
Using a specialized device that translates images into sound, Georgetown University Medical Center neuroscientists and colleagues showed that people who are blind recognized basic faces using the part of the brain known as the fusiform face area, a region that is crucial for the processing of faces in sighted people.
The findings appeared in PLOS ONE on November 22, 2023.
“It’s been known for some time that people who are blind can compensate for their loss of vision, to a certain extent, by using their other senses,” says Josef Rauschecker, Ph.D., D.Sc., professor in the Department of Neuroscience at Georgetown University and senior author of this study.
“Our study tested the extent to which this plasticity, or compensation, between seeing and hearing exists by encoding basic visual patterns into auditory patterns with the aid of a technical device we refer to as a sensory substitution device. With the use of functional magnetic resonance imaging (fMRI), we can determine where in the brain this compensatory plasticity is taking place.”
Face perception in humans and nonhuman primates is accomplished by a patchwork of specialized cortical regions. How these regions develop has remained controversial. Due to their importance for social behavior, many researchers believe that the neural mechanisms for face recognition are innate in primates or depend on early visual experience with faces.
“Our results from people who are blind implies that fusiform face area development does not depend on experience with actual visual faces but on exposure to the geometry of facial configurations, which can be conveyed by other sensory modalities,” Rauschecker adds.
Paula Plaza, Ph.D., one of the lead authors of the study, who is now at Universidad Andres Bello, Chile, says, “Our study demonstrates that the fusiform face area encodes the ‘concept’ of a face regardless of input channel, or the visual experience, which is an important discovery.”
Six people who are blind and 10 sighted people, who served as control subjects, went through three rounds of functional MRI scans to see what parts of the brain were being activated during the translations from image into sound.
The scientists found that brain activation by sound in people who are blind was found primarily in the left fusiform face area while face processing in sighted people occurred mostly in the right fusiform face area.
“We believe the left/right difference between people who are and aren’t blind may have to do with how the left and right sides of the fusiform area processes faces – either as connected patterns or as separate parts, which may be an important clue in helping us refine our sensory substitution device,” says Rauschecker, who is also co-director of the Center for Neuroengineering at Georgetown University.
Currently, with their device, people who are blind can recognize a basic ‘cartoon’ face (such as an emoji happy face) when it is transcribed into sound patterns. Recognizing faces via sounds was a time-intensive process that took many practice sessions.
Each session started with getting people to recognize simple geometrical shapes, such as horizontal and vertical lines; complexity of the stimuli was then gradually increased, so the lines formed shapes, such as houses or faces, which then became even more complex (tall versus wide houses and happy faces versus sad faces).
Ultimately, the scientists would like to use pictures of real faces and houses in combination with their device, but the researchers note that they would first have to greatly increase the resolution of the device.
“We would love to be able to find out whether it is possible for people who are blind to learn to recognize individuals from their pictures. This may need a lot more practice with our device but now that we’ve pinpointed the region of the brain where the translation is taking place, we may have a better handle on how to fine-tune our processes,” Rauschecker concludes.
In addition to Rauschecker, the other authors at Georgetown University are Laurent Renier and Stephanie Rosemann. Anne G. De Volder, who passed away while this manuscript was in preparation, was at the Neural Rehabilitation Laboratory, Institute of Neuroscience, Université Catholique de Louvain, Brussels, Belgium.
Funding: This work was supported by a grant from the National Eye Institute (#R01 EY018923).
The authors declare no personal financial interests related to the study.

News
This Startup Says It Can Clean Your Blood of Microplastics
This is a non-exhaustive list of places microplastics have been found: Mount Everest, the Mariana Trench, Antarctic snow, clouds, plankton, turtles, whales, cattle, birds, tap water, beer, salt, human placentas, semen, breast milk, feces, testicles, [...]
New Blood Test Detects Alzheimer’s and Tracks Its Progression With 92% Accuracy
The new test could help identify which patients are most likely to benefit from new Alzheimer’s drugs. A newly developed blood test for Alzheimer’s disease not only helps confirm the presence of the condition but also [...]
The CDC buried a measles forecast that stressed the need for vaccinations
This story was originally published on ProPublica, a nonprofit newsroom that investigates abuses of power. Sign up to receive our biggest stories as soon as they’re published. ProPublica — Leaders at the Centers for Disease Control and Prevention [...]
Light-Driven Plasmonic Microrobots for Nanoparticle Manipulation
A recent study published in Nature Communications presents a new microrobotic platform designed to improve the precision and versatility of nanoparticle manipulation using light. Led by Jin Qin and colleagues, the research addresses limitations in traditional [...]
Cancer’s “Master Switch” Blocked for Good in Landmark Study
Researchers discovered peptides that permanently block a key cancer protein once thought untreatable, using a new screening method to test their effectiveness inside cells. For the first time, scientists have identified promising drug candidates [...]
AI self-cloning claims: A new frontier or a looming threat?
Chinese scientists claim that some AI models can replicate themselves and protect against shutdown. Has artificial intelligence crossed the so-called red line? Chinese researchers have published two reports on arXiv claiming that some artificial [...]
New Drug Turns Human Blood Into Mosquito-Killing Weapon
Nitisinone, a drug for rare diseases, kills mosquitoes when present in human blood and may become a new tool to fight malaria, offering longer-lasting, environmentally safer effects than ivermectin. Controlling mosquito populations is a [...]
DNA Microscopy Creates 3D Maps of Life From the Inside Out
What if you could take a picture of every gene inside a living organism—not with light, but with DNA itself? Scientists at the University of Chicago have pioneered a revolutionary imaging technique called volumetric DNA microscopy. It builds [...]
Scientists Just Captured the Stunning Process That Shapes Chromosomes
Scientists at EMBL have captured how human chromosomes fold into their signature rod shape during cell division, using a groundbreaking method called LoopTrace. By observing overlapping DNA loops forming in high resolution, they revealed that large [...]
Bird Flu Virus Is Mutating Fast – Scientists Say Our Vaccines May Not Be Enough
H5N1 influenza is evolving rapidly, weakening the effectiveness of existing antibodies and increasing its potential threat to humans. Scientists at UNC Charlotte and MIT used high-performance computational modeling to analyze thousands of viral protein-antibody interactions, revealing [...]
Revolutionary Cancer Vaccine Targets All Solid Tumors
The method triggers immune responses that inhibit melanoma, triple-negative breast cancer, lung carcinoma, and ovarian cancer. Cancer treatment vaccines have been in development since 2010, when the first was approved for prostate cancer, followed [...]
Scientists Uncover Hidden Protein Driving Autoimmune Attacks
Scientists have uncovered a critical piece of the puzzle in autoimmune diseases: a protein that helps release immune response molecules. By studying an ultra-rare condition, researchers identified ArfGAP2 as a key player in immune [...]
Mediterranean neutrino observatory sets new limits on quantum gravity
Quantum gravity is the missing link between general relativity and quantum mechanics, the yet-to-be-discovered key to a unified theory capable of explaining both the infinitely large and the infinitely small. The solution to this [...]
Challenging Previous Beliefs: Japanese Scientists Discover Hidden Protector of Heart
A Japanese research team found that the oxidized form of glutathione (GSSG) may protect heart tissue by modifying a key protein, potentially offering a novel therapeutic approach for ischemic heart failure. A new study [...]
Millions May Have Long COVID – So Why Can’t They Get Diagnosed?
Millions of people in England may be living with Long Covid without even realizing it. A large-scale analysis found that nearly 10% suspect they might have the condition but remain uncertain, often due to [...]
Researchers Reveal What Happens to Your Brain When You Don’t Get Enough Sleep
What if poor sleep was doing more than just making you tired? Researchers have discovered that disrupted sleep in older adults interferes with the brain’s ability to clean out waste, leading to memory problems [...]