A new mathematical model enhances the evaluation of AI identification risks, offering a scalable solution to balance technological benefits with privacy protection.
AI tools are increasingly used to track and monitor people both online and in person, but their effectiveness carries significant risks. To address this, computer scientists from the Oxford Internet Institute, Imperial College London, and UCLouvain have developed a new mathematical model designed to help people better understand the dangers of AI and support regulators in safeguarding privacy. Their findings were published in Nature Communications.
This model is the first to offer a solid scientific framework for evaluating identification methods, particularly when handling large-scale data. It can assess the accuracy of techniques like advertising codes and invisible trackers in identifying online users based on minimal information—such as time zones or browser settings—a process known as “browser fingerprinting.”
Lead author Dr. Luc Rocher, Senior Research Fellow, Oxford Internet Institute, part of the University of Oxford, said: “We see our method as a new approach to help assess the risk of re-identification in data release, but also to evaluate modern identification techniques in critical, high-risk environments. In places like hospitals, humanitarian aid delivery, or border control, the stakes are incredibly high, and the need for accurate, reliable identification is paramount.”
Leveraging Bayesian Statistics for Improved Accuracy
The method draws on the field of Bayesian statistics to learn how identifiable individuals are on a small scale, and extrapolate the accuracy of identification to larger populations up to 10x better than previous heuristics and rules of thumb. This gives the method unique power in assessing how different data identification techniques will perform at scale, in different applications and behavioral settings. This could help explain why some AI identification techniques perform highly accurately when tested in small case studies but then misidentify people in real-world conditions.
The findings are highly timely, given the challenges posed to anonymity and privacy caused by the rapid rise of AI-based identification techniques. For instance, AI tools are being trialed to automatically identify humans from their voice in online banking, their eyes in humanitarian aid delivery, or their face in law enforcement.
According to the researchers, the new method could help organizations to strike a better balance between the benefits of AI technologies and the need to protect people’s personal information, making daily interactions with technology safer and more secure. Their testing method allows for the identification of potential weaknesses and areas for improvement before full-scale implementation, which is essential for maintaining safety and accuracy.
A Crucial Tool for Data Protection
Co-author Associate Professor Yves-Alexandre de Montjoye (Data Science Institute, Imperial College, London) said: “Our new scaling law provides, for the first time, a principled mathematical model to evaluate how identification techniques will perform at scale. Understanding the scalability of identification is essential to evaluate the risks posed by these re-identification techniques, including to ensure compliance with modern data protection legislations worldwide.”
Dr. Luc Rocher concluded: “We believe that this work forms a crucial step towards the development of principled methods to evaluate the risks posed by ever more advanced AI techniques and the nature of identifiability in human traces online. We expect that this work will be of great help to researchers, data protection officers, ethics committees, and other practitioners aiming to find a balance between sharing data for research and protecting the privacy of patients, participants, and citizens.”
Reference: “A scaling law to model the effectiveness of identification techniques” by Luc Rocher, Julien M. Hendrickx and Yves-Alexandre de Montjoye, 9 January 2025, Nature Communications.
DOI: 10.1038/s41467-024-55296-6
The work was supported by a grant awarded to Luc Rocher by Royal Society Research Grant RG\R2\232035, the John Fell OUP Research Fund, the UKRI Future Leaders Fellowship [grant MR/Y015711/1], and by the F.R.S.-FNRS. Yves -Alexandre de Montjoye acknowledges funding from the Information Commissioner Office.
News
The CDC buried a measles forecast that stressed the need for vaccinations
This story was originally published on ProPublica, a nonprofit newsroom that investigates abuses of power. Sign up to receive our biggest stories as soon as they’re published. ProPublica — Leaders at the Centers for Disease Control and Prevention [...]
Light-Driven Plasmonic Microrobots for Nanoparticle Manipulation
A recent study published in Nature Communications presents a new microrobotic platform designed to improve the precision and versatility of nanoparticle manipulation using light. Led by Jin Qin and colleagues, the research addresses limitations in traditional [...]
Cancer’s “Master Switch” Blocked for Good in Landmark Study
Researchers discovered peptides that permanently block a key cancer protein once thought untreatable, using a new screening method to test their effectiveness inside cells. For the first time, scientists have identified promising drug candidates [...]
AI self-cloning claims: A new frontier or a looming threat?
Chinese scientists claim that some AI models can replicate themselves and protect against shutdown. Has artificial intelligence crossed the so-called red line? Chinese researchers have published two reports on arXiv claiming that some artificial [...]
New Drug Turns Human Blood Into Mosquito-Killing Weapon
Nitisinone, a drug for rare diseases, kills mosquitoes when present in human blood and may become a new tool to fight malaria, offering longer-lasting, environmentally safer effects than ivermectin. Controlling mosquito populations is a [...]
DNA Microscopy Creates 3D Maps of Life From the Inside Out
What if you could take a picture of every gene inside a living organism—not with light, but with DNA itself? Scientists at the University of Chicago have pioneered a revolutionary imaging technique called volumetric DNA microscopy. It builds [...]
Scientists Just Captured the Stunning Process That Shapes Chromosomes
Scientists at EMBL have captured how human chromosomes fold into their signature rod shape during cell division, using a groundbreaking method called LoopTrace. By observing overlapping DNA loops forming in high resolution, they revealed that large [...]
Bird Flu Virus Is Mutating Fast – Scientists Say Our Vaccines May Not Be Enough
H5N1 influenza is evolving rapidly, weakening the effectiveness of existing antibodies and increasing its potential threat to humans. Scientists at UNC Charlotte and MIT used high-performance computational modeling to analyze thousands of viral protein-antibody interactions, revealing [...]
Revolutionary Cancer Vaccine Targets All Solid Tumors
The method triggers immune responses that inhibit melanoma, triple-negative breast cancer, lung carcinoma, and ovarian cancer. Cancer treatment vaccines have been in development since 2010, when the first was approved for prostate cancer, followed [...]
Scientists Uncover Hidden Protein Driving Autoimmune Attacks
Scientists have uncovered a critical piece of the puzzle in autoimmune diseases: a protein that helps release immune response molecules. By studying an ultra-rare condition, researchers identified ArfGAP2 as a key player in immune [...]
Mediterranean neutrino observatory sets new limits on quantum gravity
Quantum gravity is the missing link between general relativity and quantum mechanics, the yet-to-be-discovered key to a unified theory capable of explaining both the infinitely large and the infinitely small. The solution to this [...]
Challenging Previous Beliefs: Japanese Scientists Discover Hidden Protector of Heart
A Japanese research team found that the oxidized form of glutathione (GSSG) may protect heart tissue by modifying a key protein, potentially offering a novel therapeutic approach for ischemic heart failure. A new study [...]
Millions May Have Long COVID – So Why Can’t They Get Diagnosed?
Millions of people in England may be living with Long Covid without even realizing it. A large-scale analysis found that nearly 10% suspect they might have the condition but remain uncertain, often due to [...]
Researchers Reveal What Happens to Your Brain When You Don’t Get Enough Sleep
What if poor sleep was doing more than just making you tired? Researchers have discovered that disrupted sleep in older adults interferes with the brain’s ability to clean out waste, leading to memory problems [...]
How to prevent chronic inflammation from zombie-like cells that accumulate with age
In humans and other multicellular organisms, cells multiply. This defining feature allows embryos to grow into adulthood, and enables the healing of the many bumps, bruises and scrapes along the way. Certain factors can [...]
Breakthrough for long Covid patients who lost sense of smell
A breakthrough nasal surgery has restored the sense of smell for a dozen long Covid patients. Experts at University College London Hospitals NHS Foundation Trust successfully employed a technique typically used for correcting blocked nasal passages, [...]
