MIT researchers develop “FrameDiff,” a computational tool that uses generative AI to craft new protein structures, with the aim of accelerating drug development and improving gene therapy.
MIT’s CSAIL researchers have developed a computational tool, FrameDiff, which employs generative AI to create new protein structures. It uses machine learning to model protein “backbones” and adjust them in 3D, crafting proteins beyond known designs. This breakthrough could accelerate drug development and enhance gene therapy by creating proteins that bind more efficiently, with potential applications in biotechnology, targeted drug delivery, and more.
Biology is a wondrous yet delicate tapestry. At the heart is DNA, the master weaver that encodes proteins, responsible for orchestrating the many biological functions that sustain life within the human body. However, our body is akin to a finely tuned instrument, susceptible to losing its harmony. After all, we’re faced with an ever-changing and relentless natural world: pathogens, viruses, diseases, and cancer.
To advance our capabilities in protein engineering, MIT CSAIL researchers came up with “FrameDiff,” a computational tool for creating new protein structures beyond what nature has produced. The machine learning approach generates “frames” that align with the inherent properties of protein structures, enabling it to construct novel proteins independently of preexisting designs, facilitating unprecedented protein structures.
“In nature, protein design is a slow-burning process that takes millions of years. Our technique aims to provide an answer to tackling human-made problems that evolve much faster than nature’s pace,” says MIT CSAIL PhD student Jason Yim, a lead author on a new paper about the work. “The aim, with respect to this new capacity of generating synthetic protein structures, opens up a myriad of enhanced capabilities, such as better binders. This means engineering proteins that can attach to other molecules more efficiently and selectively, with widespread implications related to targeted drug delivery and biotechnology, where it could result in the development of better biosensors. It could also have implications for the field of biomedicine and beyond, offering possibilities such as developing more efficient photosynthesis proteins, creating more effective antibodies, and engineering nanoparticles for gene therapy.”
Framing FrameDiff
Proteins have complex structures, made up of many atoms connected by chemical bonds. The most important atoms that determine the protein’s 3D shape are called the “backbone,” kind of like the spine of the protein. Every triplet of atoms along the backbone shares the same pattern of bonds and atom types. Researchers noticed this pattern can be exploited to build machine learning algorithms using ideas from differential geometry and probability. This is where the frames come in: Mathematically, these triplets can be modeled as rigid bodies called “frames” (common in physics) that have a position and rotation in 3D.
Generation of a protein structure with FrameDiff. Credit: Ian Haydon/Institute for Protein Design
These frames equip each triplet with enough information to know about its spatial surroundings. The task is then for a machine learning algorithm to learn how to move each frame to construct a protein backbone. By learning to construct existing proteins, the algorithm hopefully will generalize and be able to create new proteins never seen before in nature.
Training a model to construct proteins via “diffusion” involves injecting noise that randomly moves all the frames and blurs what the original protein looked like. The algorithm’s job is to move and rotate each frame until it looks like the original protein. Though simple, the development of diffusion on frames requires techniques in stochastic calculus on Riemannian manifolds. On the theory side, the researchers developed “SE(3) diffusion” for learning probability distributions that nontrivially connects the translations and rotations components of each frame.
The subtle art of diffusion
In 2021, DeepMind introduced AlphaFold2, a deep learning algorithm for predicting 3D protein structures from their sequences. When creating synthetic proteins, there are two essential steps: generation and prediction. Generation means the creation of new protein structures and sequences, while “prediction” means figuring out what the 3D structure of a sequence is. It’s no coincidence that AlphaFold2 also used frames to model proteins. SE(3) diffusion and FrameDiff were inspired to take the idea of frames further by incorporating frames into diffusion models, a generative AI technique that has become immensely popular in image generation, like Midjourney, for example.
The shared frames and principles between protein structure generation and prediction meant the best models from both ends were compatible. In collaboration with the Institute for Protein Design at the University of Washington, SE(3) diffusion is already being used to create and experimentally validate novel proteins. Specifically, they combined SE(3) diffusion with RosettaFold2, a protein structure prediction tool much like AlphaFold2, which led to “RFdiffusion.” This new tool brought protein designers closer to solving crucial problems in biotechnology, including the development of highly specific protein binders for accelerated vaccine design, engineering of symmetric proteins for gene delivery, and robust motif scaffolding for precise enzyme design.
Future endeavors for FrameDiff involve improving generality to problems that combine multiple requirements for biologics such as drugs. Another extension is to generalize the models to all biological modalities including DNA and small molecules. The team posits that by expanding FrameDiff’s training on more substantial data and enhancing its optimization process, it could generate foundational structures boasting design capabilities on par with RFdiffusion, all while preserving the inherent simplicity of FrameDiff.
“Discarding a pretrained structure prediction model [in FrameDiff] opens up possibilities for rapidly generating structures extending to large lengths,” says Harvard University computational biologist Sergey Ovchinnikov. The researchers’ innovative approach offers a promising step toward overcoming the limitations of current structure prediction models. Even though it’s still preliminary work, it’s an encouraging stride in the right direction. As such, the vision of protein design, playing a pivotal role in addressing humanity’s most pressing challenges, seems increasingly within reach, thanks to the pioneering work of this MIT research team.”
Yim wrote the paper alongside Columbia University postdoc Brian Trippe, French National Center for Scientific Research in Paris’ Center for Science of Data researcher Valentin De Bortoli, Cambridge University postdoc Emile Mathieu, and Oxford University professor of statistics and senior research scientist at DeepMind Arnaud Doucet. MIT professors Regina Barzilay and Tommi Jaakkola advised the research.
The team’s work was supported, in part, by the MIT Abdul Latif Jameel Clinic for Machine Learning in Health, EPSRC grants and a Prosperity Partnership between Microsoft Research and Cambridge University, the National Science Foundation Graduate Research Fellowship Program, NSF Expeditions grant, Machine Learning for Pharmaceutical Discovery and Synthesis consortium, the DTRA Discovery of Medical Countermeasures Against New and Emerging threats program, the DARPA Accelerated Molecular Discovery program, and the Sanofi Computational Antibody Design grant. This research will be presented at the International Conference on Machine Learning in July.
![](https://www.nanoappsmedical.com/wp-content/uploads/2017/05/spacer.jpg)
News
Ethics in Nanomedicine: Key Issues and Principles
Nanomedicine, a branch of nanotechnology, is revolutionizing healthcare by enabling the manipulation of materials at the nanoscale to diagnose, treat, and prevent diseases. Unlike traditional treatments, nanoparticles (NPs) are highly precise in targeting diseased [...]
A call for robust H5N1 influenza preparedness and response
As the global threat of H5N1 influenza looms with outbreaks across species and continents including the U.S., three international vaccine and public health experts say it is time to fully resource and support a [...]
Mucosal COVID-19 boosters outperform mRNA shots in preventing upper airway infections
In a recent study published in Nature Immunology, a team of researchers from the United States used non-human primate models to compare the protection conferred by an intramuscular booster dose of the bivalent messenger ribonucleic acid [...]
How Space Travel Really Changes Astronauts – From the Inside Out
International team reveals previously unknown effects on physiology that could shape the future of long-duration space missions. Researchers have discovered significant changes in the gut microbiome due to spaceflight, which affects host physiology and [...]
Breakthrough in blood stem cell development offers hope for leukemia and bone marrow failure
Melbourne researchers have made a world first breakthrough into creating blood stem cells that closely resemble those in the human body. And the discovery could soon lead to personalized treatments for children with leukemia [...]
Scientists Develop Game-Changing Needle-Free COVID-19 Intranasal Vaccine
A new mucosal COVID-19 vaccine poised to revolutionize the delivery process is especially beneficial for those with a fear of needles. A next-generation COVID-19 mucosal vaccine is set to be a game-changer not only when delivering [...]
Scientists Develop All-in-One Solution To Catch and Destroy “Forever Chemicals”
A new water treatment system developed by UBC researchers efficiently removes and destroys PFAS pollutants using a dual-action catalyst, offering a sustainable and cost-effective solution for water purification challenges. Chemical engineers at the University of [...]
New method accelerates drug discovery from years to months
Researchers from the University of Cincinnati College of Medicine and Cincinnati Children's Hospital have found a new method to increase both speed and success rates in drug discovery. The study, published Aug. 30 in [...]
A new smart mask analyzes your breath to monitor your health
Your breath can give away a lot about you. Each exhalation contains all sorts of compounds, including possible biomarkers for disease or lung conditions, that could give doctors a valuable insight into your health. [...]
Study reveals the role of blood clotting in COVID-19
In a study that reshapes what we know about COVID-19 and its most perplexing symptoms, scientists have discovered that the blood coagulation protein fibrin causes the unusual clotting and inflammation that have become hallmarks [...]
A Novel Cancer Vaccine Combining Nano-11 and ADU-S100
In a recent article published in npj Vaccines, researchers detailed the development of a novel cancer vaccine that combines a plant-derived nanoparticle adjuvant, Nano-11, with a clinically tested STING agonist, ADU-S100. The primary objective was [...]
AI spots cancer and viral infections with nanoscale precision
Researchers have developed an artificial intelligence which can differentiate cancer cells from normal cells, as well as detect the very early stages of viral infection inside cells. The findings, published today in a study [...]
Tiny shards of plastic are increasingly infiltrating our brains, study says
Human brain samples collected at autopsy in early 2024 contained more tiny shards of plastic than samples collected eight years prior, according to a preprint posted online in May. A preprint is a study which has not yet [...]
Scientists Have Discovered Strange DNA in Our Brains – and It Could Be Shortening Our Lives
According to the research, these mitochondrial DNA insertions could be linked to early death. Mitochondria in brain cells frequently insert their DNA into the nucleus, potentially impacting lifespan, as those with more insertions were found to [...]
Watch Out After a Hospital Stay: You Could Be Exposing Your Family to Superbugs
Research indicates hospitals contribute to the local spread of antibiotic-resistant infections. A recent study published in the journal Infection Control & Hospital Epidemiology by the Society for Healthcare Epidemiology of America suggests that family members of [...]
Molecular Trickery: How COVID-19 Silently Sabotages the Human Immune System
Researchers have discovered that SARS-CoV-2 manipulates the human immune system by forcing cells to produce non-functional proteins, hindering the body’s antiviral defenses. This groundbreaking study by teams from prestigious Brazilian universities highlights potential targets for new COVID-19 treatments, [...]