DNA is crucial for life, and its organization has been a significant scientific challenge. GROVER, a model developed by BIOTEC, decodes DNA like text, promising advancements in genomics and personalized medicine.
DNA holds the essential information required to sustain life. Deciphering how this information is stored and organized has been one of the greatest scientific challenges of the past century. Now, with GROVER, a new large language model trained on human DNA, researchers can attempt to decode the intricate information concealed within our genome. Developed by a team at the Biotechnology Center (BIOTEC) of Dresden University of Technology, GROVER treats human DNA as text, learning its rules and context to extract functional information about DNA sequences. Published in Nature Machine Intelligence, this innovative tool has the potential to revolutionize genomics and accelerate personalized medicine.
Since the discovery of the double helix, scientists have sought to understand the information encoded in DNA. 70 years later, it is clear that the information hidden in the DNA is multilayered. Only 1-2 % of the genome consists of genes, the sequences that code for proteins.
“DNA has many functions beyond coding for proteins. Some sequences regulate genes, others serve structural purposes, and most sequences serve multiple functions at once. Currently, we don’t understand the meaning of most of the DNA. When it comes to understanding the non-coding regions of the DNA, it seems that we have only started to scratch the surface. This is where AI and large language models can help,” says Dr. Anna Poetsch, research group leader at the BIOTEC.
DNA as a Language
Large language models, like GPT, have transformed our understanding of language. Trained exclusively on text, the large language models developed the ability to use the language in many contexts.
“DNA is the code of life. Why not treat it like a language?” says Dr. Poetsch. The Poetsch team trained a large language model on a reference human genome. The resulting tool named GROVER, or “Genome Rules Obtained via Extracted Representations”, can be used to extract biological meaning from the DNA.
“GROVER learned the rules of DNA. In terms of language, we are talking about grammar, syntax, and semantics. For DNA this means learning the rules governing the sequences, the order of the nucleotides and sequences, and the meaning of the sequences. Like GPT models learning human languages, GROVER has basically learned how to ‘speak’ DNA,” explains Dr. Melissa Sanabria, the researcher behind the project.
The team showed that GROVER can not only accurately predict the following DNA sequences but can also be used to extract contextual information that has biological meaning, e.g., identify gene promoters or protein binding sites on DNA. GROVER also learns processes that are generally considered to be “epigenetic”, i.e., regulatory processes that happen on top of the DNA rather than being encoded.
“It is fascinating that by training GROVER with only the DNA sequence, without any annotations of functions, we are actually able to extract information on biological function. To us, it shows that the function, including some of the epigenetic information, is also encoded in the sequence,” says Dr. Sanabria.
The DNA Dictionary
“DNA resembles language. It has four letters that build sequences and the sequences carry a meaning. However, unlike a language, DNA has no defined words,” says Dr. Poetsch. DNA consists of four letters (A, T, G, and C) and genes, but there are no predefined sequences of different lengths that combine to build genes or other meaningful sequences.
To train GROVER, the team had to first create a DNA dictionary. They used a trick from compression algorithms. “This step is crucial and sets our DNA language model apart from the previous attempts,” says Dr. Poetsch.
“We analyzed the whole genome and looked for combinations of letters that occur most often. We started with two letters and went over the DNA, again and again, to build it up to the most common multi-letter combinations. In this way, in about 600 cycles, we have fragmented the DNA into ‘words’ that let GROVER perform the best when it comes to predicting the next sequence,” explains Dr. Sanabria.
The Promise of AI in Genomics
GROVER promises to unlock the different layers of genetic code. DNA holds key information on what makes us human, our disease predispositions, and our responses to treatments.
“We believe that understanding the rules of DNA through a language model is going to help us uncover the depths of biological meaning hidden in the DNA, advancing both genomics and personalized medicine,” says Dr. Poetsch.
Reference: “DNA language model GROVER learns sequence context in the human genome” by Melissa Sanabria, Jonas Hirsch, Pierre M. Joubert and Anna R. Poetsch, 23 July 2024, Nature Machine Intelligence.
DOI: 10.1038/s42256-024-00872-0
News
Urban Microbes Are Eating Disinfectants – Are We Fueling a New Health Threat?
New research reveals that microbes in urban environments are evolving to withstand the very cleaning agents designed to eliminate them. The study also uncovers new strains in Hong Kong, previously only found in the [...]
Startling Study Shows High-Potency Cannabis Alters DNA
The study shows that frequent use of high-potency cannabis alters DNA, affecting genes related to energy and immune function. These changes differ between those with and without psychosis, suggesting cannabis use could influence mental health through biological [...]
New nanotherapy targets artery inflammation in cardiovascular disease
Inflammation of the arteries is a primary precursor and driver of cardiovascular disease—the No. 1 killer of people in the United States. This inflammation is associated with the buildup of dangerous plaque inside the [...]
Revolutionary Nanoparticle Therapy for Prostate Cancer
A groundbreaking research effort involving teams from the University of Virginia, Mount Sinai, the University of Michigan, the University of Texas, and others has displayed the clinical efficacy of an innovative therapy that utilizes nanoparticles and [...]
Antibody engineering drives innovation in drug development
Monoclonal antibodies (mAbs) are used to prevent, detect, and treat a broad spectrum of non-communicable and communicable diseases. Over the past few years, the market for mAbs has grown exponentially with an expected compound [...]
Breakthrough Study Reveals How Bladder Cancer Starts and Spreads
Researchers found that DNA mutations from antiviral enzymes and chemotherapy fuel early bladder cancer, while abnormal circular DNA in tumor cells drives resistance to therapy. These discoveries open new therapeutic avenues. A groundbreaking study led by [...]
AI and Quantum Mechanics Accelerate Drug Discovery
A recent article published in the Journal of Chemical Information and Modeling researchers at Southern Methodist University (SMU) have developed SmartCADD, an open-source virtual tool designed to speed [...]
Targeting ‘undruggable’ diseases: Researchers reveal new levels of detail in targeted protein degradation
Researchers at the University of Dundee have revealed in the greatest detail yet the workings of molecules called protein degraders which can be deployed to combat what have previously been regarded as "undruggable" diseases, [...]
Revolutionizing Virology: AI Discovers Over 160,000 New RNA Viruses
Largest discovery of new virus species sheds light on the hidden virosphere. Artificial intelligence (AI) has been used to reveal details of a diverse and fundamental branch of life living right under our feet and in every [...]
Cardiac Crisis: COVID-19 Doubles Risk of Heart Attacks, Strokes, and Death
Research indicates that COVID-19 survivors face doubled risks of severe cardiac events for years after recovery, especially if hospitalized. People with A, B, or AB blood types are particularly vulnerable, highlighting the need for personalized approaches [...]
AI steps into science limelight with Nobel wins
For long periods of its history, artificial intelligence has lurked in the hinterland of science, often unloved and unfunded—but two Nobel prizes in one week suggest its time in the sunshine has finally arrived. [...]
MIT Scientists Shed New Light on the Critical Brain Connections That Define Consciousness
A new study provides further evidence that consciousness depends on communication between the brain’s sensory and cognitive regions in the cortex. Our brains are constantly making predictions about our surroundings, enabling us to focus [...]
Common Chemicals Found in Shampoo and Plastic Could Be Quietly Disrupting Your Heart’s Rhythm
UC study of Fernald data links environmental phenols to heart toxicities Environmental phenols are present in numerous everyday consumer products, serving as preservatives in packaged foods, parabens in shampoos, and bisphenol A (BPA) in [...]
Revolutionary Brain Tech Offers New Hope for Stroke and Injury Recovery
University of Pittsburgh researchers report that deep brain stimulation (DBS) can effectively enhance motor functions in individuals with arm and hand paralysis due to brain injuries, with promising results from early human and monkey [...]
NIH Scientists Discover Gene Responsible for Rare Eye Disease
Findings supported by the NIH pave the way for the development of genetic testing, clinical trials, and therapies. Researchers at the National Institutes of Health (NIH) and their collaborators have discovered a gene linked to certain [...]
Alzheimer’s Breakthrough: Synthetic THC Pill Proves Effective in Clinical Trial
Patients tolerated synthetic THC (dronabinol) well, without the adverse effects commonly associated with existing Alzheimer’s agitation medications. A study conducted by researchers from Johns Hopkins University School of Medicine and Tufts University School of Medicine found that a pill form [...]