New Coding Strategy Maximizes Data-Storage Capacity of DNA Molecules
Humanity may soon generate more data than hard drives or magnetic tape can handle, a problem that has scientists turning to nature’s age-old solution for information-storage—DNA.
In a new study in Science, a pair of researchers at Columbia University and the New York Genome Center (NYGC) show that an algorithm designed for streaming video on a cellphone can unlock DNA’s nearly full storage potential by squeezing more information into its four base nucleotides. They demonstrate that this technology is also extremely reliable.
DNA is an ideal storage medium because it’s ultra-compact and can last hundreds of thousands of years if kept in a cool, dry place, as demonstrated by the recent recovery of DNA from the bones of a 430,000-year-old human ancestor found in a cave in Spain.
“DNA won’t degrade over time like cassette tapes and CDs, and it won’t become obsolete—if it does, we have bigger problems,” said study coauthor Yaniv Erlich, a computer science professor at Columbia Engineering, a member of Columbia’s Data Science Institute, and a core member of the NYGC.
Erlich and his colleague Dina Zielinski, an associate scientist at NYGC, chose six files to encode, or write, into DNA: a full computer operating system, an 1895 French film, “Arrival of a train at La Ciotat,” a $50 Amazon gift card, a computer virus, a Pioneer plaque and a 1948 study by information theorist Claude Shannon.
They compressed the files into a master file, and then split the data into short strings of binary code made up of ones and zeros. Using an erasure-correcting algorithm called fountain codes, they randomly packaged the strings into so-called droplets, and mapped the ones and zeros in each droplet to the four nucleotide bases in DNA: A, G, C and T. The algorithm deleted letter combinations known to create errors, and added a barcode to each droplet to help reassemble the files later.
In all, they generated a digital list of 72,000 DNA strands, each 200 bases long, and sent it in a text file to a San Francisco DNA-synthesis startup, Twist Bioscience, that specializes in turning digital data into biological data. Two weeks later, they received a vial holding a speck of DNA molecules.
To retrieve their files, they used modern sequencing technology to read the DNA strands, followed by software to translate the genetic code back into binary. They recovered their files with zero errors, the study reports. (In this short demo, Erlich opens his archived operating system on a virtual machine and plays a game of Minesweeper to celebrate.)
They also demonstrated that a virtually unlimited number of copies of the files could be created with their coding technique by multiplying their DNA sample through polymerase chain reaction (PCR), and that those copies, and even copies of their copies, and so on, could be recovered error-free.
Finally, the researchers show that their coding strategy packs 215 petabytes of data on a single gram of DNA—100 times more than methods published by pioneering researchers George Church at Harvard, and Nick Goldman and Ewan Birney at the European Bioinformatics Institute. “We believe this is the highest-density data-storage device ever created,” said Erlich.
The capacity of DNA data-storage is theoretically limited to two binary digits for each nucleotide, but the biological constraints of DNA itself and the need to include redundant information to reassemble and read the fragments later reduces its capacity to 1.8 binary digits per nucleotide base.
The team’s insight was to apply fountain codes, a technique Erlich remembered from graduate school, to make the reading and writing process more efficient. With their DNA Fountain technique, Erlich and Zielinski pack an average of 1.6bits into each base nucleotide. That’s at least 60 percent more data than previously published methods, and close to the 1.8-bit limit.
Cost still remains a barrier. The researchers spent $7,000 to synthesize the DNA they used to archive their 2 megabytes of data, and another $2,000 to read it. Though the price of DNA sequencing has fallen exponentially, there may not be the same demand for DNA synthesis, says Sri Kosuri, a biochemistry professor at UCLA who was not involved in the study. “Investors may not be willing to risk tons of money to bring costs down,” he said.
But the price of DNA synthesis can be vastly reduced if lower-quality molecules are produced, and coding strategies like DNA Fountain are used to fix molecular errors, says Erlich. “We can do more of the heavy lifting on the computer to take the burden off time-intensive molecular coding,” he said.
Receive an email update when we add a new DNA DATA STORAGE article.
The Latest on: DNA data storage
via Google News
The Latest on: DNA data storage
- DNA Storage: Why the Stuff of Life Is Poised to Be the Stuff of Storage on December 13, 2018 at 6:27 pm
Microsoft also has partnered with Twist Bioscience, which has a silicon-based DNA synthesis platform, to work on long-term data storage solutions for DNA. Assuming that DNA could be easily writable an... […]
- How safe is it to take a DNA and genetics test plugged by online companies? on December 13, 2018 at 4:02 am
Ancestry has some research programmes that use anonymised data to show how DNA has changed and how to read it but we ... which include industry standards for the storage of samples taken from humans. ... […]
- Identity crisis: data misuse an unseen twist in DNA testing on December 13, 2018 at 2:23 am
"But once your DNA is sequenced and stored ... encrypted and segmented data into separate storage platforms. "Ancestry will not share any information with law enforcement unless compelled to ... […]
- Potential Analysis of Human DNA Vaccines Market Value Expected to Show $9,337 Mn by 2030 : Allied Market Research on December 11, 2018 at 2:58 pm
In addition, DNA vaccines are temperature stable, leading to easier storage and transport ... Allied Market Research provides one stop solution from the beginning of data collection to investment advi... […]
- DNAtix Releases Live Demo of its Blockchain based Genetic Infrastructure Platform on December 11, 2018 at 2:19 pm
“Users should be able to decide what to do with their most private information – their genetic make-up – and, if interested, monetize this data through sharing ... testing and storage and transfer of ... […]
- DNA Testing Kits & The Security Risks in Digitized DNA on December 7, 2018 at 6:43 am
The digitization of DNA involves its storage in a database. The solving of a criminal cold ... and biological threats can be synthesized using publicly available data." Potential security risks includ... […]
- Global Data Storage market detailed in new research report on December 6, 2018 at 11:14 pm
Data storage is the recording storing of information data in a storage medium. Recording is accomplished by virtually any form of energy. DNA and RNA, handwriting, phonographic recording, magnetic tap... […]
- What’s New in HPC Research: Automatic Energy Efficiency, DNA Data Analysis, Post-Exascale & More on December 6, 2018 at 7:32 am
Next-generation sequencing technologies have sped up the sequencing of DNA, but the massive amount of data generated by those technologies ... these approaches can dramatically improve speed. HPC stor... […]
- DNA, Big Data and the Rise of Machine on November 15, 2018 at 11:08 pm
As we rapidly hurtle towards a future characterised by IoT devices, automation and digital money, it’s more important than ever that we strive to build security and privacy-oriented infrastructures fo... […]
via Bing News