What Sort of Time Frame is Realistic for Large Scale Data Storage?

You are viewing an old revision of this post, from 9 February, 2011 @ 20:40. See below for differences between this version and the current revision.

Paul Querna wrote an interesting post back in June about “forever storage” — data storage that could potentially be stable for civilization-spanning eras of time,

Not everyone will believe we can keep growing technology at the pace we have, nor that we might be able to stop death and diseases in our generation, but I do believe we are in the age where information created and stored today, could survive forever.

There are small technical challenges, like how would you write to media intended to last thousands of years, where would you store it all, and how would you pass on access to this data to whomever you desire, but I think they are all solvable.

If you can store your body in cryogenic storage for thousands of years, why can’t you store your data; Not just for yourself, but for your descendants.

One of the interesting questions here is just how well previous civilizations have done at information preservation. On the one hand, I can still read the full text of Sophocles’ Oedipus the King even though it was written about 2,400 years ago. On the other hand, even though he was one of the most famous and successful Athenian playwrights, only 7 of the 123 plays he wrote survives in complete form.

It would be interesting to estimate what percentage of written data generated by civilizations prior to the 15th century survived to be readable today. I’d be surprised if more than 5 percent of such material survived, and suspect something like 0.5% is excessively optimistic (if anyone knows of any published estimates of long-term information survival, please send me a link or reference).

Add to that we’re relying primarily on magnetic-based form factor-based hard drives for large scale storage which is technology that has been around for just 32 years now.

One possibility is to use something like the Rosetta disc or some of the physical, non-dye based optical solutions which should last a very long time, though at exorbitant prices (there’s no way I’m putting my 25tb or so personal data archive on them).

One of the commenters to Querna’s post highlights the data storage of memristors which are capable of storing data at much higher density than existing hard drives and are nonvolatile (sort of like flash memory today). Moreover, Stanley Williams — who first invented the memristor — has said that the lifespan of memristor’s could be for periods far longer than mere millenia. Now all we need are for memristors to be come cheap and widely available!

And don’t forget that even with memristors or something like it, at the moment your data is stuck in this lonely gravity well in some third-rate planetary system that is vulnerable to a number of potential catastrophes. What we need are autonomous, reproducing memristor-bots that can spread that data archive throughout the universe (now that’s cloud-based computing).

Post Revisions:

Changes:

9 February, 2011 @ 20:40Current Revision
Content
Paul Querna wrote <a title="Read &quot;Forever Storage&quot;" href="http:// journal.paul.querna.org/articles/ 2010/06/12/forever- storage/">an interesting post</a> back in June about "forever storage" -- data storage that could potentially be stable for civilization-spanning eras of time, Paul Querna wrote <a title="Read &quot;Forever Storage&quot;" href="http:// journal.paul.querna.org/articles/ 2010/06/12/forever- storage/">an interesting post</a> back in June about "forever storage" -- data storage that could potentially be stable for civilization-spanning eras of time,
<blockquote>Not everyone will believe we can keep growing technology at the pace we have, nor that we might be able to stop death and diseases in our generation, but <em>I do believe we are in the age where information created and stored today, could survive forever</em>. <blockquote>Not everyone will believe we can keep growing technology at the pace we have, nor that we might be able to stop death and diseases in our generation, but <em>I do believe we are in the age where information created and stored today, could survive forever</em>.
... ...
There are small technical challenges, like how would you write to media intended to last thousands of years, where would you store it all, and how would you pass on access to this data to whomever you desire, but I think they are all solvable. There are small technical challenges, like how would you write to media intended to last thousands of years, where would you store it all, and how would you pass on access to this data to whomever you desire, but I think they are all solvable.
If you can store your body in cryogenic storage for thousands of years, why can’t you store your data; Not just for yourself, but for your descendants.< /blockquote> If you can store your body in cryogenic storage for thousands of years, why can’t you store your data; Not just for yourself, but for your descendants.< /blockquote>
One of the interesting questions here is just how well previous civilizations have done at information preservation. On the one hand, I can still read the full text of Sophocles' Oedipus the King even though it was written about 2,400 years ago. On the other hand, even though he was one of the most famous and successful Athenian playwrights, only 7 of the 123 plays he wrote survives in complete form. One of the interesting questions here is just how well previous civilizations have done at information preservation. On the one hand, I can still read the full text of Sophocles' Oedipus the King even though it was written about 2,400 years ago. On the other hand, even though he was one of the most famous and successful Athenian playwrights, only 7 of the 123 plays he wrote survives in complete form.
It would be interesting to estimate what percentage of written data generated by civilizations prior to the 15th century survived to be readable today. I'd be surprised if more than 5 percent of such material survived, and suspect something like 0.5% is excessively optimistic (if anyone knows of any published estimates of long-term information survival, please send me a link or reference). It would be interesting to estimate what percentage of written data generated by civilizations prior to the 15th century survived to be readable today. I'd be surprised if more than 5 percent of such material survived, and suspect something like 0.5% is excessively optimistic (if anyone knows of any published estimates of long-term information survival, please send me a link or reference).
Add to that we're relying primarily on magnetic-based form factor-based hard drives for large scale storage which is technology that has been around for just 32 years now. Add to that we're relying primarily on magnetic-based form factor-based hard drives for large scale storage which is technology that has been around for just 32 years now.
One possibility is to use something like the Rosetta disc or some of the physical, non-dye based optical solutions which should last a very long time, though at exorbitant prices (there's no way I'm putting my 25tb or so personal data archive on them). One possibility is to use something like the Rosetta disc or some of the physical, non-dye based optical solutions which should last a very long time, though at exorbitant prices (there's no way I'm putting my 25tb or so personal data archive on them).
<a title="Read 'Stanley Williams and the Memristor'" href="http:// blog.inquirylabs.com/2010/ 04/23/stanley- williams-and- the-memristor/">One of the commenters</a> to Querna's post highlights the data storage of memristors which are capable of storing data at much higher density than existing hard drives and are nonvolatile (sort of like flash memory today). Moreover, Stanley Williams -- who first invented the memristor -- has said that the lifespan of memristor's could be for periods far longer than mere millenia. Now all we need are for memristors to be come cheap and widely available!  <a title="Read 'Stanley Williams and the Memristor'" href="http:// blog.inquirylabs.com/2010/ 04/23/stanley- williams-and- the-memristor/">One of the commenters</a> to Querna's post highlights the data storage of memristors which are capable of storing data at much higher densities than existing hard drives and are nonvolatile (sort of like flash memory today). Moreover, Stanley Williams -- who first invented the memristor -- has said that the lifespan of memristors could be for periods far longer than mere millenia. Now all we need are for memristors to become cheap and widely available!
And don't forget that even with memristors or something like it, at the moment your data is stuck in this lonely gravity well in some third-rate planetary system that is vulnerable to a number of potential catastrophes. What we need are autonomous, reproducing memristor-bots that can spread that data archive throughout the universe (now <strong>that's</strong> cloud-based computing). And don't forget that even with memristors or something like it, at the moment your data is stuck in this lonely gravity well in some third-rate planetary system that is vulnerable to a number of potential catastrophes. What we need are autonomous, reproducing memristor-bots that can spread that data archive throughout the universe (now <strong>that's</strong> cloud-based computing).

Note: Spaces may be added to comparison text to allow better line wrapping.

Leave a Reply