An Economic Perspective of Disk vs. Flash Media in Archival Storage

For three decades, Kryder's law correctly predicted an exponential increase in bit density on disk platters, leading to an exponential drop in cost per gigabyte, and thus to an entrenched expectation that if data could be stored for a few years the incremental cost of storing it forever would be minimal. However, disk now is over 7 times as expensive as Kryder's law would have predicted, and industry projections suggest that in 2020 the gap will reach 200 times, disrupting this expectation. Our model shows that archives based upon alternative media are surprisingly cost competitive with archives based upon traditional disk media over the long-term. We propose using Archival Flash for long-term data preservation, with the trade off between longer data retention period and lower write cycles.

[1]  Serge J. Goldstein,et al.  DataSpace: A Funding and Operational Model for Long-Term Preservation and Sharing of Research Data , 2010 .

[2]  M. Fatih Erden,et al.  Heat Assisted Magnetic Recording , 2008, Proceedings of the IEEE.

[3]  Paul Wheatley,et al.  LIFE3: Predicting Long Term Digital Preservation Costs , 2009, iPRES.

[4]  John Geanakoplos,et al.  Hyperbolic Discounting is Rational: Valuing the Far Future with Uncertain Discount Rates , 2009 .

[5]  David S. H. Rosenthal,et al.  Using Storage Class Memory for Archives with DAWN , a Durable Array of Wimpy Nodes Technical Report UCSC-SSRC-1105 May 2011 , 2011 .

[6]  Robert H. McDonald,et al.  Disk and Tape Storage Cost Models , 2007, Archiving Conference.

[7]  Stephen Chapman Counting the Costs of Digital Preservation: Is Repository Storage Affordable? , 2003, J. Digit. Inf..

[8]  Dipak Kalra,et al.  The KRDS Benefit Analysis Toolkit: Development and Application , 2012, Int. J. Digit. Curation.

[9]  Richard D. Adams Hybrid Organic-Inorganic Composite Solar Cells for Efficient, Low Cost, Photoelectric Energy Conversion , 2011 .

[10]  Ulla Bøgvad Kejser,et al.  Cost Model for Digital Preservation: Cost of Digital Migration , 2011, Int. J. Digit. Curation.

[11]  Gary M. Decad,et al.  The impact of areal density and millions of square inches (MSI) of produced memory on petabyte shipments of TAPE, NAND flash, and HDD storage class memories , 2013, 2013 IEEE 29th Symposium on Mass Storage Systems and Technologies (MSST).

[12]  J. Zhu,et al.  Microwave Assisted Magnetic Recording , 2008, IEEE Transactions on Magnetics.

[13]  D. Rosenthal,et al.  The Economics of Long-Term Digital Storage , 2012 .

[14]  Matthew Addis,et al.  Tools for modelling and simulating migrationbased preservation , 2010 .

[15]  J. Holliday,et al.  Data Management and Layout for Shingled Magnetic Recording , 2011, IEEE Transactions on Magnetics.

[16]  C. Walter Kryder's law. , 2005, Scientific American.