Estimating the Innovator's Dilemma: Structural Analysis of Creative Destruction in the Hard Disk Drive Industry, 1981-1998

This paper studies strategic industry dynamics of creative destruction in which firms and technologies experience turnover. Theories predict that cannibalization between existing and new products delays incumbents’ innovation, whereas preemptive motives accelerate it. Incumbents’ cost (dis)advantage relative to that of entrants would further reinforce these tendencies. To empirically assess these three forces, I estimate a dynamic oligopoly model using a unique panel data set of hard disk drive manufacturers. The results suggest that despite strong preemptive motives and a substantial cost advantage over entrants, cannibalization makes incumbents reluctant to innovate, which can explain at least 57 percent of the incumbent-entrant innovation gap.

[1]  H. Greve,et al.  From Silicon Valley to Singapore: Location and Competitive Advantage in the Hard Disk Drive Industry , 2001 .

[2]  John Sutton,et al.  Sunk Costs and Market Structure: Price Competition, Advertising, and the Evolution of Concentration , 1992 .

[3]  R. Brandis.  The Limits of Organization , 1975 .

[4]  Timothy H. Hannan,et al.  The Determinants of Technology Adoption: The Case of the Banking Firm , 1984 .

[5]  S. Klepper,et al.  Submarkets and the evolution of market structure , 2006 .

[6]  John T. Scott.  Firm versus Industry Variability in R&D Intensity , 1984 .

[7]  J. Stiglitz,et al.  The Architecture of Economic Systems: Hierarchies and Polyarchies , 1984 .

[8]  Paul Geroski,et al.  Entry, innovation and productivity growth , 1989 .

[9]  Myongjin Kim,et al.  Strategic Responses to Used Goods Markets: Airbus and Boeing , 2013 .

[10]  Allan Collard-Wexler,et al.  Mergers and Sunk Costs: An Application to the Ready-Mix Concrete Industry , 2014 .

[11]  S. Klepper.  Entry, Exit, Growth, and Innovation over the Product Life Cycle , 1996 .

[12]  J. Lerner.  An Empirical Exploration of a Technology Race , 1997 .

[13]  J. Hausman.  Valuation of New Goods Under Perfect and Imperfect Competition , 1994 .

[14]  Boyan Jovanovic.  Selection and the evolution of industry , 1981 .

[15]  Aviv Nevo.  Measuring Market Power in the Ready-to-Eat Cereal Industry , 1998 .

[16]  D. Newbery,et al.  Preemptive Patenting and the Persistence of Monopoly , 1982 .

[17]  Drew Fudenberg,et al.  Dynamic Models of Oligopoly , 1986 .

[18]  Chris Nosko.  Competition and Quality Choice in the CPU Market ∗ , 2011 .

[19]  Steven Klepper,et al.  The Evolution of New Industries and the Determinants of Market Structure , 1990 .

[20]  R. Blundell,et al.  Market share, market value and innovation in a panel of British manufacturing firms , 1999 .

[21]  William J. Abernathy,et al.  Patterns of Industrial Innovation , 1978 .

[22]  David H. Hsu,et al.  When Does Start-Up Innovation Spur the Gale of Creative Destruction? , 2000 .

[23]  Yi Qian,et al.  Do National Patent Laws Stimulate Domestic Innovation in a Global Patenting Environment? A Cross-Country Analysis of Pharmaceutical Patent Protection, 19782002 , 2007, The Review of Economics and Statistics.

[24]  K. Arrow.  The limits of organization , 1974 .

[25]  W. Mitchell.  Whether and When? Probability and Timing of Incumbents' Entry into Emerging Industrial Subfields , 1989 .

[26]  K. Clark,et al.  Innovation: Mapping the winds of creative destruction☆ , 1993 .

[27]  M. Satterthwaite,et al.  Learning-by-Doing, Organizational Forgetting and Industry Dynamics , 2007 .

[28]  A. Mukhopadhyay,et al.  Technological Progress and Change in Market Concentration in the U. S., 1963-77 , 1985 .

[29]  Josh Lerner,et al.  The Government as Venture Capitalist: The Long-Run Effects of the Sbir Program , 1996 .

[30]  John Rust.  Optimal Replacement of GMC Bus Engines: An Empirical Model of Harold Zurcher , 1987 .

[31]  R. McDonald,et al.  The Value of Waiting to Invest , 1982 .

[32]  Ira Horowitz,et al.  Firm Size and Research Activity , 1962 .

[33]  A. Link,et al.  Investments in technology , 1983 .

[34]  J. D. Howe,et al.  The Determinants of R & D Expenditures , 1976 .

[35]  John Sutton,et al.  Technology and Market Structure: Theory and History , 1998 .

[36]  C. L. Benkard,et al.  Estimating Dynamic Models of Imperfect Competition , 2004 .

[37]  Joachim Schwalbach,et al.  Entry and Market Contestability: An International Comparison , 1991 .

[38]  Michael Egesdal,et al.  Estimating Dynamic Discrete-Choice Games of Incomplete Information , 2014 .

[39]  María Consuelo Pazó Martínez,et al.  Do public subsidies stimulate private R&D spending? , 2006 .

[40]  Edwin Mansfield,et al.  Industrial Research and Technological Innovation: An Econometric Analysis , 1968 .

[41]  Andrew Sweeting,et al.  Dynamic Product Positioning in Differentiated Product Markets: The Effect of Fees for Musical Performance Rights on the Commercial Radio Industry , 2011 .

[42]  J. Lerner,et al.  The Government as Venture Capitalist , 2000 .

[43]  Advances in Economics and Econometrics: Estimation of (Dynamic) Games: A Discussion , 2013 .

[44]  Eduardo S. Schwartz,et al.  Investment Under Uncertainty. , 1994 .

[45]  Katja Seim,et al.  An empirical model of firm entry with endogenous product-type choices , 2006 .

[46]  Mary Tripsas.  UNRAVELING THE PROCESS OF CREATIVE DESTRUCTION: COMPLEMENTARY ASSETS AND INCUMBENT SURVIVAL IN THE TYPESETTER INDUSTRY: UNRAVELING THE PROCESS OF CREATIVE DESTRUCTION , 1997 .

[47]  Steven Berry,et al.  Nonparametric Identi cation of Multinomial Choice Demand Models with Heterogeneous Consumers , 2008 .

[48]  D. Hamberg,et al.  R & D : essays on the economics of research and development , 1966 .

[49]  Paul Stoneman,et al.  Rank, Stock, Order And Epidemic Effects In The Diffusion Of New Process Technologies : An Empirical Model , 1990 .

[50]  T. Bresnahan.  Departures from marginal-cost pricing in the American automobile industry: Estimates for 1977–1978 , 1981 .

[51]  J. Lerner.  The Importance of Patent Scope: An Empirical Analysis , 1994 .

[52]  Brett R. Gordon,et al.  Does AMD Spur Intel to Innovate More? , 2011, Journal of Political Economy.

[53]  Kim B. Clark,et al.  Architectural Innovation: The Reconfiguration of Existing Product Technologies and the Failure of , 1990 .

[54]  P. Goldberg,et al.  Estimating the Effects of Global Patent Protection in Pharmaceuticals: A Case Study of Quinolones in India , 2003, The American economic review.

[55]  Andrew S. Grove,et al.  Only the Paranoid Survive: How to Exploit the Crisis Points that Challenge Every Company and Career , 1996 .

[56]  Lee Branstetter,et al.  Japanese Research Consortia: A Microeconometric Analysis of Industrial Policy , 1997 .

[57]  Jennifer F. Reinganum.  Uncertain Innovation and the Persistence of Monopoly , 1982 .

[58]  Paul Geroski,et al.  Market Structure, Corporate Performance, and Innovative Activity , 1995 .

[59]  Richard R. Nelson,et al.  Forces Generating and Limiting Concentration under Schumpeterian Competition , 1978 .

[60]  Steven T. Berry.  Estimating Discrete-Choice Models of Product Differentiation , 1994 .

[61]  M. Tushman,et al.  Technological Discontinuities and Organizational Environments , 1986 .

[62]  Bronwyn H Hall,et al.  The Private and Social Returns to Research and Development , 1996 .

[63]  John Sutton,et al.  Competing in Capabilities: The Globalization Process , 2012 .

[64]  H. Rao,et al.  The Demography of Corporations and Industries , 1999 .

[65]  Mitsuru Igamiy,et al.  Mergers, Innovation, and Entry-Exit Dynamics: The Consolidation of the Hard Disk Drive Industry , 2015 .

[66]  S. Klepper,et al.  Time Paths in the Diffusion of Product Innovations , 1982 .

[67]  Mark Armstrong,et al.  Handbook of industrial organization: Volume 3 , 2007 .

[68]  Keith Pavitt,et al.  The Size Distribution of Innovating Firms in the UK: 1945-1983 , 1987 .

[69]  Mark Chicu.  Dynamic Investment and Deterrence in the U.S. Cement Industry , 2013 .

[70]  Nathan Rosenberg,et al.  Handbook of the Economics of Innovation , 2013 .

[71]  M. Cherniack.  The Productivity Dilemma in Workplace Health Promotion , 2015, TheScientificWorldJournal.

[72]  Henry Chesbrough,et al.  Arrested development: the experience of European hard disk drive firms in comparison with US and Japanese firms , 1999 .

[73]  David M. Kreps,et al.  Quantity Precommitment and Bertrand Competition Yield Cournot Outcomes , 1983 .

[74]  José Carlos Fariñas García.  Sunk costs and market structure: price competition, advertising and the evolution of concentration , 1993 .

[75]  Philipp Schmidt-Dengler,et al.  The Timing of New Technology Adoption: The Case of MRI , 2006 .

[76]  Paul Stoneman.  FINANCIAL FACTORS AND THE INTER FIRM DIFFUSION OF NEW TECHNOLOGY: A REAL OPTIONS MODEL , 2001 .

[77]  Wesley M. Cohen,et al.  R&D Appropriability, Opportunity, and Market Structure: New Evidence on Some Schumpeterian Hypotheses , 1985 .

[78]  S. Scotchmer,et al.  Innovation and Incentives , 2004 .

[79]  April M. Franco,et al.  Knowledge Diffusion through Employee Mobility , 2000 .

[80]  Wesley M. Cohen.  Fifty Years of Empirical Studies of Innovative Activity and Performance , 2010 .

[81]  Andrea Gregg,et al.  Learning From Doing: Lessons Learned From Designing and Developing an Educational Software Within a Heterogeneous Group , 2021, Int. J. Web Based Learn. Teach. Technol..

[82]  J. Sutton.  Technology and Market Structure , 1998 .

[83]  David B. Audretsch,et al.  Innovation in Large and Small Firms: An Empirical Analysis , 1988 .

[84]  O. Williamson.  Innovation and Market Structure , 1965, Journal of Political Economy.

[85]  Benjamin Van Roy,et al.  MARKOV PERFECT INDUSTRY DYNAMICS WITH MANY FIRMS , 2008 .

[86]  A. Pakes,et al.  Markov-Perfect Industry Dynamics: A Framework for Empirical Work , 1995 .

[87]  Victor Aguirregabiria,et al.  Identification and counterfactuals in dynamic models of market entry and exit , 2014 .

[88]  Zvi Griliches,et al.  R&D, Patents, and Productivity , 1981 .

[89]  Christopher L. Tucci,et al.  Incumbent Entry into New Market Niches: The Role of Experience and Managerial Choice in the Creation of Dynamic Capabilities , 2002, Manag. Sci..

[91]  Bronwyn H Hall,et al.  Innovation and Diffusion , 2004 .

[92]  Edward E. Leamer,et al.  Econometric Tools for Analyzing Market Outcomes , 2007 .

[93]  Ron Adner,et al.  Disruptive Technologies and the Emergence of Competition , 2003 .

[94]  John Kenneth Galbraith,et al.  American Capitalism; The Concept of Countervailing Power , 1952 .

[95]  Rasmus Lentz,et al.  An Empirical Model of Growth Through Product Innovation , 2005, SSRN Electronic Journal.

[96]  F. Scherer,et al.  Industrial Market Structure and Economic Performance. , 1971 .

[97]  C. Shapiro,et al.  Optimal Patent Length and Breadth , 1990 .

[98]  R. E. Shrieves,et al.  Determinants of Market Structure , 1973 .

[99]  Yi Xu.  A Structural Empirical Model of R & D , Firm Heterogeneity , and Industry Evolution ∗ , 2007 .

[100]  Michael J. Mazzeo.  Product Choice and Oligopoly Market Structure , 2002 .

[101]  W. Abernathy.  Innovation : Mapping the winds of creative destruction * , 2003 .

[102]  Steven Klepper,et al.  Firm Survival and the Evolution of Oligopoly , 2002 .

[103]  Martin Pesendorfer,et al.  Asymptotic Least Squares Estimators for Dynamic Games , 2008 .

[104]  Clayton M. Christensen.  The Rigid Disk Drive Industry: A History of Commercial and Technological Turbulence , 1993, Business History Review.

[105]  Steven T. Berry,et al.  Automobile Prices in Market Equilibrium , 1995 .

[106]  C. F. Phillips.  Industrial Market Structure and Economic Performance , 1971 .

[107]  Victor Aguirregabiria,et al.  A Dynamic Oligopoly Game of the US Airline Industry: Estimation and Policy Experiments , 2012 .

[108]  Paul Geroski,et al.  Entry And The Rate of Innovation , 1991 .

[109]  Bertel Schjerning,et al.  Constrained Optimization Approaches to Estimation of Structural Models: Comment , 2015 .

[110]  Steven T. Berry,et al.  Simple Estimators for the Parameters of Discrete Dynamic Games (with Entry/Exit Examples) , 2004 .

[111]  R. Henderson.  Underinvestment and Incompetence as Responses to Radical Innovation: Evidence From the Photolithographic Alignment Equipment Industry , 2015 .

[112]  R. Atkinson.  Innovation Economics: The Race for Global Advantage , 2012 .

[113]  Myrto Kalouptsidi.  Time to Build and Shipping Prices , 2011 .

[114]  Stephen P. Ryan.  The Costs of Environmental Regulation in a Concentrated Industry , 2012 .

[115]  Allan Collard-Wexler,et al.  Plant Turnover and Demand Fluctuations in the Ready-Mix Concrete Industry , 2006 .

[116]  A. Pakes,et al.  Computing Markov Perfect Nash Equilibria: Numerical Implications of a Dynamic Differentiated Product Model , 1992 .

[117]  J. Schumpeter,et al.  Capitalism, Socialism and Democracy , 1943 .

[118]  P. Klemperer.  How Broad Should the Scope of Patent Protection Be , 1990 .

[119]  Ariel Pakes,et al.  A Framework for Applied Dynamic Analysis in I.O , 2000 .

[120]  Richard J. Gilbert,et al.  Looking for Mr. Schumpeter: Where Are We in the Competition--Innovation Debate? , 2006, Innovation Policy and the Economy.

[121]  Steven Klepper,et al.  The Making of an Oligopoly: Firm Survival and Technological Change in the Evolution of the U.S. Tire Industry , 2000, Journal of Political Economy.

[122]  D. Wright,et al.  American Capitalism: The Concept of Countervailing Power , 1957 .

[123]  Victor Aguirregabiria,et al.  Sequential Estimation of Dynamic Discrete Games , 2007 .

[124]  A. Norets,et al.  Inference in Dynamic Discrete Choice Models With Serially orrelated Unobserved State Variables , 2009 .

[125]  Mark J. Roberts,et al.  R&D Investment, Exporting, and Productivity Dynamics , 2009 .

[126]  Mitsuru Igami.  Offshoring as Process Innovation , 2013 .

[127]  K. Arrow.  Economic Welfare and the Allocation of Resources for Invention , 1962 .

[128]  Dan Cao,et al.  Innovation by Entrants and Incumbents , 2010, J. Econ. Theory.

[129]  David L. Bradford,et al.  Optimal Departures from Marginal Cost Pricing , 1970 .

[130]  Leonard Berkowitz,et al.  Innovation and Its Discontents: How Our Broken Patent System Is Endangering Innovation and Progress and What to Do about It , 2005 .

[131]  James M. Utterback,et al.  Technological Innovation for a Dynamic Economy , 1980 .

[132]  What Happens When Wal-Mart Comes to Town : An Empirical Analysis of the Discount Industry ∗ , 2005 .

[133]  Heidrun C. Hoppe.  The Timing of New Technology Adoption: Theoretical Models and Empirical Evidence , 2002 .

[134]  Hugo A. Hopenhayn,et al.  Exit, selection, and the value of firms , 1992 .

[135]  Panle Jia,et al.  What Happens When Wal‐Mart Comes to Town: An Empirical Analysis of the Discount Retailing Industry , 2008 .

[136]  S. Winter,et al.  The Schumpeterian Tradeoff Revisited , 1982 .

[137]  Gabriel Y. Weintraub,et al.  Nonstationary Oblivious Equilibrium , 2008 .

[138]  D. Mueller,et al.  Research and development costs as a barrier to entry , 1969 .

[139]  Mary Tripsas,et al.  Surviving Radical Technological Change through Dynamic Capability: Evidence from the Typesetter Industry , 1997 .

[140]  Alon Eizenberg.  Upstream Innovation and Product Variety in the U.S. Home PC Market , 2011 .

[141]  Niklas Sjöberg,et al.  Technological discontinuities, competition and firm performance , 1995 .

[142]  Steven Klepper,et al.  Industry shakeouts and technological change , 2005 .

[143]  Che-Lin Su.  Estimating discrete-choice games of incomplete information: Simple static examples , 2014 .

[144]  Z. Griliches,et al.  Do Subsidies to Commercial R&D Reduce Market Failures? Microeconomic Evaluation Studies , 1999 .

[145]  Steven T. Berry.  Estimation of a Model of Entry in the Airline Industry , 1992 .

[146]  V. J. Hotz,et al.  Conditional Choice Probabilities and the Estimation of Dynamic Models , 1993 .

[147]  Clayton M. Christensen.  The Innovator's Dilemma , 1997 .

[148]  Raimar Richers.  The theory of economic development , 1961 .

[149]  Mark J. Roberts,et al.  Entry, Exit and the Determinants of Market Structure , 2009 .

[150]  Giuliana Battisti,et al.  The Diffusion of New Technology , 2010 .

[151]  Peter J. Klenow,et al.  High Tech R&D Subsidies: Estimating the Effects of Sematech , 1994 .

[152]  Henry Chesbrough.  Arrested Development: The Experience of European Hard Disk Drive Firms in Comparison with Us and Japanese Firms , 1999 .