Managing R&D Project Shifts in High‐Tech Organizations: A Multi‐Method Study

High-tech organizations maintain a portfolio of R&D projects that address problems with different levels of complexity. These projects use different strategies to search for technological solutions. Projects refining existing products, processes, and technologies, for instance, employ a local search strategy to improve performance, while projects developing new products, processes, and technologies employ a distant search strategy. However, projects can shift in their levels of complexity due to exogenous technological changes, and failure to change search strategy in turn can negatively impact project performance. This study first develops grounded theory via case studies to understand how high-tech organizations manage R&D projects when complexity shifts. The case data come from 142 informants in 12 R&D projects at three high-tech business units. A cross-case comparison shows that three interconnected mechanisms positioned at multiple levels within the organization enable high-tech organizations to identify such shifts and adjust the project's search. We refer to this strategy as responsive search. We then conduct agent-based simulation experiments to examine the conditions under which the responsive search outperforms other canonical search strategies. Overall, this study sheds light on the underexplored question of how to make mid-project corrections by effectively identifying and managing shifts in project complexity.

[1]  A. Woodside.  Building Theory from Case Study Research , 2016 .

[2]  B. Golden.  The past is the past--or is it? The use of retrospective accounts as indicators of past strategy. , 1992, Academy of Management journal. Academy of Management.

[3]  Janice M. Morse,et al.  "Perfectly Healthy, but Dead": The Myth of Inter-Rater Reliability , 1997 .

[4]  Stuart A. Kauffman,et al.  The origins of order , 1993 .

[5]  Svenja C. Sommer,et al.  The Effects of Problem Structure and Team Diversity on Brainstorming Effectiveness , 2009, Manag. Sci..

[6]  Mikael Holmqvist,et al.  Experiential Learning Processes of Exploitation and Exploration Within and Between Organisations : An Empirical Study of Product Development, Department of Business Studies , 2003 .

[7]  Christoph H. Loch,et al.  Hierarchical Structure and Search in Complex Organizations , 2010, Manag. Sci..

[8]  K. Clark,et al.  Creating project plans to focus product development. , 1992, Harvard business review.

[9]  D. Dougherty,et al.  Sustained product innovation in large, mature organizations: Overcoming innovation-to-organization problems. , 1996 .

[10]  Daniel A. Levinthal,et al.  Temporarily Divide to Conquer: Centralized, Decentralized, and Reintegrated Organizational Approaches to Exploration and Adaptation , 2003 .

[11]  Daniel A. Levinthal,et al.  Exploration and Exploitation in Organizational Learning , 2007 .

[12]  Daniel A. Levinthal,et al.  Temporarily Divide to Conquer: Centralized, Decentralized, and Reintegrated Organizational Approaches to Exploration and Adaptation , 2003, Organ. Sci..

[13]  Srinivas Talluri,et al.  Faster, better, cheaper: A study of NPD project efficiency and performance tradeoffs , 2006 .

[15]  Dennis A. Gioia,et al.  Identity, Image, and Issue Interpretation: Sensemaking during Strategic Change in Academia. , 1996 .

[16]  Jack A. Nickerson,et al.  Being Efficiently Fickle: A Dynamic Theory of Organizational Choice , 2002, Organ. Sci..

[17]  Jack A. Nickerson,et al.  Strategic Management of R&D Pipelines with Cospecialized Investments and Technology Markets , 2007, Manag. Sci..

[18]  C. Gibson,et al.  THE ANTECEDENTS , CONSEQUENCES , AND MEDIATING ROLE OF ORGANIZATIONAL AMBIDEXTERITY , 2004 .

[19]  Robert G. Cooper,et al.  Portfolio Management for New Products (Управление портфелем новых продуктов) , 1998 .

[20]  D. Rousseau.  Issues of level in organizational research: Multi-level and cross-level perspectives. , 1985 .

[21]  Henk W. Volberda,et al.  Structural Differentiation and Ambidexterity: The Mediating Role of Integration Mechanisms , 2008, Organ. Sci..

[22]  Cheryl Gaimon,et al.  Managing Knowledge-Based Resource Capabilities Under Uncertainty , 2004, Manag. Sci..

[23]  O. Sorenson,et al.  Technology as a complex adaptive system: evidence from patent data , 2001 .

[24]  R. Grant.  Strategic planning in a turbulent environment: evidence from the oil majors , 2003 .

[25]  R. O. Chao,et al.  How Complexity Impacts R&D Portfolio Decisions and Technological Search Distance , 2011 .

[26]  Constantine Andriopoulos,et al.  Exploitation-Exploration Tensions and Organizational Ambidexterity: Managing Paradoxes of Innovation , 2009, Organ. Sci..

[27]  Fabian J. Sting,et al.  Collaborative Search , 2016 .

[28]  Andrew H. Van de Ven,et al.  Special Issue: Frontiers of Organization Science, Part 1 of 2: Designing Work Within and Between Organizations , 2005, Organ. Sci..

[29]  Daniel A. Levinthal.  Adaptation on rugged landscapes , 1997 .

[30]  Kenneth B. Kahn,et al.  PERSPECTIVE: Trends and Drivers of Success in NPD Practices: Results of the 2003 PDMA Best Practices Study* , 2009 .

[31]  W. D. Perreault,et al.  Reliability of Nominal Data Based on Qualitative Judgments , 1989 .

[32]  Daniel A. Levinthal,et al.  Chasing a Moving Target: Exploitation and Exploration in Dynamic Environments , 2011, Manag. Sci..

[33]  Stylianos Kavadias,et al.  Strategic Resource Allocation: Top-Down, Bottom-Up, and the Value of Strategic Buckets , 2013, Manag. Sci..

[34]  A. Langley.  Strategies for Theorizing from Process Data , 1999 .

[35]  Christoph H. Loch,et al.  Selectionism and Learning in Projects with Complexity and Unforeseeable Uncertainty , 2004, Manag. Sci..

[36]  Stylianos Kavadias,et al.  A Theoretical Framework for Managing the New Product Development Portfolio: When and How to Use Strategic Buckets , 2008, Manag. Sci..

[37]  Kevin W. Linderman,et al.  Managing Knowledge Creation in High-Tech R&D Projects: A Multimethod Study , 2015, Decis. Sci..

[38]  A. Michael Huberman,et al.  An expanded sourcebook qualitative data analysis , 1994 .

[39]  John H. Miller,et al.  Complex adaptive systems - an introduction to computational models of social life , 2009, Princeton studies in complexity.

[40]  R. V. Hoek.  Clockspeed: Winning Industry Control in the Age of Temporary Advantage , 2000 .

[41]  Diane M. Strong,et al.  Technological Embeddedness and Organizational Change , 2007, Organ. Sci..

[42]  A. Smart.  Operations, Strategy, and Technology: Pursuing the Competitive Edge , 2006 .

[43]  Christoph H. Loch,et al.  Dynamic Portfolio Selection of NPD Programs Using Marginal Returns , 2002, Manag. Sci..

[44]  K. Eisenhardt.  Building theories from case study research , 1989, STUDI ORGANIZZATIVI.

[45]  O. Sorenson,et al.  Science as a Map in Technological Search , 2000 .

[46]  Jan W. Rivkin,et al.  Patterned Interactions in Complex Systems: Implications for Exploration , 2007, Manag. Sci..

[47]  Dovev Lavie,et al.  Balance Within and Across Domains: The Performance Implications of Exploration and Exploitation in Alliances , 2011, Organ. Sci..

[48]  G. Hamel,et al.  Strategy as revolution. , 1996, Harvard business review.

[49]  Jan W. Rivkin,et al.  Balancing Search and Stability: Interdependencies Among Elements of Organizational Design , 2003, Manag. Sci..

[50]  Lori Rosenkopf,et al.  Balancing Exploration and Exploitation in Alliance Formation , 2006 .

[51]  Zi-Lin He,et al.  Exploration vs. Exploitation: An Empirical Test of the Ambidexterity Hypothesis , 2004, Organ. Sci..

[52]  Mary J. Benner,et al.  Exploitation, Exploration, and Process Management: The Productivity Dilemma Revisited , 2003 .

[53]  Debasish N. Mallick,et al.  An Integrated Framework for Measuring Product Development Performance in High Technology Industries , 2003 .

[54]  A. Strauss,et al.  Basics of qualitative research: Grounded theory procedures and techniques. , 1993 .

[55]  Laura B. Cardinal,et al.  Balancing and Rebalancing in the Creation and Evolution of Organizational Control , 2004, Organ. Sci..

[56]  R. Schroeder,et al.  The role of project and organizational context in managing high-tech R&D projects , 2015 .