Creativity at the Knowledge Frontier: The Impact of Specialization in Fast- and Slow-paced Domains*

Using the impact of the Soviet Union’s collapse on the performance of theoretical mathematicians as a natural experiment, we attempt to resolve the controversy in prior research on whether specialists or generalists have superior creative performance. While many have highlighted generalists’ advantage due to access to a wider set of knowledge components, others have underlined the benefits that specialists can derive from their deep expertise. We argue that this disagreement might be partly driven by the fact that the pace of change in a knowledge domain shapes the relative return from being a specialist or a generalist. We show that generalist scientists performed best when the pace of change was slower and their ability to draw from diverse knowledge domains was an advantage in the field, but specialists gained advantage when the pace of change increased and their deeper expertise allowed them to use new knowledge created at the knowledge frontier. We discuss and test the roles of cognitive mechanisms and of competition for scarce resources. Specifically, we show that specialists became more desirable collaborators when the pace of change was faster, but when the pace of change was slower, generalists were more sought after as collaborators. Overall, our results highlight trade-offs associated with specialization for creative performance.

[1]  M. Montoya-Weiss,et al.  Critical development activities for really new versus incremental products , 1998 .

[2]  Jasjit Singh,et al.  Lone Inventors as Source of Breakthroughs: Myth or Reality? , 2009, Manag. Sci..

[3]  A. McGahan,et al.  Health Care’s Grand Challenge: Stimulating Basic Science on Diseases that Primarily Afflict the Poor , 2016 .

[4]  Melissa A. Schilling A "Small-World" Network Model of Cognitive Insight , 2005 .

[5]  T. M. Amabile The social psychology of creativity: A componential conceptualization. , 1983 .

[6]  D. Dougherty Interpretive Barriers to Successful Product Innovation in Large Firms , 1992 .

[7]  Avi Goldfarb,et al.  Understanding the Changing Structure of Scientific Inquiry , 2016 .

[8]  Gino Cattani,et al.  A Core/Periphery Perspective on Individual Creative Performance: Social Networks and Cinematic Achievements in the Hollywood Film Industry , 2008, Organ. Sci..

[9]  K. Knorr-Cetina,et al.  Epistemic cultures : how the sciences make knowledge , 1999 .

[10]  G. King,et al.  Cem: Coarsened Exact Matching in Stata , 2009 .

[11]  Wanda J. Orlikowski,et al.  Knowing in practice: Enacting a collective capability in distributed organizing , 2002, STUDI ORGANIZZATIVI.

[12]  O. Hauptman,et al.  The influence of process concurrency on project outcomes in product development: an empirical study of cross-functional teams , 1996 .

[13]  Pierre Azoulay,et al.  Matthew: Effect or Fable? , 2012, Manag. Sci..

[14]  Karin Fladmoe-Lindquist,et al.  Breakthrough innovations in the U.S. biotechnology industry: the effects of technological space and geographic origin , 2006 .

[15]  E. Leahey,et al.  Research Specialization and Collaboration Patterns in Sociology , 2008 .

[16]  Raffaele Conti,et al.  Learning to Be Edison: Inventors, Organizations, and Breakthrough Inventions , 2014, Organ. Sci..

[17]  Bernard Barber,et al.  The Structure of Scientific Revolutions. , 1963 .

[18]  Lee Fleming,et al.  Finding the organizational sources of technological breakthroughs: the story of Hewlett‐Packard's thermal ink‐jet , 2002 .

[19]  Eugene Russo Special Report: The birth of biotechnology , 2003, Nature.

[20]  Philip H. Birnbaum,et al.  Integration and Specialization in Academic Research , 1981 .

[21]  Florenta Teodoridis,et al.  When Collaboration Bridges Institutions: The Impact of University-Industry Collaboration on Academic Productivity , 2019, Organ. Sci..

[22]  G. Dosi Technological Paradigms and Technological Trajectories: A Suggested Interpretation of the Determinants and Directions of Technical Change , 1982 .

[23]  R. Merton Priorities in scientific discovery: A chapter in the sociology of science. , 1957 .

[24]  Toby E. Stuart,et al.  Status Spillovers: The Effect of Status-conferring Prizes on the Allocation of Attention , 2018 .

[25]  Andrew Hargadon,et al.  When Innovations Meet Institutions: Edison and the Design of the Electric Light , 2001 .

[26]  Kwanghui Lim,et al.  The many faces of absorptive capacity : spillovers of copper interconnect technology for semiconductor chips , 2000 .

[27]  Erik Dane Reconsidering the Trade-off Between Expertise and Flexibility: a Cognitive Entrenchment Perspective , 2010 .

[28]  Joshua S. Gans,et al.  Exploring Trade-offs in the Organization of Scientific Work: Collaboration and Scientific Reward , 2015, Manag. Sci..

[29]  Ezra W. Zuckerman,et al.  Networks, Diversity, and Productivity: The Social Capital of Corporate R&D Teams , 2001 .

[30]  A. Luchins Mechanization in problem solving: The effect of Einstellung. , 1942 .

[31]  H. Simon,et al.  Perception in chess , 1973 .

[32]  J. Schumpeter Capitalism, Socialism and Democracy , 1943 .

[33]  L. Fleming,et al.  Collaborative Brokerage, Generative Creativity, and Creative Success , 2007 .

[34]  Paula E. Stephan How Economics Shapes Science , 2012 .

[35]  H. Aarts,et al.  Habits as knowledge structures: automaticity in goal-directed behavior. , 2000, Journal of personality and social psychology.

[36]  Robert J. Sternberg,et al.  Expertise and Intelligent Thinking: When is it Worse to Know Better , 1989 .

[37]  Sarah Kaplan,et al.  The double-edged sword of recombination in breakthrough innovation: The Double-Edged Sword of Recombination , 2015 .

[38]  M. Weitzman,et al.  Recombinant Growth , 2009 .

[39]  R. Weisberg Creativity and knowledge: A challenge to theories. , 1998 .

[40]  Benjamin F. Jones,et al.  Age dynamics in scientific creativity , 2011, Proceedings of the National Academy of Sciences.

[41]  B. Uzzi,et al.  Collaboration and Creativity: The Small World Problem1 , 2005, American Journal of Sociology.

[42]  G. Häubl,et al.  Explaining Cognitive Lock-In: The Role of Skill-Based Habits of Use in Consumer Choice , 2007 .

[43]  Gianluca Carnabuci,et al.  Risky Recombinations: Institutional Gatekeeping in the Innovation Process , 2017, Organ. Sci..

[44]  Edwin G. Boring,et al.  Dual Role of the Zeitgeist in Scientific Creativity , 1955 .

[45]  Benjamin F. Jones The Burden of Knowledge and the &Apos;Death of the Renaissance Man&Apos;: Is Innovation Getting Harder? , 2005 .

[46]  R. Merton The Matthew Effect in Science , 1968, Science.

[47]  Silvana Tenreyro,et al.  The Log of Gravity , 2004, The Review of Economics and Statistics.

[48]  P. McLeod,et al.  Inflexibility of experts—Reality or myth? Quantifying the Einstellung effect in chess masters , 2008, Cognitive Psychology.

[49]  S. Gould,et al.  Punctuated equilibria: the tempo and mode of evolution reconsidered , 1977, Paleobiology.

[50]  Curba Morris Lampert,et al.  Entrepreneurship in the large corporation: a longitudinal study of how established firms create breakthrough inventions , 2001 .

[51]  Erin E Leahey,et al.  Not by Productivity Alone: How Visibility and Specialization Contribute to Academic Earnings , 2007 .

[52]  Melissa A. Schilling,et al.  Recombinant Search and Breakthrough Idea Generation: An Analysis of High Impact Papers in the Social Sciences , 2011 .

[53]  Florenta Teodoridis Understanding Team Knowledge Production: The Interrelated Roles of Technology and Expertise , 2018, Manag. Sci..

[54]  Loren R. Graham,et al.  Science in Russia and the Soviet Union: A Short History , 1993 .

[55]  G. Borjas,et al.  The Collapse of the Soviet Union and the Productivity of American Mathematicians , 2012, World Scientific Studies in International Economics.

[56]  R. Krohn Laboratory Life , 2019, Contemporary Sociology: A Journal of Reviews.

[57]  K. Dunbar HOW SCIENTISTS REALLY REASON: SCIENTIFIC REASONING IN REAL-WORLD LABORATORIES , 1995 .

[58]  Oscar Hauptman,et al.  Effectiveness of Organizational Responses to Technological Change in the Production Process , 1992 .

[59]  Aleksandra J. Kacperczyk,et al.  The Paradox of Breadth: The Tension between Experience and Legitimacy in the Transition to Entrepreneurship* , 2017 .

[60]  Gianluca Carnabuci,et al.  Knowledge Specialization, Knowledge Brokerage and the Uneven Growth of Technology Domains , 2009 .

[61]  R. Burt Structural Holes and Good Ideas1 , 2004, American Journal of Sociology.

[62]  G. King,et al.  Multivariate Matching Methods That Are Monotonic Imbalance Bounding , 2011 .

[63]  Daniel A. Levinthal The Slow Pace of Rapid Technological Change: Gradualism and Punctuation in Technological Change , 1998 .

[64]  P. Romer Endogenous Technological Change , 1989, Journal of Political Economy.

[65]  Pier Vittorio Mannucci,et al.  The Differential Impact of Knowledge Depth and Knowledge Breadth on Creativity over Individual Careers , 2017, Academy of Management Journal.

[66]  Lee Fleming,et al.  Special Issue on Design and Development: Recombinant Uncertainty in Technological Search , 2001, Manag. Sci..

[67]  Erin Leahey,et al.  Prominent but Less Productive , 2015, ArXiv.

[68]  Ezra W. Zuckerman,et al.  How to Make the Team: Social Networks vs. Demography as Criteria for Designing Effective Teams , 2004 .

[69]  M. Tushman,et al.  Technological Discontinuities and Organizational Environments , 1986 .

[70]  Jinhong Xie,et al.  The Impact of Cross‐Functional Joint Involvement Across Product Development Stages: An Exploratory Study , 1998 .

[71]  B. Verplanken,et al.  Predicting behavior from actions in the past : repeated decision making or a matter of habit? , 1998 .

[72]  T. Knudsen,et al.  Coordinated Exploration: Organizing Search by Multiple Specialists to Overcome Mutual Confusion and Joint Myopia , 2013 .

[73]  Pino G. Audia,et al.  Past Success and Creativity over Time: A Study of Inventors in the Hard Disk Drive Industry , 2007, Manag. Sci..

[74]  Michelene T. H. Chi,et al.  Expertise in Problem Solving. , 1981 .

[75]  Sen Chai,et al.  Near Misses in the Breakthrough Discovery Process , 2017, Organ. Sci..

[76]  Karim R. Lakhani,et al.  Marginality and Problem-Solving Effectiveness in Broadcast Search , 2010, Organ. Sci..

[77]  W. P. Barnett,et al.  The Organizational Ecology of a Technological System. , 1990 .

[78]  Ina Ganguli,et al.  Scientific brain drain and human capital formation after the end of the Soviet Union , 2013 .

[79]  Paula E. Stephan,et al.  Changing Incentives to Publish , 2011, Science.

[80]  B. Latour,et al.  Laboratory Life: The Construction of Scientific Facts , 1979 .

[81]  Andrew B. Hargadon,et al.  Technology brokering and innovation in a product development firm. , 1997 .

[82]  Paul Josephson,et al.  Science in the New Russia , 2009 .

[83]  Kim B. Clark,et al.  Architectural Innovation: The Reconfiguration of Existing Product Technologies and the Failure of , 1990 .

[84]  H. Greve,et al.  Superman or the Fantastic Four? Knowledge Combination and Experience in Innovative Teams , 2006 .

[85]  Scott Stern,et al.  Climbing Atop the Shoulders of Giants: The Impact of Institutions on Cumulative Research , 2006, American Economic Review.

[86]  Benjamin F. Jones,et al.  Atypical Combinations and Scientific Impact , 2013, Science.