Engineering serendipity: When does knowledge sharing lead to knowledge production?

Abstract Research Summary We investigate how knowledge similarity between two individuals is systematically related to the likelihood that a serendipitous encounter results in knowledge production. We conduct a field experiment at a medical research symposium, where we exogenously varied opportunities for face‐to‐face encounters among 15,817 scientist‐pairs. Our data include direct observations of interaction patterns collected using sociometric badges, and detailed, longitudinal data of the scientists' postsymposium publication records over 6 years. We find that interacting scientists acquire more knowledge and coauthor 1.2 more papers when they share some overlapping interests, but cite each other's work between three and seven times less when they are from the same field. Our findings reveal both collaborative and competitive effects of knowledge similarity on knowledge production outcomes. Managerial Summary Managers often try to stimulate innovation by encouraging serendipitous interactions between employees, for example by using office space redesigns, conferences and similar events. Are such interventions effective? This article proposes that an effective encounter depends on the degree of common knowledge shared by the individuals. We find that scientists who attend the same conference are more likely to learn from each other and collaborate effectively when they have some common interests, but may view each other competitively when they work in the same field. Hence, when designing opportunities for face‐to‐face interactions, managers should consider knowledge similarity as a criteria for fostering more productive exchanges.

[1]  K. Arrow Economic Welfare and the Allocation of Resources for Invention , 1962 .

[2]  D. Jorgenson The Rate and Direction of Inventive Activity. , 1963 .

[3]  R. Merton,et al.  The Sociology of Science: Theoretical and Empirical Investigations , 1975, Journal for the Scientific Study of Religion.

[4]  P. Blau The Organization of Academic Work , 2021 .

[5]  W. Hagstrom Competition in Science , 1974 .

[6]  Norman Kaplan,et al.  The Sociology of Science: Theoretical and Empirical Investigations , 1974 .

[7]  B. Reskin Scientific Productivity and the Reward Structure of Science , 1977 .

[8]  Thomas J. Allen,et al.  Managing the flow of technology: technology transfer and the dissemination of technological informat , 1977 .

[9]  Estelle Brodman,et al.  Managing the Flow of Technology: Technology Transfer and the Dissemination of Technological Information Within the R&D Organization (Book Review) , 1978 .

[10]  B. Latour,et al.  Laboratory Life: The Construction of Scientific Facts , 1979 .

[11]  P. Bourdieu Distinction: A Social Critique of the Judgement of Taste* , 2018, Food and Culture.

[12]  J. Hicks,et al.  The economics of science , 1996 .

[13]  L. Smith-Lovin,et al.  Homophily in voluntary organizations: Status distance and the composition of face-to-face groups. , 1987 .

[14]  H. Simon Bounded Rationality and Organizational Learning , 1991 .

[15]  B. Kogut,et al.  Knowledge of the Firm, Combinative Capabilities, and the Replication of Technology , 1992 .

[16]  Paul M. B. Vitányi,et al.  Theories of learning , 2007 .

[17]  Daniel A. Levinthal,et al.  The myopia of learning , 1993 .

[18]  I. Nonaka A Dynamic Theory of Organizational Knowledge Creation , 1994 .

[19]  Paula E. Stephan The Economics of Science , 1996 .

[20]  J. Spender Making knowledge the basis of a dynamic theory of the firm , 1996 .

[21]  Gabriel Szulanski Exploring internal stickiness: Impediments to the transfer of best practice within the firm , 1996 .

[22]  R. Grant Toward a Knowledge-Based Theory of the Firm,” Strategic Management Journal (17), pp. , 1996 .

[23]  Andrew B. Hargadon,et al.  Technology brokering and innovation in a product development firm. , 1997 .

[24]  B. Uzzi,et al.  Social Structure and Competition in Interfirm Networks: The Paradox of Embeddedness , 1997 .

[25]  Melissa S. Anderson,et al.  Withholding research results in academic life science. Evidence from a national survey of faculty. , 1997, JAMA.

[26]  Ashish Arora,et al.  The Impact of NSF Support for Basic Research in Economics , 1997 .

[27]  L. Argote Organizational Learning: Creating, Retaining and Transferring Knowledge , 1999 .

[28]  Morten T. Hansen,et al.  The Search-Transfer Problem: The Role of Weak Ties in Sharing Knowledge across Organization Subunits , 1999 .

[29]  Barry M. Staw,et al.  What Bandwagons Bring: Effects of Popular Management Techniques on Corporate Performance, Reputation, and CEO Pay , 2000 .

[30]  Eric A. von Hippel,et al.  How Open Source Software Works: 'Free' User-to-User Assistance? , 2000 .

[31]  Andrew Abbott,et al.  Time Matters: On Theory and Method , 2001 .

[32]  M. McPherson,et al.  Birds of a Feather: Homophily in Social Networks , 2001 .

[33]  Howard L. Bleich,et al.  Technical Milestone: Medical Subject Headings Used to Search the Biomedical Literature , 2001, J. Am. Medical Informatics Assoc..

[34]  Lee Fleming,et al.  Special Issue on Design and Development: Recombinant Uncertainty in Technological Search , 2001, Manag. Sci..

[35]  Morten T. Hansen,et al.  Competing for Attention in Knowledge Markets: Electronic Document Dissemination in a Management Consulting Company , 2001 .

[36]  S. Hilgartner,et al.  Data withholding in academic genetics: evidence from a national survey. , 2002, JAMA.

[37]  Lori Rosenkopf,et al.  Overcoming Local Search Through Alliances and Mobility , 2003, Manag. Sci..

[38]  Paul Almeida,et al.  Learning - by - Hiring: When Is Mobility More Likely to Facilitate Interfirm Knowledge Transfer? , 2003, Manag. Sci..

[39]  Paula E. Stephan,et al.  Scientific Teams and Institution Collaborations: Evidence from U.S. Universities, 1981-1999 , 2004 .

[40]  Paul R. Carlile,et al.  Transferring, Translating, and Transforming: An Integrative Framework for Managing Knowledge Across Boundaries , 2004, Organ. Sci..

[41]  Benjamin F. Jones The Burden of Knowledge and the 'Death of the Renaissance Man': Is Innovation Getting Harder? , 2004 .

[42]  Albert A. Cannella,et al.  Social Capital and Knowledge Creation: Diminishing Returns of the Number and Strength of Exchange Relationships , 2004 .

[43]  Jasjit Singh,et al.  Collaborative Networks as Determinants of Knowledge Diffusion Patterns , 2005, Manag. Sci..

[44]  Waverly W. Ding,et al.  The Determinants of Faculty Patenting Behavior: Demographics or Opportunities? , 2005 .

[45]  Benjamin F. Jones The Burden of Knowledge and the &Apos;Death of the Renaissance Man&Apos;: Is Innovation Getting Harder? , 2005 .

[46]  Indre Maurer,et al.  Dynamics of Social Capital and Their Performance Implications: Lessons from Biotechnology Start-ups , 2006 .

[47]  Avi Goldfarb,et al.  Restructuring Research: Communication Costs and the Democratization of University Innovation , 2006 .

[48]  Waverly W. Ding,et al.  The Impact of Academic Patenting on the Rate, Quality and Direction of (Public) Research Output , 2009 .

[49]  M. Morris,et al.  Do People Mix at Mixers? Structure, Homophily, and the “Life of the Party” , 2007 .

[50]  Juan Miguel Campanario,et al.  Rejecting highly cited papers: The views of scientists who encounter resistance to their discoveries from other scientists , 2007, J. Assoc. Inf. Sci. Technol..

[51]  L. Fleming,et al.  Collaborative Brokerage, Generative Creativity, and Creative Success , 2007 .

[52]  B. Kogut,et al.  Exploring internal stickiness : Impediments to the transfer of best practice within the firm , 2007 .

[53]  Fiona Murray,et al.  Exploring the Foundations of Cumulative Innovation: Implications for Organization Science , 2007, Organ. Sci..

[54]  Martine R. Haas,et al.  To Share or Not to Share? Professional Norms, Reference Groups, and Information Withholding Among Life Scientists , 2010, Organ. Sci..

[55]  Christina Fang,et al.  Balancing Exploration and Exploitation through Structural Design: The Isolation of Subgroups and Organization Learning , 2008 .

[56]  Jasjit Singh,et al.  Lone Inventors as Source of Breakthroughs: Myth or Reality? , 2009, Manag. Sci..

[57]  Karim R. Lakhani,et al.  Marginality and Problem-Solving Effectiveness in Broadcast Search , 2010, Organ. Sci..

[58]  Ralph A. Heidl,et al.  Knowledge, Networks, and Knowledge Networks , 2011 .

[59]  Douglas L. Miller,et al.  Robust Inference With Multiway Clustering , 2011 .

[60]  Beth A. Bechky Making Organizational Theory Work: Institutions, Occupations, and Negotiated Orders , 2011, Organ. Sci..

[61]  Ralph A. Heidl,et al.  Knowledge, Networks, and Knowledge Networks: A Review and Research Agenda , 2011 .

[62]  Alex Pentland,et al.  Sociometric badges: Using sensor technology to capture new forms of collaboration , 2012 .

[63]  Andrea Prencipe,et al.  Regions Matter: How Localized Social Capital Affects Innovation and External Knowledge Acquisition , 2012, Organ. Sci..

[64]  Ken G. Smith,et al.  The complex search process of invention , 2013 .

[65]  Benjamin F. Jones,et al.  Atypical Combinations and Scientific Impact , 2013, Science.

[66]  Adam M. Kleinbaum,et al.  Discretion Within Constraint: Homophily and Structure in a Formal Organization , 2012, Organ. Sci..

[67]  Daniel A. McFarland,et al.  Ties That Last , 2013 .

[68]  Ioana Boghian Distinction: A Social Critique of the Judgement of Taste , 2013 .

[69]  Daniel A. McFarland,et al.  The Semiformal Organization , 2014, Organ. Sci..

[70]  Marie C. Thursby,et al.  Specific and general information sharing among competing academic researchers , 2014 .

[71]  K. Boudreau,et al.  'Open' Disclosure of Innovations, Incentives and Follow-on Reuse: Theory on Processes of Cumulative Innovation and a Field Experiment in Computational Biology , 2015 .

[72]  Daniel A. McFarland,et al.  Streams of Thought: Knowledge Flows and Intellectual Cohesion in a Multidisciplinary Era , 2015 .

[73]  Erin Leahey,et al.  Prominent but Less Productive , 2015, ArXiv.

[74]  D. Gann,et al.  One Foot in, One Foot Out: How Does Individuals’ External Search Breadth Affect Innovation Outcomes? , 2016 .

[75]  Karim R. Lakhani,et al.  Looking Across and Looking Beyond the Knowledge Frontier: Intellectual Distance, Novelty, and Resource Allocation in Science , 2016, Manag. Sci..

[76]  Elkin Olaguer Pérez Sánchez,et al.  Measurement of potential absorption capacity in Colombia's innovative companies , 2017 .

[77]  K. Boudreau,et al.  A Field Experiment on Search Costs and the Formation of Scientific Collaborations , 2014, Review of Economics and Statistics.

[78]  Ben McQuillin,et al.  Lost in the Storm: The Academic Collaborations that Went Missing in Hurricane Isaac , 2017 .

[79]  Ina Ganguli Saving Soviet Science: The Impact of Grants When Government R&D Funding Disappears , 2017 .

[80]  A. Chatterji,et al.  When Does Advice Impact Startup Performance? , 2017, Strategic Management Journal.

[81]  S. Moss,et al.  From Synchronizing to Harmonizing: The Process of Authenticating Multiple Work Identities , 2018 .

[82]  Christian Catalini,et al.  Microgeography and the Direction of Inventive Activity , 2017, Manag. Sci..

[83]  Daniel A. McFarland,et al.  Superstars in the making? The broad effects of interdisciplinary centers , 2018 .

[84]  Toby E. Stuart,et al.  Status Spillovers: The Effect of Status-conferring Prizes on the Allocation of Attention , 2018 .

[85]  Elisabeth Pain,et al.  Collaborating for the win , 2018 .

[86]  M. Pezzoni,et al.  The important thing is not to win, it is to take part: What if scientists benefit from participating in research grant competitions? , 2019, Research Policy.

[87]  A. Chatterji,et al.  When does advice impact startup performance? , 2019, Strategic Management Journal.

[88]  R. Krohn Laboratory Life , 2019, Contemporary Sociology: A Journal of Reviews.

[89]  Sharique Hasan,et al.  Prior ties and the limits of peer effects on startup team performance , 2019, Strategic Management Journal.

[90]  Lei Zhang,et al.  How to Join the Club: Patterns of Embeddedness and the Addition of New Members to Interorganizational Collaborations , 2020, Administrative Science Quarterly.

[91]  R. Freeman,et al.  Temporary Colocation and Collaborative Discovery: Who Confers at Conferences , 2019, Strategic Management Journal.

[92]  Sunkee Lee,et al.  Learning-by-Moving: Can Reconfiguring Spatial Proximity Between Organizational Members Promote Individual-level Exploration? , 2019, Organization Science.

[93]  Patrick Gaulé,et al.  How Do Travel Costs Shape Collaboration? , 2020, Manag. Sci..