High Reliability in Digital Organizing: Mindlessness, the Frame Problem, and Digital Operations

Organizations facing high risks and operating in purely digital domains, such as computer security and many financial services, must meet two, contradictory goals: they need to identify digital threats at scale and speed while also avoiding errors that result from automated processing. Research on high-reliability organizations has identified multiple challenges in reaching these goals simultaneously, because automation often renders organizations’ operations “mindless” and unable to cope gracefully with changing, complex situations characteristic of high-risk domains. In digital operations, a special challenge arises from the “frame problem” connected with the inability of algorithms to adapt to environments not identified within their developers’ initial cognitive frames. An exploratory, theory-generating case study was conducted within a computer security company (F-Secure) to examine how organizations acting in digital domains may achieve high reliability by mitigating the frame problem. This article examines digital organizing of the epistemic and pragmatic features of operations, along with arrangements of these features that respond to the frame problem. Collective mindfulness is identified as emerging in such a sociotechnical setting via a carefully layered, systemic constellation of (human) mindful and (digital) mindless operations while the organization’s core operations remain digital and algorithmic. The findings point to heretofore unexplored reliability challenges associated with digital organizing, alongside several relevant ways to overcome and/or mitigate them.

[1]  Adam Wierman,et al.  Thinking Fast and Slow , 2017, SIGMETRICS Perform. Evaluation Rev..

[2]  Nick Oliver,et al.  Cognition, Technology, and Organizational Limits: Lessons from the Air France 447 Disaster , 2017, Organ. Sci..

[3]  Roman Beck,et al.  The concept of mindfulness in information systems research: a multi-dimensional analysis , 2017, Eur. J. Inf. Syst..

[4]  Scott Sonenshein,et al.  Routines and Creativity: From Dualism to Duality , 2016, Organ. Sci..

[5]  J. Hahn Victims Of Groupthink A Psychological Study Of Foreign Policy Decisions And Fiascoes , 2016 .

[6]  Yvonne Schuhmacher Organizational Behavior The State Of The Science , 2016 .

[7]  Monika Richter,et al.  Cognition In The Wild , 2016 .

[8]  Kalle Lyytinen,et al.  Flexibility vs. Structure: How to Manage Reliably Continuously Emerging Threats in Malware Protection , 2015, 2015 48th Hawaii International Conference on System Sciences.

[9]  Michael Marien,et al.  Book Review: The Second Machine Age: Work, Progress, and Prosperity in a Time of Brilliant Technologies , 2014 .

[10]  John McAvoy,et al.  Analysing ISD performance using narrative networks, routines and mindfulness , 2014, Inf. Softw. Technol..

[11]  Jannis Kallinikos,et al.  The Ambivalent Ontology of Digital Artifacts , 2013, MIS Q..

[12]  D. Cameron Organizational Effectiveness: Old Models and New Constructs , 2013 .

[13]  P. Leonardi,et al.  Materiality and Organizing: Social Interaction in a Technological World , 2013 .

[14]  J. Kallinikos Form, function and matter: crossing the border of materiality , 2012 .

[15]  Pedro M. Domingos A few useful things to know about machine learning , 2012, Commun. ACM.

[16]  David Bamford,et al.  Operations Management in Context , 2012 .

[17]  Antti Oulasvirta,et al.  Resolving Safety-Critical Incidents in a Rally Control Center , 2011, Hum. Comput. Interact..

[18]  Kalle Lyytinen,et al.  The New Organizing Logic of Digital Innovation: An Agenda for Information Systems Research , 2011 .

[19]  Rajiv Kishore,et al.  Social Capital and IT as predicates of Collective Mindfulness and Business Risk Mitigation: A Grounded Theory Development , 2011, ICIS.

[20]  Erik Dane Reconsidering the Trade-off Between Expertise and Flexibility: a Cognitive Entrenchment Perspective , 2010 .

[21]  Charles Perrow,et al.  The meltdown was not an accident , 2010 .

[22]  Moshe Farjoun Beyond Dualism: Stability and Change As a Duality , 2010 .

[23]  K. Lyytinen,et al.  Digital Infrastructures : The Missing IS Research Agenda , 2010 .

[24]  Mikko Valorinta,et al.  Information technology and mindfulness in organizations , 2009 .

[25]  J. Carroll,et al.  Moving Beyond Normal Accidents and High Reliability Organizations: A Systems Approach to Safety in Complex Systems , 2009 .

[26]  E. Burton Swanson,et al.  Mindfulness Routines for Innovating with Information Technology , 2009, J. Decis. Syst..

[27]  Bartel Van de Walle,et al.  Decision support for emergency situations , 2008, Inf. Syst. E Bus. Manag..

[28]  Valéry Merminod,et al.  Product LIfecycle Management, Knowledge Integration and Reliability in New Product Co-Development: A Case Study Between Europe and China , 2008, ICIS.

[29]  Kalle Lyytinen,et al.  Systemic Risk, IT Artifacts, and High Reliability Organizations: A Case of Constructing a Radical Architecture , 2008 .

[30]  Nassim Nicholas Taleb,et al.  The Black Swan: The Impact of the Highly Improbable , 2007 .

[31]  Emilie M. Roth,et al.  Shared Situation Awareness as a Contributor to High Reliability Performance in Railroad Operations , 2006 .

[32]  Daniel A. Levinthal,et al.  Crossing an Apparent Chasm: Bridging Mindful and Less-Mindful Perspectives on Organizational Learning , 2006, Organ. Sci..

[33]  Kathleen M. Sutcliffe,et al.  Mindfulness and the Quality of Organizational Attention , 2006, Organ. Sci..

[34]  Brian S. Butler,et al.  Reliability, Mindfulness, and Information Systems , 2006, MIS Q..

[35]  Anne-Françoise Rutkowski,et al.  Dealing with Risk in Incident Management: An Application of High Reliability Theory , 2006, Proceedings of the 39th Annual Hawaii International Conference on System Sciences (HICSS'06).

[36]  Rajiv Kishore,et al.  Assuring IT Services Quality through High-Reliability Risk Management in Offshore Business Process Outsourcing , 2006, ICIS.

[37]  E. Burton Swanson,et al.  Innovating Mindfully with Information Technology , 2004, MIS Q..

[38]  Timothy J. Vogus,et al.  Structuring for High Reliability: HR Practices and Mindful Processes in Reliability-Seeking Organizations , 2003 .

[39]  Karlene H. Roberts,et al.  High reliability and organizational behavior: finally the twain must meet , 2003 .

[40]  Karlene H. Roberts,et al.  The Incident Command System : High Reliability Organizing for Complex and Volatile Task , 2007 .

[41]  Karl E. Weick,et al.  Managing the unexpected: Assuring high performance in an age of complexity. , 2001 .

[42]  J. Reason Human error: models and management , 2000, BMJ : British Medical Journal.

[43]  K. Weick,et al.  Organizing for high reliability: Processes of collective mindfulness. , 1999 .

[44]  Martha Grabowski,et al.  Risk Mitigation in Virtual Organizations , 1999, J. Comput. Mediat. Commun..

[45]  Richard E. Boyatzis,et al.  Transforming Qualitative Information: Thematic Analysis and Code Development , 1998 .

[46]  Christos H. Papadimitriou,et al.  Elements of the Theory of Computation , 1997, SIGA.

[47]  Mathilde Bourrier,et al.  Organizing Maintenance Work At Two American Nuclear Power Plants , 1996 .

[48]  Paul P. Maglio,et al.  On Distinguishing Epistemic from Pragmatic Action , 1994, Cogn. Sci..

[49]  Ramkrishnan V. Tenkasi,et al.  Designing Information Technology to Support Distributed Cognition Ceo Publication G 93-16 (236) Designing Information Technology to Support Distributed Cognition Designing Information Technology to Support Distributed Cognition , 1994 .

[50]  S. Stout,et al.  Decision Dynamics in Two High Reliability Military Organizations , 1994 .

[51]  Kevin Crowston,et al.  The interdisciplinary study of coordination , 1994, CSUR.

[52]  K. Weick,et al.  Collective mind in organizations: Heedful interrelating on flight decks. , 1993 .

[53]  Scott D. Sagan,et al.  The Limits of Safety: Organizations, Accidents, and Nuclear Weapons , 1993 .

[54]  Hubert L. Dreyfus,et al.  What computers still can't do - a critique of artificial reason , 1992 .

[55]  R. A. Brooks,et al.  Intelligence without Representation , 1991, Artif. Intell..

[56]  R. I. Sutton,et al.  Switching Cognitive Gears: From Habits of Mind to Active Thinking , 1991 .

[57]  K. J. Vicente,et al.  The Ecology of Human-Machine Systems II: Mediating 'Direct Perception' in Complex Work Domains , 1990 .

[58]  K. Roberts Some Characteristics of One Type of High Reliability Organization , 1990 .

[59]  J. E. Groves,et al.  Made in America: Science, Technology and American Modernist Poets , 1989 .

[60]  K. Eisenhardt Building theories from case study research , 1989, STUDI ORGANIZZATIVI.

[61]  Karlene H. Roberts,et al.  Research in nearly failure-free, high-reliability organizations: having the bubble , 1989 .

[62]  M. O'hare,et al.  Searching for Safety , 1990 .

[63]  Y. Shoham What is the frame problem , 1987 .

[64]  Karlene H. Roberts,et al.  The Self-Designing High-Reliability Organization: Aircraft Carrier Flight Operations at Sea , 1987 .

[65]  Terry Winograd,et al.  Understanding computers and cognition - a new foundation for design , 1987 .

[66]  K. Cameron Effectiveness as Paradox: Consensus and Conflict in Conceptions of Organizational Effectiveness , 1986 .

[67]  John McCarthy,et al.  SOME PHILOSOPHICAL PROBLEMS FROM THE STANDPOINT OF ARTI CIAL INTELLIGENCE , 1987 .

[68]  Дрейфус Хьюберт,et al.  Чего не могут вычислительные машины: Критика искусственного разума. (What computers cant do: A critique of artificial reason) , 1978 .

[69]  Michael X Cohen,et al.  A Garbage Can Model of Organizational Choice. , 1972 .

[70]  C. Lévi-Strauss The Savage Mind , 1967 .

[71]  P. Hayes,et al.  Cognitive Wheels : The Frame Problem of AI , 2022 .