Understanding User Uncertainty during the Implementation of Self-Service Business Intelligence: A Thematic Analysis

Owing to Self-Service Business Intelligence (SSBI) systems’ transformative power for organizations, substantial user uncertainties often blight their potential. Although these uncertainties pose a significant threat to effective SSBI implementation, their sources and determinants remain unclear. We conducted semi-structured interviews with 15 current users of a recently implemented SSBI system to empirically explore the relevant factors of user uncertainty. We undertook a rigorous thematic analysis of the collected data, thereafter developing a thematic map to visualize user uncertainties. This map uncovered three unexplored important factors (work routine change, social dynamics and fear of AI) for future research. Our findings show that users are not only perturbed by “hard” factors (e.g. a lack of technical understanding), but also by “soft” factors (social dynamics, fear of AI and nontransparency). Practitioners can use the thematic map to identify and observe potential uncertainties and to develop adequate procedures.

[1]  D. Brashers Communication and Uncertainty Management. , 2001 .

[2]  Viswanath Venkatesh,et al.  Managing Citizens' Uncertainty in E-Government Services: The Mediating and Moderating Roles of Transparency and Trust , 2016, Inf. Syst. Res..

[3]  H. P. Sims,et al.  A Typology for Integrating Technology, Organization, and Job Design , 1980 .

[4]  Peter H. Gray,et al.  Social Influence and Knowledge Management Systems Use: Evidence from Panel Data , 2013, MIS Q..

[5]  Howard E. Aldrich,et al.  Organizations and Environments , 1979 .

[6]  Suresh Malladi,et al.  Adoption of Business Intelligence & Analytics in Organizations - An Empirical Study of Antecedents , 2013, AMCIS.

[7]  Viswanath Venkatesh,et al.  Changes in Employees' Job Characteristics During an Enterprise System Implementation: A Latent Growth Modeling Perspective , 2013, MIS Q..

[8]  V. Braun,et al.  Using thematic analysis in psychology , 2006 .

[9]  Hock-Hai Teo,et al.  Effects of environmental uncertainty on organizational intention to adopt distributed work arrangements , 2004, IEEE Transactions on Engineering Management.

[10]  Michael Song,et al.  Manuscript #: RRR97-0379 THE EFFECT OF PERCEIVED TECHNOLOGICAL UNCERTAINTY ON JAPANESE NEW PRODUCT DEVELOPMENT , 1999 .

[11]  Jay R. Galbraith Designing Complex Organizations , 1973 .

[12]  Meredith Lawley,et al.  Factors influencing decision support system acceptance , 2013, Decis. Support Syst..

[13]  Bryan Marshall,et al.  Does Sample Size Matter in Qualitative Research?: A Review of Qualitative Interviews in is Research , 2013, J. Comput. Inf. Syst..

[14]  Paul A. Pavlou,et al.  Understanding and Mitigating Uncertainty in Online Exchange Relationships: A Principal-Agent Perspective , 2007, MIS Q..

[15]  Robert W. Zmud,et al.  A Comprehensive Conceptualization of Post-Adoptive Behaviors Associated with Information Technology Enabled Work Systems , 2005, MIS Q..

[16]  E. Lind,et al.  When fairness works : Toward a general theory of uncertainty management , 2002 .

[17]  Eric S. K. Yu,et al.  Adapting to uncertain and evolving enterprise requirements: The case of business-driven business intelligence , 2013, IEEE 7th International Conference on Research Challenges in Information Science (RCIS).

[18]  Barbara Dinter,et al.  25+ Years of Business Intelligence and Analytics Minitrack at HICSS: A Text Mining Analysis , 2017, HICSS.

[19]  Dennis F. Galletta,et al.  A Multidimensional Commitment Model of Volitional Systems Adoption and Usage Behavior , 2005, J. Manag. Inf. Syst..

[20]  Mark Thompson,et al.  People, practice, and technology: Restoring Giddens' broader philosophy to the study of information systems , 2012, Inf. Organ..

[21]  Sue Newell,et al.  Coping with Information Technology: Mixed Emotions, Vacillation, and Nonconforming Use Patterns , 2015, MIS Q..

[22]  Thomas Hess,et al.  Product fit uncertainty and its effects on vendor choice: an experimental study , 2015, Electronic Markets.

[23]  Eva Söderström,et al.  Implementation Challenges of Self Service Business Intelligence: A Literature Review , 2018, HICSS.

[24]  I. Ajzen The theory of planned behavior , 1991 .

[25]  Suzanne Rivard,et al.  A Multilevel Model of Resistance to Information Technology Implementation , 2005, MIS Q..

[26]  F. Knight The economic nature of the firm: From Risk, Uncertainty, and Profit , 2009 .

[27]  Veda C. Storey,et al.  Business Intelligence and Analytics: From Big Data to Big Impact , 2012, MIS Q..

[28]  M. Patton,et al.  Qualitative evaluation and research methods , 1992 .

[29]  Moritz Becker,et al.  Understanding Users' Health Information Privacy Concerns for Health Wearables , 2018, HICSS.

[30]  M. Feldman Organizational Routines as a Source of Continuous Change , 2000 .

[31]  Sven Laumer,et al.  Work routines as an object of resistance during information systems implementations: theoretical foundation and empirical evidence , 2016, Eur. J. Inf. Syst..

[32]  Steven L. Alter Work System Theory: Overview of Core Concepts, Extensions, and Challenges for the Future , 2013, J. Assoc. Inf. Syst..

[33]  Christopher J. Davis,et al.  User response to mandatory IT use: a Coping Theory perspective , 2018, Eur. J. Inf. Syst..

[34]  Gordon B. Davis,et al.  User Acceptance of Information Technology: Toward a Unified View , 2003, MIS Q..

[35]  Lars Mathiassen,et al.  A Theory of Responsive Design: A Field Study of Corporate Engagement with Open Source Communities , 2017, Inf. Syst. Res..

[36]  Frank Biocca,et al.  Consumer Learning and the Effects of Virtual Experience Relative to Indirect and Direct Product Experience , 2008 .

[37]  Kai R. T. Larsen,et al.  A Taxonomy of Antecedents of Information Systems Success: Variable Analysis Studies , 2003, J. Manag. Inf. Syst..

[38]  Michael D. Myers,et al.  The qualitative interview in IS research: Examining the craft , 2007, Inf. Organ..

[39]  Paul Alpar,et al.  Self-Service Business Intelligence , 2016, Bus. Inf. Syst. Eng..

[40]  Richard E. Boyatzis,et al.  Transforming Qualitative Information: Thematic Analysis and Code Development , 1998 .