Objective measures of IS usage behavior under conditions of experience and pressure using eye fixation data

The core objective of this study is to understand individuals IS usage by going beyond the traditional subjective self-reported and objective system-log measures to unveil the delicate process through which users interact with IS. In this study, we conducted a laboratory experiment to capture users’ eye movement and, more importantly, applied a novel methodology that uses the Gaussian mixture model (GMM) to analyze the gathered physiological data. We also examine how performance pressure and prior usage experience of the investigative system affect IS usage patterns. Our results suggest that experienced and pressured users demonstrate more efficient and focused usage patterns than inexperienced and non-pressured ones, respectively. Our findings constitute an important advancement in the IS use literature. The proposed statistical approach for analyzing eye-movement data is a critical methodological contribution to the emerging research that uses eye-tracking technology for investigation.

[1]  Angelika Dimoka,et al.  Where Does TAM Reside in the Brain? The Neural Mechanisms Underlying Technology Adoption , 2008, ICIS.

[2]  Tim Chuk,et al.  Understanding eye movements in face recognition with hidden Markov model , 2013, CogSci.

[3]  Erik Brynjolfsson,et al.  Goodbye Pareto Principle, Hello Long Tail: The Effect of Search Costs on the Concentration of Product Sales , 2011, Manag. Sci..

[4]  Sung S. Kim The integrative framework of technology use: an extension and test , 2009 .

[5]  E. B. Swanson,et al.  Management Information Systems: Appreciation and Involvement , 1974 .

[6]  Janet H. Marler,et al.  The dual nature of prior computer experience: More is not necessarily better for technology acceptance , 2013, Comput. Hum. Behav..

[7]  Varun Grover,et al.  Technostress: Technological Antecedents and Implications , 2011, MIS Q..

[8]  Marci S. DeCaro,et al.  Choking under pressure: multiple routes to skill failure. , 2011, Journal of experimental psychology. General.

[9]  Michael Ahearne,et al.  Effect of Technology on Sales Performance: Progressing from Technology Acceptance to Technology Usage and Consequence , 2004 .

[10]  Thomas Dohmen Do Professionals Choke Under Pressure? , 2005, SSRN Electronic Journal.

[11]  Werner Kroeber-Riel,et al.  Activation Research: Psychobiological Approaches in Consumer Research , 1979 .

[12]  Louis Raymond,et al.  Organizational Context and Information Systems Success: A Contingency Approach , 1990, J. Manag. Inf. Syst..

[13]  Timothy J. Loving,et al.  Time pressure and group performance: Exploring underlying processes in the Attentional Focus Model , 2004 .

[14]  O. Turel,et al.  ‘I’m busy (and competitive)!’ Antecedents of knowledge sharing under pressure , 2014 .

[15]  Andrew Burton-Jones,et al.  New Perspectives on the System Usage Construct , 2005 .

[16]  InduShobha N. Chengalur-Smith,et al.  The Impact of Experience and Time on the Use of Data Quality Information in Decision Making , 2003, Inf. Syst. Res..

[17]  William R. King,et al.  Note-Participative Design of Strategic Decision Support Systems: An Empirical Assessment , 1981 .

[18]  Pradeep Racherla,et al.  Network Externalities and Technology Use: A Quantitative Analysis of Intraorganizational Blogs , 2010, J. Manag. Inf. Syst..

[19]  Abdallah Namoune,et al.  Investigating User Attention and Interest in Websites , 2007, INTERACT.

[20]  A. Kruglanski,et al.  Motivated Cognition and Group Interaction: Need for Closure Affects the Contents and Processes of Collective Negotiations , 1999 .

[21]  G. Klerman,et al.  Facial muscle patterning to affective imagery in depressed and nondepressed subjects , 1976, Science.

[22]  Angelika Dimoka,et al.  What Does the Brain Tell Us About Trust and Distrust? Evidence from a Functional Neuroimaging Study , 2010, MIS Q..

[23]  Venkateshviswanath,et al.  A Theoretical Extension of the Technology Acceptance Model , 2000 .

[24]  Gordon B. Davis,et al.  User Acceptance of Information Technology: Toward a Unified View , 2003, MIS Q..

[25]  D. Gustafson,et al.  An empirical study of perceived usefulness and perceived ease of use on computerized support system use over time , 1994 .

[26]  D. Mook,et al.  In defense of external invalidity. , 1983 .

[27]  Chris Lankford,et al.  Gazetracker: software designed to facilitate eye movement analysis , 2000, ETRA.

[28]  Ananth Srinivasan,et al.  Alternative Measures of Systems Effectiveness: Associations and Implications , 1985, MIS Q..

[29]  Izak Benbasat,et al.  An Experimental Investigation of Some MIS Design Variables , 1977, MIS Q..

[30]  G. R. Oldham,et al.  The curvilinear relation between experienced creative time pressure and creativity: moderating effects of openness to experience and support for creativity. , 2006, The Journal of applied psychology.

[31]  Terry C. Lansdown,et al.  The mind's eye: cognitive and applied aspects of eye movement research , 2005 .

[32]  Tor Guimaraes,et al.  Client/Server System Success: Exploring the Human Side , 1997 .

[33]  Bernadette Szajna,et al.  Empirical evaluation of the revised technology acceptance model , 1996 .

[34]  J. H. Bertera,et al.  Masking of foveal and parafoveal vision during eye fixations in reading. , 1981, Journal of experimental psychology. Human perception and performance.

[35]  Michael J. Ginzberg,et al.  Finding an adequate measure of or/ms effectiveness , 1978 .

[36]  Rajiv Kohli,et al.  Performance Impacts of Information Technology: Is Actual Usage the Missing Link? , 2003, Manag. Sci..

[37]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[38]  Fred D. Davis Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[39]  Bart J. Bronnenberg,et al.  Do Digital Video Recorders Influence Sales? , 2010 .

[40]  Daniel Robey,et al.  User Attitudes and Management Information System Use , 1979 .

[41]  Gerardine De Sanctis,et al.  Expectancy Theory as an Explanation of Voluntary Use of a Decision-Support System: , 1983 .

[42]  Agnieszka Bojko,et al.  Informative or Misleading? Heatmaps Deconstructed , 2009, HCI.

[43]  Dianne Cyr,et al.  Exploring Human Images in Website Design Across Cultures: A Multi-Method Approach , 2006 .

[44]  Gerald L. Lohse,et al.  Consumer Eye Movement Patterns on Yellow Pages Advertising , 1997 .

[45]  Magid Igbaria,et al.  Microcomputer applications: An empirical look at usage , 1989, Inf. Manag..

[46]  S. Shimojo,et al.  Gaze bias both reflects and influences preference , 2003, Nature Neuroscience.

[47]  Mohammad S. Rahman,et al.  Technology Usage and Online Sales: An Empirical Study , 2010, Manag. Sci..

[48]  Brian T. Pentland,et al.  USE AND PRODUCTIVITY IN PERSONAL COMPUTING: AN EMPIRICAL TEST , 1989 .

[49]  Richard Klein,et al.  An empirical examination of patient-physician portal acceptance , 2007, Eur. J. Inf. Syst..

[50]  James R. Marsden,et al.  Decision making under time pressure with different information sources and performance-based financial incentives: part 3 , 2006, Decis. Support Syst..

[51]  Robert W. Kentridge,et al.  Eye movements when reading disappearing text: is there a gap effect in reading? , 2004, Vision Research.

[52]  Rajiv Kohli,et al.  Information Technology Payoff in the Health-Care Industry: A Longitudinal Study , 2000, J. Manag. Inf. Syst..

[53]  James R. Marsden,et al.  Decision making under time pressure with different information sources and performance-based financial incentives - Part 1 , 2002, Decis. Support Syst..

[54]  R KingWilliam,et al.  Note-Participative Design of Strategic Decision Support Systems , 1981 .

[55]  X. Drèze,et al.  Internet advertising: Is anybody watching? , 2003 .

[56]  Chris W. Clegg,et al.  Explaining intranet use with the technology acceptance model , 2001, J. Inf. Technol..

[57]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[58]  Mun Y. Yi,et al.  Predicting the use of web-based information systems: self-efficacy, enjoyment, learning goal orientation, and the technology acceptance model , 2003, Int. J. Hum. Comput. Stud..

[59]  O. Mimura [Eye movements]. , 1992, Nippon Ganka Gakkai zasshi.

[60]  Carrick C. Williams,et al.  Eye movements are functional during face learning , 2005, Memory & cognition.

[61]  Bernadette Szajna,et al.  Determining information system usage: Some issues and examples , 1993, Inf. Manag..

[62]  R. Baumeister Choking under pressure: self-consciousness and paradoxical effects of incentives on skillful performance. , 1984, Journal of personality and social psychology.

[63]  K. Rayner Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[64]  Wan Chul Yoon,et al.  Age- and experience-related user behavior differences in the use of complicated electronic devices , 2008, Int. J. Hum. Comput. Stud..

[65]  Melody M. Moore,et al.  Controllability of Galvanic Skin Response , 2005 .

[66]  D. C. Howell Fundamental Statistics for the Behavioral Sciences , 1985 .

[67]  S. Karau,et al.  The effects of time scarcity and time abundance on group performance quality and interaction process. , 1992 .

[68]  Niv Ahituv,et al.  The Effects of Time Pressure and Completeness of Information on Decision Making , 1998, J. Manag. Inf. Syst..

[69]  Viswanath Venkatesh,et al.  User Acceptance Enablers in Individual Decision Making About Technology: Toward an Integrated Model , 2002, Decis. Sci..

[70]  Barbara S. Chaparro,et al.  Eye Movement Patterns on Single and Dual-Column Web Pages , 2008 .

[71]  Monideepa Tarafdar,et al.  The Consequences of Technostress for End Users in Organizations: Conceptual Development and Empirical Validation , 2008, Inf. Syst. Res..

[72]  C. Schewe The Management Information System User: An Exploratory Behavioral Analysis , 1976 .

[73]  KangNeung Eun,et al.  Age- and experience-related user behavior differences in the use of complicated electronic devices , 2008 .

[74]  Detmar W. Straub,et al.  Reconceptualizing System Usage: An Approach and Empirical Test , 2006, Inf. Syst. Res..

[75]  Viswanath Venkatesh,et al.  Consumer Acceptance and Use of Information Technology: Extending the Unified Theory of Acceptance and Use of Technology , 2012, MIS Q..

[76]  Milena M. Head,et al.  Exploring human images in website design: a multi-method approach , 2009 .

[77]  P. Costa,et al.  Revised NEO Personality Inventory (NEO-PI-R) and NEO-Five-Factor Inventory (NEO-FFI) , 1992 .

[78]  I. Ajzen The theory of planned behavior , 1991 .

[79]  Fred D. Davis,et al.  A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies , 2000, Management Science.

[80]  Naresh K. Malhotra,et al.  A Longitudinal Model of Continued IS Use: An Integrative View of Four Mechanisms Underlying Postadoption Phenomena , 2005, Manag. Sci..

[81]  Erik D. Reichle,et al.  Toward a model of eye movement control in reading. , 1998, Psychological review.