Are MIS research instruments stable? An exploratory reconsideration of the computer playfulness scale

Computer systems have changed significantly in the past decades and this means that MIS research instruments developed when surveying users of legacy systems could be out-of-date. However, these instruments are often considered stable. We undertook an empirical exploratory investigation of the unidimensionality of the computer playfulness scale because several academics had reported inconsistent item loadings that they could not explain. As a result of our investigation, we concluded that the original computer playfulness construct consists of two correlated but distinct factors when administered to today's IS users. Negatively worded items had no impact on the properties of the scale. Temporal structural stability was hypothesized as an explanation of the observed shift in this construct's psychometric properties.

[1]  P. M. Podsakoff,et al.  Self-Reports in Organizational Research: Problems and Prospects , 1986 .

[2]  Denise Potosky,et al.  A field study of computer efficacy beliefs as an outcome of training: the role of computer playfulness, computer knowledge, and performance during training , 2002, Comput. Hum. Behav..

[3]  Joel Kupfersmid,et al.  Improving What Is Published A Model in Search of an Editor , 2001 .

[4]  Nick Bontis,et al.  End-user adoption of animated interface agentsin everyday work applications , 2007, Behav. Inf. Technol..

[5]  Nick Bontis,et al.  User acceptance of wireless short messaging services: Deconstructing perceived value , 2007, Inf. Manag..

[6]  A. Caspi,et al.  Personality continuity and change across the life course. , 1990 .

[7]  J. Conley,et al.  The hierarchy of consistency: A review and model of longitudinal findings on adult individual differences in intelligence, personality and self-opinion , 1984 .

[8]  David Sohn,et al.  Significance testing and the science. , 2000 .

[9]  R. Bagozzi.  A Prospectus for Theory Construction in Marketing , 1984 .

[10]  Trevor Hastie,et al.  Statistical Models in S , 1991 .

[11]  Alexander Serenko,et al.  A model of user adoption of interface agents for email notification , 2008, Interact. Comput..

[12]  Viswanath Venkatesh,et al.  Determinants of Perceived Ease of Use: Integrating Control, Intrinsic Motivation, and Emotion into the Technology Acceptance Model , 2000, Inf. Syst. Res..

[13]  Leon A. Kappelman,et al.  Microcomputer playfulness: stable or dynamic trait? , 1997, DATB.

[14]  Joseph J. Martocchio,et al.  Microcomputer playfulness: development of a measure with workplace implications , 1992 .

[15]  George W. Bohrnstedt,et al.  An empirical study of the reliability and stability of survey research items , 1987 .

[16]  Steven L. Alter.  18 Reasons Why IT-Reliant Work Systems Should Replace "The IT Artifact" as the Core Subject Matter of the IS Field , 2003, Commun. Assoc. Inf. Syst..

[17]  Patrick Y. K. Chau.  On the use of construct reliability in MIS research: a meta-analysis , 1999, Inf. Manag..

[18]  R. Harvey,et al.  Confirmatory factor analysis of the Job Diagnostic Survey: Good news and bad news. , 1985 .

[19]  S. Weisberg.  Plots, transformations, and regression , 1985 .

[20]  Jaap J. Dijkstra,et al.  User agreement with incorrect expert system advice , 1999, Behav. Inf. Technol..

[21]  Jean E. Sammet,et al.  In recognition of the 25th anniversary of Computing Reviews: selected reviews 1960–1984 , 1985, CACM.

[22]  B. Muthén,et al.  Assessing Reliability and Stability in Panel Models , 1977 .

[23]  B. Roberts,et al.  The rank-order consistency of personality traits from childhood to old age: a quantitative review of longitudinal studies. , 2000, Psychological bulletin.

[24]  Ritu Agarwal,et al.  A Conceptual and Operational Definition of Personal Innovativeness in the Domain of Information Technology , 1998, Inf. Syst. Res..

[25]  Albert H. Segars,et al.  Exploring the theoretical foundations of playfulness in computer interactions , 2002, Comput. Hum. Behav..

[26]  David E. Wiley,et al.  The Estimation of Measurement Error in Panel Data , 1970 .

[27]  Gary Hackbarth,et al.  Computer playfulness and anxiety: positive and negative mediators of the system experience effect on perceived ease of use , 2003, Inf. Manag..

[28]  Christine T. Kydd,et al.  Individual characteristics associated with World Wide Web use: an empirical study of playfulness and motivation , 1997, DATB.

[29]  David Gefen,et al.  Assessing Unidimensionality Through LISREL: An Explanation and an Example , 2003, Commun. Assoc. Inf. Syst..

[30]  C. Barbaranelli,et al.  Factor analyses of the NEO-PI-R Inventory and the Comrey Personality Scales in Italy and the United States , 2001 .

[31]  A. Caspi,et al.  The Cumulative Continuity Model of Personality Development: Striking a Balance Between Continuity and Change in Personality Traits across the Life Course , 2003 .