Experience effects on the accuracy of self-assessed user competence

Self-managed learning is the normal way that users learn to work with software within organizations. To be effective, self-managed, learning requires individuals to self-assess their IT knowledge; accurate self-assessment helps them optimize the capabilities they possess and be aware of those they do not. This study demonstrated that, in general, individuals did not accurately self-assess their knowledge of the software they used. However, we also found that the accuracy of self-assessment increased with greater experience in, and better understanding of, IT domains.Organizations need to recognize the self-assessment problem to facilitate effective software learning and to gain the most from their software investments.

[1]  R. Ryan Nelson,et al.  Educational Needs as Perceived by IS and End-User Personnel: A Survey of Knowledge and Skill Requirements , 1991, MIS Q..

[2]  J. Kruger,et al.  Unskilled and unaware of it: how difficulties in recognizing one's own incompetence lead to inflated self-assessments. , 1999, Journal of personality and social psychology.

[3]  Michael J. Renner,et al.  But I thought I knew that: using confidence estimation as a debiasing technique to improve classroom performance , 2001 .

[4]  R. Bagozzi.  A Prospectus for Theory Construction in Marketing , 1984 .

[5]  Arnold Reisman,et al.  On alternative strategies for doing research in the management and social sciences , 1988 .

[6]  Edgar Erdfelder,et al.  GPOWER: A general power analysis program , 1996 .

[7]  Timothy D. Wilson,et al.  Telling more than we can know: Verbal reports on mental processes. , 1977 .

[8]  Fred D. Davis,et al.  Developing and Validating an Observational Learning Model of Computer Software Training and Skill Acquisition , 2003, Inf. Syst. Res..

[9]  Viswanath Venkatesh,et al.  Determinants of Perceived Ease of Use: Integrating Control, Intrinsic Motivation, and Emotion into the Technology Acceptance Model , 2000, Inf. Syst. Res..

[10]  Detmar W. Straub,et al.  Information Technology Adoption Across Time: A Cross-Sectional Comparison of Pre-Adoption and Post-Adoption Beliefs , 1999, MIS Q..

[11]  R. Ryan Nelson,et al.  The assessment of end-user training needs , 1995, CACM.

[12]  Fred D. Davis,et al.  A Model of the Antecedents of Perceived Ease of Use: Development and Test† , 1996 .

[13]  Peter K. Mills,et al.  Self-Management: Its Control and Relationship to Other Organizational Properties , 1983 .

[14]  Chaelynne M. Wolak.  Assessing User Competence: Conceptualization and Measurement , 2000 .

[15]  D. Brillinger,et al.  Multivariate Procedures for the Behavioral Sciences. , 1964 .

[16]  Lorne Olfman,et al.  End-user training and learning , 1995, CACM.

[17]  Jane M. Howell,et al.  Influence of Experience on Personal Computer Utilization: Testing a Conceptual Model , 1994, J. Manag. Inf. Syst..

[18]  Jungwoo Lee,et al.  Measures of perceived end-user computing skills , 2003, Inf. Manag..

[19]  Delroy L. Paulhus,et al.  Enhancement and Denial in Socially Desirable Responding , 1991 .

[20]  Jane Webster,et al.  Computer-assisted versus paper-and-pencil administration of questionnaires , 1996 .

[21]  Patty Winter,et al.  Microsoft Office 97 User Manual , 1998 .

[22]  Peter A. Todd,et al.  Understanding Information Technology Usage: A Test of Competing Models , 1995, Inf. Syst. Res..

[23]  W. Hays.  Experimental Design: Procedures for the Behavioral Sciences. 2nd ed. , 1983 .

[24]  A. Bandura.  Social Foundations of Thought and Action: A Social Cognitive Theory , 1985 .

[25]  D. Marlowe,et al.  A new scale of social desirability independent of psychopathology. , 1960, Journal of consulting psychology.

[26]  Gary Hackbarth,et al.  Computer playfulness and anxiety: positive and negative mediators of the system experience effect on perceived ease of use , 2003, Inf. Manag..

[27]  R. Kirk.  Experimental Design: Procedures for the Behavioral Sciences , 1970 .

[28]  J. Edwards.  Ten Difference Score Myths , 2001 .

[29]  Gary P. Latham,et al.  Application of social learning theory to employee self-management of attendance , 1987 .

[30]  Jane Webster,et al.  Desktop Videoconferencing: Experiences of Complete Users, Wary Users, and Non-Users , 1998, MIS Q..

[31]  R. Fisher.  The future of social‐desirability bias research in marketing , 2000 .

[32]  K. Weick.  The social psychology of organizing , 1969 .

[33]  Malcolm Munro,et al.  Understanding and measuring user competence , 1997, Inf. Manag..

[34]  J. W. Hutchinson,et al.  Knowledge Calibration: What Consumers Know and What They Think They Know , 2000 .

[35]  Jane M. Mackay,et al.  Training needs of novices and experts with referent experience and task domain knowledge , 1991, Inf. Manag..

[36]  E. Salas,et al.  Application of cognitive, skill-based, and affective theories of learning outcomes to new methods of training evaluation. , 1993 .

[37]  L. Bambara,et al.  Issues surrounding the use of self-management interventions in the schools. , 1992 .

[38]  Lorne Olfman,et al.  End-User Training and Learning - Introduction to the Special Section. , 1995 .

[39]  W. Reynolds.  Development of reliable and valid short forms of the marlowe-crowne social desirability scale , 1982 .

[40]  Fred D. Davis,et al.  A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies , 2000, Management Science.

[41]  E. A. Locke,et al.  Work Motivation and Satisfaction: Light at the End of the Tunnel , 1990 .

[42]  H. Markus.  Self-schemata and processing information about the self. , 1977 .

[43]  Jane Webster,et al.  Desktop Videoconferencing: Experiences of Complete Users, , 1998 .

[44]  John R. Anderson.  Acquisition of cognitive skill. , 1982 .

[45]  J. Kruger.  Lake Wobegon be gone! The "below-average effect" and the egocentric nature of comparative ability judgments. , 1999, Journal of personality and social psychology.

[46]  Bernadette Szajna,et al.  Empirical evaluation of the revised technology acceptance model , 1996 .

[47]  R. Fisher.  Social Desirability Bias and the Validity of Indirect Questioning , 1993 .

[48]  John R. Anderson,et al.  Rules of the Mind , 1993 .

[49]  Frank J. Sinkavich.  Performance and metamemory: Do students know what they don't know? , 1995 .