The Dunning-Kruger Effect in a workplace computing setting

This study investigated the Dunning-Kruger Effect in the domain of workplace computing. The Dunning-Kruger Effect is present in situations where people with lower levels of skill or knowledge in a domain do not recognise their actual level of skill. Participants in this study were asked to make an estimate of the size of the domain of end-user computing as it relates to the greater domain of computing as a whole. It should be noted, that although end-user computing is present in many situations, on the whole its undefined nature is unappreciated by many users. A measure of perception was used as a way of investigating if people, who appreciate the extent of a domain, will be more conservative in their estimations of it, their knowledge in it and that same knowledge of an average person or peer. Results indicate that the Dunning-Kruger Effect is present in workplace end-user computing in situations where self-assessments are based on what a person believes there is to know in a domain. However, this effect was not present in situations where participants made estimations of the knowledge of workplace end-user computing of an average end-user. In this case, these estimations appeared to be based on what a person believed they knew not what they believed there was to know. Technology is advancing at a fast rate and end-user computing applications are not immune to this change. This study is important as it highlights a domain, which, due to its fast-changing nature, is near impossible to define but one that is critical to modern workplaces. The study shows that neither employers nor employees currently enough of an appreciation of a domain to understand its extent and how misinterpreting skill level can pose challenges to both groups. The DKE occurs when a self-report is based on what a person thinks there is to know.The domain of workplace computing is fast-changing and difficult to define.The workplace computing is a domain where observations of others are hard to make.The VAS is a novel way to measure perception in a difficult to define domain.Estimations of the knowledge of peers are based on what a person thinks they know.

[1]  Diane M. Holtzman,et al.  Skills Required of Business Graduates: Evidence from Undergraduate Alumni and Employers , 2010 .

[2]  Shirley Gibbs,et al.  The Computing Skills expected of Business Graduates: A New Zealand Study , 2009, AMCIS.

[3]  G. Stoner.  Accounting Students' IT Application Skills over a 10-year Period , 2009 .

[4]  Stephen G. Powell,et al.  A comparison of spreadsheet users with different levels of experience , 2009 .

[5]  Fiona Fui-Hoon Nah,et al.  Information Systems User Competency: A Conceptual Foundation , 2014, Commun. Assoc. Inf. Syst..

[6]  Stephen G. Powell,et al.  A critical review of the literature on spreadsheet errors , 2008, Decis. Support Syst..

[7]  Melissa R. Gross,et al.  What's skill got to do with it?: Information literacy skills and self-views of ability among first-year college students , 2012, J. Assoc. Inf. Sci. Technol..

[8]  Raymond R. Panko,et al.  The Cognitive Science of Spreadsheet Errors: Why Thinking is Bad , 2013, 2013 46th Hawaii International Conference on System Sciences.

[9]  Jonathon D. Brown,et al.  Understanding the Better Than Average Effect , 2012, Personality & social psychology bulletin.

[10]  Chui Young Yoon,et al.  Measures of perceived end-user computing competency in an organizational computing environment , 2009, Knowl. Based Syst..

[11]  Sui Huang,et al.  When peers are not peers and don't know it: The Dunning‐Kruger effect and self‐fulfilling prophecy in peer‐review , 2013, BioEssays : news and reviews in molecular, cellular and developmental biology.

[12]  Dawn M. Marsh-Richard,et al.  Adaptive Visual Analog Scales (AVAS): A modifiable software program for the creation, administration, and scoring of visual analog scales , 2009, Behavior research methods.

[13]  Roger Tourangeau,et al.  Evaluating the Effectiveness of Visual Analog Scales , 2006 .

[14]  Sandra Barker,et al.  Developers, Decision Makers, Strategists or Just End-users? Redefining End-User Computing for the 21st Century: A Case Study , 2011, J. Organ. End User Comput..

[15]  Deborah Compeau,et al.  Experience effects on the accuracy of self-assessed user competence , 2006, Inf. Manag..

[16]  Stephen G. Powell,et al.  Comparison of Characteristics and Practices amongst Spreadsheet Users with Different Levels of Experience , 2008, ArXiv.

[17]  Benjamin T. Hazen,et al.  Technical proficiency for IS Success , 2014, Comput. Hum. Behav..

[18]  Michael F. Robertson,et al.  The Dunning-Kruger Effect and SIUC University's Aviation Students , 2012 .

[19]  D. Dunning,et al.  Faulty Self-Assessment: Why Evaluating One's Own Competence Is an Intrinsically Difficult Task , 2008 .

[20]  J. Gerich,et al.  Visual analogue scales for mode-independent measurement in self-administered questionnaires , 2007, Behavior research methods.

[21]  J. Kruger,et al.  Unskilled and unaware of it: how difficulties in recognizing one's own incompetence lead to inflated self-assessments. , 1999, Journal of personality and social psychology.

[22]  Ali Azadeh,et al.  Assessing the impact of the information technology on organisational systems: a power holding company , 2015, Int. J. Bus. Inf. Syst..

[23]  Meg Murray,et al.  INFORMATION TECHNOLOGY LITERACY IN THE WORKPLACE: A PRELIMINARY INVESTIGATION , 2007 .

[24]  David Dunning,et al.  How unaware are the unskilled? Empirical tests of the “signal extraction” counterexplanation for the Dunning–Kruger effect in self-evaluation of performance , 2013 .

[25]  David Dunning,et al.  What you don't know : The role played by errors of omission in imperfect self-assessments , 2005 .

[26]  Marianne C. Murphy,et al.  A Comparison of Student Perceptions of their Computer Skills to their Actual Abilities , 2009, J. Inf. Technol. Educ..

[27]  Kerri L. Johnson,et al.  Why the Unskilled are Unaware: Further Explorations of (Absent) Self-Insight Among the Incompetent , 2006, Organizational behavior and human decision processes.

[28]  David Parkin,et al.  Is there a case for using visual analogue scale valuations in cost-utility analysis? , 2006, Health economics.