Computer usage and the validity of self-assessed computer competence among first-year business students

This study evaluates the reliability of self-assessment as a measure of computer competence. This evaluation is carried out in response to recent research which has employed self-reported ratings as the sole indicator of students' computer competence. To evaluate the reliability of self-assessed computer competence, the scores achieved by students in self-assessed computer competence tests are compared with scores achieved in objective tests. The results reveal a statistically significantly over-estimation of computer competence among the students surveyed. Furthermore, reported pre-university computer experience in terms of home and school use and formal IT education does not affect this result. The findings call into question the validity of using self-assessment as a measure of computer competence. More generally, the study also provides an up-to-date picture of self-reported computer usage and IT experience among pre-university students from New Zealand and South-east Asia and contrasts these findings with those from previous research.

[1]  Roberta M. Roth,et al.  Computer Self-Efficacy: A Practical Indicator of Student Computer Competency in Introductory IS Courses , 1998, Informing Sci. Int. J. an Emerg. Transdiscipl..

[2]  Joan Ballantine,et al.  Evaluating the validity of self-assessment: measuring computer literacy among entry-level undergraduates within accounting degree programmes at two UK universities , 2003 .

[3]  Susan Harris,et al.  Secondary school students' use of computers at home , 1999, Br. J. Educ. Technol..

[4]  Shazia Mumtaz,et al.  Children's enjoyment and perception of computer use in the home and the school , 2001, Comput. Educ..

[5]  Linda B. Shoffner.  The Effects of Home Environment on Achievement and Attitudes toward Computer Literacy. , 1990 .

[6]  David Buckingham.  Superhighway or Road to Nowhere? Children’s Relationships with Digital Technology , 1999 .

[7]  I. M. Jawahar,et al.  Attitudes, self-monitoring, and appraisal behaviors. , 2001 .

[8]  Phyllis Schumacher,et al.  Gender, Internet and computer attitudes and experiences , 2001, Comput. Hum. Behav..

[9]  S. Papert.  The children's machine: rethinking school in the age of the computer , 1993 .

[10]  Lin Norton,et al.  Self-Assessment in Coursework Essays. , 1997 .

[11]  Keith Sullivan,et al.  Introducing Students to Self‐assessment , 1997 .

[12]  Erno Lehtinen,et al.  Students' skills and practices of using ICT: results of a national assessment in Finland , 2000, Comput. Educ..

[13]  Johan van Braak,et al.  Domains and determinants of university students' self-perceived computer competence , 2004, Comput. Educ..

[14]  P. A. Curtis.  Measuring Computer Literacy in Colleges of Agriculture: Results, Conclusions and Implications. , 1986 .

[15]  Greg Stoner.  IT is part of youth culture, but are accounting undergraduates confident in IT? , 1999 .

[16]  Graham Mowl,et al.  Using Self and Peer Assessment to Improve Students’ Essay Writing: a Case Study from Geography , 1995 .

[17]  E. Beck,et al.  Computing: an ideal occupation for women? , 1993 .

[18]  Mrudula Patri,et al.  The influence of peer feedback on self- and peer-assessment of oral skills , 2002 .

[19]  W. Littlewood.  Defining and developing autonomy in East Asian contexts , 1999 .

[20]  Willem J. Pelgrum,et al.  Obstacles to the integration of ICT in education: results from a worldwide educational assessment , 2001, Comput. Educ..

[21]  Neil Selwyn,et al.  The effect of using a home computer on students' educational use of IT , 1998, Comput. Educ..

[22]  Els Kuiper,et al.  New technologies, new differences. Gender and ethnic differences in pupils' use of ICT in primary and secondary education , 2005, Comput. Educ..

[23]  Stephen Hibberd.  The mathematical assessment of students entering university engineering courses , 1996 .

[24]  Susan Tyler Eastman,et al.  Homes More High Tech than Schools , 1997 .

[25]  Shaul Fox,et al.  VALIDITY OF SELF‐ASSESSMENT: A FIELD EVALUATION , 1988 .

[26]  Gillian M Eadie,et al.  The Impact of ICT on Schools: Classroom Design and Curriculum Delivery , 2001 .

[27]  Ian Moffatt,et al.  The use of computing in Scottish schools: a preliminary survey , 1995 .

[28]  Joanna Bull,et al.  Assessing student learning in higher education , 1997 .

[29]  Ronald H. Mueller.  Is Self-Grading the Answer? , 1970 .

[30]  S. Siegel,et al.  Nonparametric Statistics for the Behavioral Sciences , 2022, The SAGE Encyclopedia of Research Design.

[31]  Goutam Chakraborty,et al.  The measurement of computer literacy: a comparison of self-appraisal and objective tests , 1994, Int. J. Hum. Comput. Stud..

[32]  H. E. Stanton,et al.  Self-Grading as an Assessment Method. , 1978 .

[33]  Yao-Ting Sung,et al.  The design and application of a web-based self- and peer-assessment system , 2005, Comput. Educ..

[34]  Elisheva F. Gross,et al.  The impact of computer use on children's and adolescents' development , 2001, Journal of Applied Developmental Psychology.

[35]  Toni Downes.  The computer as a toy and tool in the home: implications for schools and teachers , 2006, Education and Information Technologies.

[36]  D. Boud,et al.  Quantitative studies of student self-assessment in higher education: a critical analysis of findings , 1989 .

[37]  Stephen Merry,et al.  A Study in Self‐assessment: tutor and students’ perceptions of performance criteria , 1997 .

[38]  Patricia McCourt Larres,et al.  A critical analysis of students' perceptions of the usefulness of the case study method in an advanced management accounting module: the impact of relevant work experience , 2004 .

[39]  A. Durndell,et al.  Gender and computing: a decade of change? , 1997 .

[40]  C D Stephens,et al.  A survey of the IT skills and attitudes of final year dental students at Bristol University in 1996 and 1997. , 1999, European journal of dental education : official journal of the Association for Dental Education in Europe.

[41]  湯淺 太一,et al.  20世紀の名著名論:Seymour Papert: Mindstorms:Children Computers and Powerful Ideas Basic Books New York 1980 , 2005 .

[42]  T. Busch,et al.  Gender, Group Composition, Cooperation, and Self-Efficacy in Computer Studies , 1996 .

[43]  L. Stefani.  Peer, self and tutor assessment: Relative reliabilities , 1994 .

[44]  Jean Underwood,et al.  Predicting Computer Literacy: How Do the Technological Experiences of Schoolchildren Predict Their Computer-Based Problem-Solving Skills? , 1994 .

[45]  Tamar Levine,et al.  Computer Experience, Gender, and Classroom Environment in Computer-Supported Writing Classes , 1995 .

[46]  Seymour Papert,et al.  Mindstorms: Children, Computers, and Powerful Ideas , 1981 .

[47]  Toni Downes,et al.  Playing with Computing Technologies in the Home , 1999, Education and Information Technologies.

[48]  M I Nurjahan,et al.  Computer literacy in medical students , 2000, Medical education.

[49]  D. Sluijsmans,et al.  The use of self-, peer and co-assessment in higher education: A review , 1999 .

[50]  A. Colley,et al.  The effects of age, gender and computer experience upon computer attitudes , 1997 .

[51]  Tjeerd Plomp,et al.  Information technology and gender equality: A contradiction in terminis? , 1997, Comput. Educ..

[52]  Niki Davis,et al.  Primary teachers' competence with IT in the National Curriculum , 1990, Br. J. Educ. Technol..