Exploring the wiki user experience: The effects of training spaces on novice user usability and anxiety towards wiki editing

With the advent of Web 2.0, the number of IT systems used in university courses is growing. Yet research consistently shows that a significant proportion of students are anxious about computer use. The quality of first experience with computers has been consistently mentioned as a significant contributor to anxiety onset. However the effect of users' first experience on system related anxiety has not to the authors' knowledge been researched using controlled experiments. Indeed little experiment based research has been conducted on the wiki user experience, specifically users' evaluations and emotional reactions towards editing. This research uses usability engineering principles to engineer four different wiki experiences for novice wiki users and measures the effect each has on usability, anxiety during editing and on anxiety about future wiki editing. Each experience varied in the type of training spaces available before completing six live wiki editing tasks. We found that anxiety experienced by users was not related to computer anxiety but was wiki specific. Users in the in-built tutorial conditions also rated the usability of the editing interface higher than users in the non-tutorial conditions. The tutorial conditions also led to a significant reduction in wiki anxiety during interaction but did not significantly affect future editing anxiety. The findings suggest that the use of an in-built tutorial reduces emotional and technological barriers to wiki editing and that controlled experiments can help in discovering how aspects of the system experience can be designed to affect usability and anxiety towards editing wikis.

[1]  Kent L. Norman,et al.  Development of an instrument measuring user satisfaction of the human-computer interface , 1988, CHI '88.

[2]  Chien Chou,et al.  Incidences and correlates of Internet anxiety among high school teachers in Taiwan , 2003, Comput. Hum. Behav..

[3]  Martin Ebner,et al.  Why is Wikipedia so Successful? Experiences in Establishing the Principles in Higher Education , 2006 .

[4]  S. Mulaik,et al.  Single-sample tests for many correlations. , 1977 .

[5]  N. Kambouropoulos,et al.  Affect-regulated indirect effects of trait anxiety and trait resilience on self-esteem , 2006 .

[6]  Nancy L. Kocovski,et al.  State and trait anxiety revisited. , 2001, Journal of anxiety disorders.

[7]  Chien-Min Wang,et al.  Extending the wiki paradigm for use in the classroom , 2004, International Conference on Information Technology: Coding and Computing, 2004. Proceedings. ITCC 2004..

[8]  F. Deane,et al.  Development of a Short Form of the Test Anxiety Inventory (TAI) , 2002, The Journal of general psychology.

[9]  Jennifer Preece,et al.  Sociability and usability in online communities: Determining and measuring success , 2001, Behav. Inf. Technol..

[10]  John Todman,et al.  Effects of qualitative differences in initial and subsequent computer experience on computer anxiety , 2004, Comput. Hum. Behav..

[11]  Jos J. A. Van Berkum,et al.  TRAIT ANXIETY, DEFENSIVENESS, AND THE STRUCTURE OF WORRY , 1992 .

[12]  Martin Ebner,et al.  Wikis: Do They Need Usability Engineering? , 2006, USAB.

[13]  R. Heinssen,et al.  Assessing computer anxiety: Development and validation of the Computer Anxiety Rating Scale , 1987 .

[14]  Alan Durndell,et al.  Computer self efficacy, computer anxiety, attitudes towards the Internet and reported experience with the Internet, by gender, in an East European sample , 2002, Comput. Hum. Behav..

[15]  Sarah Guth,et al.  Wikis in education: is public better? , 2007, WikiSym '07.

[16]  T. Marteau,et al.  The development of a six-item short-form of the state scale of the Spielberger State-Trait Anxiety Inventory (STAI). , 1992, The British journal of clinical psychology.

[17]  Raafat George Saadé,et al.  Mediating the impact of technology usage on perceived ease of use by anxiety , 2007, Comput. Educ..

[18]  Mark Brosnan,et al.  Technophobia: The Psychological Impact of Information Technology , 1998 .

[19]  Sarah Diefenbach,et al.  Needs, affect, and interactive products - Facets of user experience , 2010, Interact. Comput..

[20]  Kevin R. Parker,et al.  Wiki as a Teaching Tool , 2007 .

[21]  James N. Anderson,et al.  On the role of metaphor and language in design of third party payments in eBanking: Usability and quality , 2006, Int. J. Hum. Comput. Stud..

[22]  James T. C. Teng,et al.  The Relationship of Information System Training Methods and Cognitive Ability to End-User Satisfaction, Comprehension, and Skill Transfer: A Longitudinal Field Study , 1996, Inf. Syst. Res..

[23]  Cynthia L. Turk,et al.  Empirical validation and psychometric evaluation of the Brief Fear of Negative Evaluation Scale in patients with social anxiety disorder. , 2005, Psychological assessment.

[24]  Jon M. Werner,et al.  Computer training through behavior modeling, self-paced, and instructional approaches : A field experiment , 1996 .

[25]  Marc Hassenzahl,et al.  User experience - a research agenda , 2006, Behav. Inf. Technol..

[26]  Melissa E. O'Neill.  Automated use of a Wiki for collaborative lecture notes , 2005 .

[27]  Viswanath Venkatesh,et al.  Determinants of Perceived Ease of Use: Integrating Control, Intrinsic Motivation, and Emotion into the Technology Acceptance Model , 2000, Inf. Syst. Res..

[28]  Mark J. Brosnan,et al.  Does computer anxiety reach levels which conform to DSM IV criteria for specific phobia? , 2007, Comput. Hum. Behav..

[29]  David McIlroy,et al.  Computer phobia and computer self-efficacy: their association with undergraduates' use of university computer facilities , 2007, Comput. Hum. Behav..

[30]  Benjamin R. Cowan,et al.  Exploring the effects of experience on wiki anxiety and wiki usability: an online study , 2009 .

[31]  K. Power,et al.  The relationship between trait vulnerability and anxiety and depressive diagnoses at long-term follow-up of Generalized Anxiety Disorder. , 2004, Journal of anxiety disorders.

[32]  Mary Corbett,et al.  SUMI: the Software Usability Measurement Inventory , 1993, Br. J. Educ. Technol..

[33]  Chao-Min Chiu,et al.  Understanding e-learning continuance intention: An extension of the Technology Acceptance Model , 2006, Int. J. Hum. Comput. Stud..

[34]  J. Sobral,et al.  Predictors of Anxiety towards Computers. , 1991 .

[35]  Tim Leso,et al.  Computer Anxiety and Different Types of Computer Courses , 1992 .

[36]  Benjamin R. Cowan,et al.  Exploring the relationship between anxiety and usability evaluation - an online study of Internet and wiki anxiety , 2008 .

[37]  Robert P. Bostrom,et al.  Training End Users: An Experimental Investigation of the Roles of the Computer Interface and Training Methods , 1993, MIS Q..

[38]  Martin Ebner,et al.  Utilizing Wiki-Systems in higher education classes: a chance for universal access? , 2008, Universal Access in the Information Society.

[39]  Kevin Tierney,et al.  The relation of gender and background experience to self-reported computing anxieties and cognitions , 2001, Comput. Hum. Behav..

[40]  Alan J. Dix,et al.  Human-computer interaction: A stable discipline, a nascent science, and the growth of the long tail , 2010, Interact. Comput..

[41]  Melissa Cole,et al.  Using Wiki technology to support student engagement: Lessons from the trenches , 2009, Comput. Educ..

[42]  A. Deacon,et al.  Weathering wikis: Net-based learning meets political science in a South African university , 2007 .

[43]  Laurie E. Damianos,et al.  Factors impeding Wiki use in the enterprise: a case study , 2010, CHI Extended Abstracts.

[44]  Bob Goodwin-Jones,et al.  Blogs and Wikis: Environments for On-Line Collaboration. , 2003 .

[45]  Mark J. Brosnan,et al.  The relationship between Internet identification, Internet anxiety and Internet use , 2007, Comput. Hum. Behav..

[46]  C. Spielberger,et al.  Manual for the State-Trait Anxiety Inventory , 1970 .

[47]  Jennifer Preece,et al.  The top five reasons for lurking: improving community experiences for everyone , 2004, Comput. Hum. Behav..

[48]  Mervyn A. Jack,et al.  A usability comparison of three alternative message formats for an SMS banking service , 2008, Int. J. Hum. Comput. Stud..

[49]  Gholamreza Torkzadeh,et al.  A path analytic study of determinants of information system usage , 1994 .

[50]  John M. Carroll,et al.  Exploring Exploring a Word Processor , 1985, Hum. Comput. Interact..

[51]  Jelte M. Wicherts,et al.  Computer Anxiety: "Trait" or "State"? , 2007, Comput. Hum. Behav..

[52]  Susan Wiedenbeck,et al.  The effect of interaction style and training method on end user learning of software packages , 1998, Interact. Comput..

[53]  Wayne G. Lutters,et al.  Wiki anxiety: impediments to implementing wikis for IT support groups , 2009, CHIMIT.

[54]  Angela F. L. Wong,et al.  Computer anxiety and its correlates : a meta-analysis , 1999 .

[55]  Larry D. Rosen,et al.  The etiology of computerphobia , 1990 .

[56]  E. Wood,et al.  Developing a Computer Workshop To Facilitate Computer Skills and Minimize Anxiety for Early Childhood Educators , 2002 .

[57]  J. Todman,et al.  Qualitative differences in computer experience, computer anxiety, and students' use of computers: A path model , 1994 .

[58]  Paul Kline,et al.  A Psychometrics Primer , 2000 .

[59]  Amy Bruckman,et al.  Constructing text:: Wiki as a toolkit for (collaborative?) learning , 2007, WikiSym '07.

[60]  Virpi Roto,et al.  Understanding, scoping and defining user experience: a survey approach , 2009, CHI.

[61]  Wanlei Zhou,et al.  Teaching and learning online with wikis , 2004 .

[62]  Yoram M. Kalman,et al.  Wikibooks in higher education: Empowerment through online distributed collaboration , 2008, Comput. Hum. Behav..

[63]  Paul van Schaik,et al.  Modelling user experience - An agenda for research and practice , 2010, Interact. Comput..

[64]  Peter Caputi,et al.  Cognitive interference model of computer anxiety: Implications for computer-based assessment , 2007, Comput. Hum. Behav..