Measuring Anxiety Towards Wiki Editing: Investigating the Dimensionality of the Wiki Anxiety Inventory-Editing

General rights Copyright for the publications made accessible via the Edinburgh Research Explorer is retained by the author(s) and / or other copyright owners and it is a condition of accessing these publications that users recognise and abide by the legal requirements associated with these rights. Take down policy The University of Edinburgh has made every reasonable effort to ensure that Edinburgh Research Explorer content complies with UK legislation. If you believe that the public display of this file breaches copyright please contact openaccess@ed.ac.uk providing details, and we will remove access to the work immediately and investigate your claim. Although wikis are common in both the workplace and in Higher Education, little research has studied the wiki user experience. Recent literature highlights that users may be anxious about editing wiki content; yet in most of this research this anxiety has not been measured quantitatively. Although computer anxiety metrics exist to measure anxiety towards technology, they lack specificity and relevance to the wiki editing context. This paper reports two studies used to research the validity and reliability of the wiki anxiety inventory-editing (WAI-E), an inventory developed and used to measure anxiety in wiki editing (Study 1) and to explore the factor structure of the WAI-E and the validity and reliability of the resulting subscales (Study 2). Study 1 shows that the WAI-E, when used as a uni-dimensional structure, shows high reliability and validity. The principal component analysis conducted in Study 2 showed that the measure converged on a three-factor solution with factors measuring positive affect, editability anxiety and contribution judgement anxiety. The subscales showed high reliability and validity. It therefore seems that although the validity and reliability of using the WAI-E as a uni-dimensional construct are high, the use of the metric as such hides the true structure and nuances of the concept of wiki anxiety. RESEARCH HIGHLIGHTS • The paper presents a self-report inventory (wiki anxiety inventory-editing, WAI-E) to measure anxiety in wiki editing. • The uni-dimensional WAI-E has good reliability and validity. • Principal component analysis (PCA) highlights three factors: positive affect, editability anxiety and contribution judgement anxiety. • These factors also show high reliability and validity. • PCA shows that use of uni-dimensional WAI-E masks strong factor structure of WAI-E. The benefits of using wikis as collaborative tools for knowledge sharing and co-creation such as their facilitation of democratic knowledge construction (Glaser, 2004), their dynamic nature leading to …

[1]  Henk G. Schmidt,et al.  Computer experience and computer anxiety , 2003, Comput. Hum. Behav..

[2]  Viswanath Venkatesh,et al.  Determinants of Perceived Ease of Use: Integrating Control, Intrinsic Motivation, and Emotion into the Technology Acceptance Model , 2000, Inf. Syst. Res..

[3]  Amy Bruckman,et al.  Becoming Wikipedian: transformation of participation in a collaborative online encyclopedia , 2005, GROUP.

[4]  Laurie E. Damianos,et al.  Factors impeding Wiki use in the enterprise: a case study , 2010, CHI Extended Abstracts.

[5]  Cynthia L. Turk,et al.  Empirical validation and psychometric evaluation of the Brief Fear of Negative Evaluation Scale in patients with social anxiety disorder. , 2005, Psychological assessment.

[6]  Jason Bennett Thatcher,et al.  Internet anxiety: An empirical study of the effects of personality, beliefs, and social support , 2007, Inf. Manag..

[7]  Mark J. Brosnan,et al.  The relationship between Internet identification, Internet anxiety and Internet use , 2007, Comput. Hum. Behav..

[8]  L. J. Williams,et al.  Exploratory and confirmatory factor analysis: guidelines, issues, and alternatives , 1997 .

[9]  Eleni Stroulia,et al.  Recognizing contributions in wikis: Authorship categories, algorithms, and visualizations , 2010 .

[10]  Andrew S. Chirwa,et al.  Computer Attitude Scale , 1992 .

[11]  Wanda J. Orlikowski,et al.  Learning from Notes: organizational issues in groupware implementation , 1992, CSCW '92.

[12]  C. Spielberger,et al.  Manual for the State-Trait Anxiety Inventory , 1970 .

[13]  Han Zhang,et al.  Anxious or Angry? Effects of Discrete Emotions on the Perceived Helpfulness of Online Reviews , 2014, MIS Q..

[14]  Fawei Geng,et al.  Researching the use of Wiki's to facilitate group work , 2009 .

[15]  Eleni Stroulia,et al.  Recognizing contributions in wikis: Authorship categories, algorithms, and visualizations , 2009, J. Assoc. Inf. Sci. Technol..

[16]  Richard Giordano,et al.  An investigation of the use of a wiki to support knowledge exchange in public health , 2007, GROUP.

[17]  Benjamin R. Cowan,et al.  The impact of identity on anxiety during wiki editing in higher education , 2014, J. Enterp. Inf. Manag..

[18]  D. Dozois,et al.  The validity of the brief version of the Fear of Negative Evaluation Scale. , 2004, Journal of anxiety disorders.

[19]  Meredith Ringel Morris,et al.  What do people ask their social networks, and why?: a survey study of status message q&a behavior , 2010, CHI.

[20]  R. Heinssen,et al.  Assessing computer anxiety: Development and validation of the Computer Anxiety Rating Scale , 1987 .

[21]  Ole Smørdal,et al.  Is there a space for the teacher in a WIKI? , 2006, WikiSym '06.

[22]  Benjamin R. Cowan,et al.  Exploring the wiki user experience: The effects of training spaces on novice user usability and anxiety towards wiki editing , 2011, Interact. Comput..

[23]  Jelte M. Wicherts,et al.  Computer Anxiety: "Trait" or "State"? , 2007, Comput. Hum. Behav..

[24]  Martin Wattenberg,et al.  Studying cooperation and conflict between authors with history flow visualizations , 2004, CHI.

[25]  J. Sobral,et al.  Predictors of Anxiety towards Computers. , 1991 .

[26]  Jonathan Grudin,et al.  Why CSCW applications fail: problems in the design and evaluationof organizational interfaces , 1988, CSCW '88.

[27]  Tim Leso,et al.  Computer Anxiety and Different Types of Computer Courses , 1992 .

[28]  Peter Caputi,et al.  Cognitive interference in computer anxiety , 2001, Behav. Inf. Technol..

[29]  Mark Guzdial,et al.  Beyond Adoption to Invention: Teacher-Created Collaborative Activities in Higher Education , 2001 .

[30]  X. Liu.  Online posting anxiety: impacts on blogging , 2010 .

[31]  C. Spielberger,et al.  Manual for the state-trait anxiety inventory (form Y) : "self-evaluation questionnaire" , 1983 .

[32]  Henk G. Schmidt,et al.  The influence of computer anxiety on experienced computer users while performing complex computer tasks , 2006, Comput. Hum. Behav..

[33]  Eric A Storch,et al.  The psychometric properties of the Brief Fear of Negative Evaluation Scale. , 2006, Journal of anxiety disorders.

[34]  Paul Kline,et al.  A Psychometrics Primer , 2000 .

[35]  Peter Caputi,et al.  Cognitive interference model of computer anxiety: Implications for computer-based assessment , 2007, Comput. Hum. Behav..

[36]  Kate J. Garland,et al.  Computer attitude scales: How relevant today , 2008, Comput. Hum. Behav..

[37]  Nancy L. Kocovski,et al.  State and trait anxiety revisited. , 2001, Journal of anxiety disorders.

[38]  Susan F. Ehrlich,et al.  Strategies for encouraging successful adoption of office communication systems , 1987, TOIS.

[39]  Mark Brosnan,et al.  Technophobia: The Psychological Impact of Information Technology , 1998 .

[40]  Wanlei Zhou,et al.  Security in the online e-learning environment , 2005, Fifth IEEE International Conference on Advanced Learning Technologies (ICALT'05).

[41]  F. Bryant,et al.  Principal-components analysis and exploratory and confirmatory factor analysis. , 1995 .

[42]  Benjamin R. Cowan,et al.  Now You See it, Now You Don’t: The Effects of wiki Flexibility on Anxiety during wiki Editing , 2010 .

[43]  Elizabeth M. Weiss,et al.  Computer self-efficacy and anxiety scales for an Internet sample: testing measurement equivalence of existing measures and development of new scales , 2004, Comput. Hum. Behav..

[44]  R. Carleton,et al.  Brief Fear of Negative Evaluation scale—revised , 2006, Depression and anxiety.

[45]  Hee-Cheol Kim,et al.  Reviewing Practices in Collaborative Writing , 2001, Computer Supported Cooperative Work (CSCW).

[46]  David Kaufer,et al.  Issues in the design of computer support for co-authoring and commenting , 1990, CSCW '90.

[47]  T. Marteau,et al.  The development of a six-item short-form of the state scale of the Spielberger State-Trait Anxiety Inventory (STAI). , 1992, The British journal of clinical psychology.

[48]  Boi Faltings,et al.  Reporting incentives and biases in online review forums , 2010, TWEB.

[49]  Angela F. L. Wong,et al.  Computer anxiety and its correlates : a meta-analysis , 1999 .

[50]  Ho Cheung William Li,et al.  Do trait anxiety and age predict state anxiety of school-age children? , 2005, Journal of clinical nursing.

[51]  Chien-Min Wang,et al.  Extending the wiki paradigm for use in the classroom , 2004, International Conference on Information Technology: Coding and Computing, 2004. Proceedings. ITCC 2004..

[52]  F. Deane,et al.  Development of a Short Form of the Test Anxiety Inventory (TAI) , 2002, The Journal of general psychology.

[53]  Sébastien Paquet,et al.  Are wikis usable? , 2005, Int. Sym. Wikis.

[54]  David McIlroy,et al.  Computer phobia and computer self-efficacy: their association with undergraduates' use of university computer facilities , 2007, Comput. Hum. Behav..

[55]  Sarah Guth,et al.  Wikis in education: is public better? , 2007, WikiSym '07.

[56]  Christa Womser-Hacker,et al.  Integration of a Wiki for Collaborative Knowledge Development in an E-Learning Context for University Teaching , 2008, USAB.

[57]  Angelo Di Iorio,et al.  Constrained Wiki: an Oxymoron? , 2006, WikiSym '06.

[58]  Anja Ebersbach-Markus Glaser,et al.  Towards Emancipatory Use of a Medium: The Wiki , 2004 .

[59]  Wanlei Zhou,et al.  Teaching and learning online with wikis , 2004 .

[60]  Xun Liu.  Empirical Testing of a Theoretical Extension of the Technology Acceptance Model: An Exploratory Study of Educational Wikis , 2010 .

[61]  Yoram M. Kalman,et al.  Wikibooks in higher education: Empowerment through online distributed collaboration , 2008, Comput. Hum. Behav..

[62]  Clarice P. Gressard,et al.  The Effects of Sex, Age, and Computer Experience on Computer Attitudes. , 1984 .

[63]  Larry D. Rosen,et al.  The psychological impact of technology from a global perspective , 1995 .