Specification and Validation of a Formative Index to Evaluate the Ergonomic Quality of an AR-based Educational Platform

The ergonomic quality of educational systems is a key feature influencing both the usefulness and motivation for the learner. Desktop Augmented Reality (AR) systems are featuring specific interaction techniques that may create additional usability issues affecting the perceived ease of use. Measuring key usability aspects and understanding the causal relationships between them is a challenge that requires formative measurement models specification and validation. In this paper we present an evaluation instrument based on two main formative indexes that are capturing specific usability measures for two AR-based applications. The formative indexes are forming a second order formative construct that acts as predictor for both the general ease of use and ease of learning how to operate with the application.

[1]  Dwayne D. Gremler,et al.  Service value revisited: Specifying a higher-order, formative measure , 2008 .

[2]  Adamantios Diamantopoulos,et al.  The error term in formative measurement models: interpretation and modeling implications , 2006 .

[3]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[4]  Anne L. Souchon,et al.  The quality of market-oriented behaviors: Formative index construction , 2008 .

[5]  Lyn Pemberton,et al.  Remote Hands-On Experience: Distributed Collaboration with Augmented Reality , 2009, EC-TEL.

[6]  J. Wilcox,et al.  Questions about formative measurement , 2008 .

[7]  J. Edward Swan,et al.  Usability Engineering for Augmented Reality: Employing User-Based Studies to Inform Design , 2008, IEEE Transactions on Visualization and Computer Graphics.

[8]  R. Lennox,et al.  Conventional wisdom on measurement: A structural equation perspective. , 1991 .

[9]  H. Winklhofer,et al.  Index Construction with Formative Indicators: An Alternative to Scale Development , 2001 .

[10]  Manfred Bruhn,et al.  Customer equity management as formative second-order construct , 2008 .

[11]  Shu-Sheng Liaw,et al.  Investigating learners' attitudes toward virtual reality learning environments: Based on a constructivist approach , 2010, Comput. Educ..

[12]  Manfred Bogen,et al.  Spinnstube®: a seated augmented reality display system , 2007, EGVE'07.

[13]  Edward E. Rigdon,et al.  Proportional structural effects of formative indicators , 2008 .

[14]  Kasper Hornbæk,et al.  Current practice in measuring usability: Challenges to usability studies and research , 2006, Int. J. Hum. Comput. Stud..

[15]  R. Bagozzi,et al.  On the nature and direction of relationships between constructs and measures. , 2000, Psychological methods.

[16]  Cheryl Burke Jarvis,et al.  A Critical Review of Construct Indicators and Measurement Model Misspecification in Marketing and Consumer Research , 2003 .

[17]  James C. Anderson,et al.  STRUCTURAL EQUATION MODELING IN PRACTICE: A REVIEW AND RECOMMENDED TWO-STEP APPROACH , 1988 .

[18]  Alexandru Balog,et al.  The Role of Perceived Enjoyment in the Students’ Acceptance of an Augmented Reality Teaching Platform: a Structural Equation Modelling Approach , 2010 .

[19]  Rolph E. Anderson,et al.  Multivariate Data Analysis (7th ed. , 2009 .

[20]  Udo Konradt,et al.  Predicting user satisfaction, strain and system usage of employee self-services , 2006, Int. J. Hum. Comput. Stud..

[21]  B. Tabachnick,et al.  Using multivariate statistics, 5th ed. , 2007 .

[22]  Adamantios Diamantopoulos,et al.  Advancing formative measurement models , 2008 .

[23]  Dominique L. Scapin,et al.  Obstacles and Perspectives for Evaluating Mixed Reality Usability , 2004, MIXER.

[24]  Alexandru Balog,et al.  Measuring the Usability of Augmented Reality e-Learning Systems: A User-Centered Evaluation Approach , 2008, ICSOFT.