Identifying Relationships between Physiological Measures and Evaluation Metrics for 3D Interaction Techniques

This project aims to present a methodology to study the relationships between physiological measures and evaluation metrics for 3D interaction techniques using methods for multivariate data analysis. Physiological responses, such as heart rate and skin conductance, offer objective data about the user stress during interaction. This could be useful, for instance, to evaluate qualitative aspects of interaction techniques without relying on solely subjective data. Moreover, these data could contribute to improve task performance analysis by measuring different responses to 3D interaction techniques. With this in mind, we propose a methodology that defines a testing protocol, a normalization procedure and statistical techniques, considering the use of physiological measures during the evaluation process. A case study comparison between two 3D interaction techniques (ray-casting and HOMER) shows promising results, pointing to heart rate variability, as measured by the NN50 parameter, as a potential index of task performance. Further studies are needed in order to establish guidelines for evaluation processes based on welldefined associations between human behaviors and human actions realized in 3D user interfaces.

[1]  Tao Lin,et al.  Evaluating usability based on multimodal information: an empirical study , 2006, ICMI '06.

[2]  A BoltRichard,et al.  Put-that-there , 1980 .

[3]  Tao Lin,et al.  Using multiple data sources to get closer insights into user cost and task performance , 2008, Interact. Comput..

[4]  H. Rex Hartson,et al.  Developing user interfaces: ensuring usability through product & process , 1993 .

[5]  Tao Lin,et al.  Do physiological data relate to traditional usability indexes? , 2005, OZCHI.

[6]  Tao Lin,et al.  AN EMPIRICAL STUDY OF RELATIONSHIPS BETWEEN TRADITIONAL USABILITY INDEXES AND PHYSIOLOGICAL DATA , 2006 .

[7]  Mel Slater,et al.  Responses of Participants During an Immersive Virtual Environment Experience , 2007, Int. J. Virtual Real..

[8]  Ivan Poupyrev,et al.  3D User Interfaces: Theory and Practice , 2004 .

[9]  Naresh Malhotra,et al.  Marketing Research: An Applied Orientation and SPSS 14.0 Student CD (5th Edition) , 2006 .

[10]  Doug A. Bowman,et al.  A Survey of Usability Evaluation in Virtual Environments: Classification and Comparison of Methods , 2002, Presence: Teleoperators & Virtual Environments.

[11]  Tom Appolloni,et al.  Proceedings of the 29th annual conference on Computer graphics and interactive techniques , 2002, SIGGRAPH.

[12]  Gert Pfurtscheller,et al.  Analysis of Physiological Responses to a Social Situation in an Immersive Virtual Environment , 2006, PRESENCE: Teleoperators and Virtual Environments.

[13]  Louis Guttman,et al.  A basis for analyzing test-retest reliability , 1945, Psychometrika.

[14]  Taku Komura,et al.  Computing inverse kinematics with linear programming , 2005, VRST '05.

[15]  Hirofumi Tanaka,et al.  Age-predicted maximal heart rate revisited. , 2001, Journal of the American College of Cardiology.

[16]  東 宏一郎,et al.  American College of Sports Medicine (ACSM) , 2001, The Grants Register 2019.

[17]  Doug A. Bowman,et al.  An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments , 1997, SI3D.

[18]  Mary Beth Rosson,et al.  Usability Engineering: Scenario-based Development of Human-Computer Interaction , 2001 .

[19]  Rolph E. Anderson,et al.  Multivariate Data Analysis (7th ed. , 2009 .

[20]  Mel Slater,et al.  Variations in physiological responses of participants during different stages of an immersive virtual environment experiment , 2006, VRST '06.

[21]  Bing Wu,et al.  Legacy Information Systems: Issues and Directions , 1999, IEEE Softw..

[22]  Richard A. Bolt,et al.  “Put-that-there”: Voice and gesture at the graphics interface , 1980, SIGGRAPH '80.

[23]  L. Cronbach Coefficient alpha and the internal structure of tests , 1951 .

[24]  Naresh K. Malhotra,et al.  Marketing Research: An Applied Orientation , 1993 .

[25]  James J. Thomas,et al.  Proceedings of the 7th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1980, Seattle, Washington, USA, July 14-18, 1980 , 1980, SIGGRAPH.

[26]  Michael Meehan,et al.  Physiological measures of presence in stressful virtual environments , 2002, SIGGRAPH.

[27]  Kwang Suk Park,et al.  The Application of Biosignal Feedback for Reducing Cybersickness from Exposure to a Virtual Environment , 2008, PRESENCE: Teleoperators and Virtual Environments.

[28]  A. Guyton,et al.  Textbook of Medical Physiology , 1961 .

[29]  A. Malliani,et al.  Heart rate variability. Standards of measurement, physiological interpretation, and clinical use , 1996 .

[30]  M. Whitton,et al.  Review of Four Studies on the Use of Physiological Reaction as a Measure of Presence in StressfulVirtual Environments , 2005, Applied psychophysiology and biofeedback.

[31]  M. Karvonen,et al.  The effects of training on heart rate; a longitudinal study. , 1957, Annales medicinae experimentalis et biologiae Fenniae.