An evaluation tool for research of user behavior in a realistic mobile environment

User behavior is significantly influenced by the surrounding environment. Especially complex and dynamically changing environments (like mobile environment) are represented by a wide variety of extraneous variables, which influence the user behavior in an unpredictable and mostly uncontrolled way. For researchers, it is challenging to measure and analyze the user behavior in such environments. We introduce a complex tool—the IVE tool—which provides a unique way of context visualization and synchronization of measured data of various kinds. Thanks to this tool it is possible to efficiently evaluate data acquired during complex usability tests in a mobile environment. The functionality of this tool is demonstrated on the use case “Navigation of visually impaired users in the building with support of a navigation system called NaviTerier.” During the experiment, we focused on collection and analysis of data that may show user stress and which may influence his/her ability to navigate. We analyzed objective data like Galvanic Skin Response parameter (GSR), Heart Rate Variability parameters (HRV) and audio video recordings and also subjective data like the user’s subjective stress feeling and observation of the user’s behavior.

[1]  Keith Vertanen,et al.  Speech dasher: fast writing using speech and gaze , 2010, CHI.

[2]  J. M. Tellevik.  Influence of Spatial Exploration Patterns on Cognitive Mapping by Blindfolded Sighted Persons , 1992 .

[3]  Jesper Kjeldskov,et al.  Is It Worth the Hassle? Exploring the Added Value of Evaluating the Usability of Context-Aware Mobile Systems in the Field , 2004, Mobile HCI.

[4]  Xiao Li,et al.  The vocal joystick:: evaluation of voice-based cursor control techniques , 2006, Assets '06.

[5]  Sri Kurniawan,et al.  Non-speech Operated Emulation of Keyboard , 2006 .

[6]  Thomas S. Huang,et al.  Face as mouse through visual face tracking , 2005, The 2nd Canadian Conference on Computer and Robot Vision (CRV'05).

[7]  R. Spillane,et al.  The physiological measurement of acute stress (public speaking) in bank employees. , 1987, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[8]  R. Hyman.  Stimulus information as a determinant of reaction time. , 1953, Journal of experimental psychology.

[9]  I. Scott MacKenzie,et al.  Qanti: A Software Tool for Quick Ambiguous Non-standard Text Input , 2010, ICCHP.

[10]  R. W. Schulz.  The Psychology of Fear and Stress , 1974 .

[11]  Alan F. Blackwell,et al.  Dasher—a data entry interface using continuous gestures and language models , 2000, UIST '00.

[12]  Kimihiro Yamanaka,et al.  Convenient Evaluation of Mental Stress With Pupil Diameter , 2009, International journal of occupational safety and ergonomics : JOSE.

[13]  E. Ochaíta,et al.  Spatial Representation by Persons who are Blind: A Study of the Effects of Learning and Development , 1993 .

[14]  Hanspeter A. Mallot,et al.  Navigation and Acquisition of Spatial Knowledge in a Virtual Maze , 1998, Journal of Cognitive Neuroscience.

[15]  Andrey Ronzhin,et al.  Assistive multimodal system based on speech recognition and head tracking , 2005, 2005 13th European Signal Processing Conference.

[16]  Yun Fu,et al.  hMouse: Head Tracking Driven Virtual Computer Mouse , 2007, 2007 IEEE Workshop on Applications of Computer Vision (WACV '07).

[17]  M. Ohsuga,et al.  Assessment of phasic work stress using autonomic indices. , 2001, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[18]  Pavel Slavík,et al.  A Comparative Longitudinal Study of Non-verbal Mouse Pointer , 2007, INTERACT.

[19]  H H Koester,et al.  Adaptive one-switch row-column scanning. , 1999, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[20]  R. Kitchin,et al.  Techniques to Collect and Analyze the Cognitive Map Knowledge of Persons with Visual Impairment Or Blindness: Issues of Validity , 1997 .

[21]  Poika Isokoski,et al.  Now Dasher! Dash away!: longitudinal study of fast text entry by Eye Gaze , 2008, ETRA.

[22]  Carmen Sandi,et al.  Stress and Memory: Behavioral Effects and Neurobiological Mechanisms , 2007, Neural plasticity.

[23]  Julio Miró,et al.  Text Entry System Based on a Minimal Scan Matrix for Severely Physically Handicapped People , 2008, ICCHP.

[24]  William H Warren,et al.  Do humans integrate routes into a cognitive map? Map- versus landmark-based navigation of novel shortcuts. , 2010, Journal of experimental psychology. Learning, memory, and cognition.

[25]  Ben Shneiderman,et al.  Readings in information visualization - using vision to think , 1999 .

[26]  Lizawati Salahuddin,et al.  Detection of Acute Stress by Heart Rate Variability Using a Prototype Mobile ECG Sensor , 2006 .

[27]  H. Nagaraja,et al.  Heart rate variability: origins, methods, and interpretive caveats. , 1997, Psychophysiology.

[28]  Dmitry O. Gorodnichy.  Nouse ‘Use Your Nose as a Mouse’ – a New Technology for Hands-free Games and Interfaces , 2002 .

[29]  Franck Poirier,et al.  Text entry for mobile devices and users with severe motor impairments: handiglyph, a primitive shapes based onscreen keyboard , 2008, Assets '08.

[30]  W. Teahan.  Probability estimation for PPM , 1995 .

[31]  R. Dantzer.  The Psychology of Fear and Stress, J.A. Gray (Ed.). Cambridge University Press, Cambridge (1987), viii and 422 pp, ISBN 0-521-27098-7 , 1989 .

[32]  Cuntai Guan,et al.  P300 Brain-Computer Interface Design for Communication and Control Applications , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[33]  Daniela Gorski Trevisan,et al.  Multimodal focus attention and stress detection and feedback in an augmented driver simulator , 2007, Personal and Ubiquitous Computing.

[34]  Andrew P. Duchon,et al.  Do Humans Integrate Routes Into a Cognitive Map? Map- Versus Landmark-Based Navigation of Novel Shortcuts , 2005 .

[35]  I. Scott MacKenzie,et al.  CHANTI: predictive text entry using non-verbal vocal input , 2011, CHI.

[36]  Michael Kühn,et al.  Predictive and highly ambiguous typing for a severely speech and motion impaired user , 2001, HCI.

[37]  Pavel Slavík,et al.  Longitudinal study of continuous non-speech operated mouse pointer , 2007, CHI Extended Abstracts.

[38]  Zdenek Mikovec,et al.  Interactive analytical tool for usability analysis of mobile indoor navigation application , 2010, 3rd International Conference on Human System Interaction.