Usability Study of Two In-Vehicle Information Systems Using Finger Tracking and Facial Expression Recognition Technology

ABSTRACT In this study, an experiment is conducted to compare the usability of two in-vehicle information systems (IVISs), namely, the newly developed “Calink” and the commercially available “Carlife.” The interface style of Calink is similar to that of smartphones, while that of Carlife is similar to the interface style of traditional IVISs. This study establishes a usability index system based on the International Organization for Standardization’s definition of usability, and each evaluation index has a corresponding subjective or objective measurement method. Five new indexes, namely, angular velocity, velocity, turn angle, distance of finger movements, and valence and arousal value of facial expression, are used in the usability test. Participants are asked to complete three tasks (namely, music, telephone, and navigation) to test the usability of the IVIS interface. The results show that in the case of most of the indexes Calink performs better than Carlife. Finally, the consistency of subjective experience and objective performance is discussed.

[1]  M. Bradley,et al.  Affective reactions to acoustic stimuli. , 2000, Psychophysiology.

[2]  Robert R. Hoffman,et al.  Concept Mapping Usability Evaluation: An Exploratory Study of a New Usability Inspection Method , 2015, Int. J. Hum. Comput. Interact..

[3]  Joseph H. Goldberg,et al.  Relating Perceived Web Page Complexity to Emotional Valence and Eye Movement Metrics , 2012 .

[4]  Cees de Graaf,et al.  Autonomic nervous system responses on and facial expressions to the sight, smell, and taste of liked and disliked foods , 2012 .

[5]  Myung Hwan Yun,et al.  Evaluation of product usability: development and validation of usability dimensions and design elements based on empirical models , 2000 .

[6]  Bryan Reimer,et al.  User Perceptions Toward In-Vehicle Technologies: Relationships to Age, Health, Preconceptions, and Hands-On Experience , 2015, Int. J. Hum. Comput. Interact..

[7]  H. Pashler.  Dissociations and dependencies between speed and accuracy: Evidence for a two-component theory of divided attention in simple tasks , 1989, Cognitive Psychology.

[8]  Myung Hwan Yun,et al.  Usability of consumer electronic products , 2001 .

[9]  Gyanendra K. Verma,et al.  Multimodal fusion framework: A multiresolution approach for emotion classification and recognition from physiological signals , 2014, NeuroImage.

[10]  Jaehyun Park,et al.  Modeling user experience: A case study on a mobile device , 2013 .

[11]  Luis de-Marcos,et al.  An experiment with content distribution methods in touchscreen mobile devices. , 2015, Applied ergonomics.

[12]  İsmail Tonbuloğlu,et al.  Using Eye Tracking Method and Video Record in Usability Test of Educational Softwares and Gender Effects , 2013 .

[13]  Jakob Nielsen,et al.  Chapter 4 – The Usability Engineering Lifecycle , 1993 .

[14]  Fred D. Davis.  User Acceptance of Information Technology: System Characteristics, User Perceptions and Behavioral Impacts , 1993, Int. J. Man Mach. Stud..

[15]  Jeff Sauro,et al.  Quantifying the User Experience: Practical Statistics for User Research , 2012 .

[16]  Lukas Danner,et al.  Make a face! Implicit and explicit measurement of facial expressions elicited by orange juices using face reading technology. , 2014 .

[17]  Alex Pentland,et al.  Coding, Analysis, Interpretation, and Recognition of Facial Expressions , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Nigel Bevan,et al.  International standards for HCI and usability , 2001, Int. J. Hum. Comput. Stud..

[19]  Nobuyuki Nishiuchi,et al.  Objective Evaluation Method of Usability Using Parameters of User's Fingertip Movement , 2015, Trans. Comput. Sci..

[20]  M. Koelen,et al.  Facial expressions in school-aged children are a good indicator of 'dislikes', but not of 'likes' , 2009 .

[21]  Lee Skrypchuk,et al.  Intent Inference for Hand Pointing Gesture-Based Interactions in Vehicles , 2016, IEEE Transactions on Cybernetics.

[22]  P. Ekman.  Facial expressions of emotion: an old controversy and new findings. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[23]  P. Ekman.  An argument for basic emotions , 1992 .

[24]  Ayyaz Hussain,et al.  Facial expression recognition on real world face images using intelligent techniques: A survey , 2016 .

[25]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[26]  Sung H. Han,et al.  A methodology for developing a usability index of consumer electronic products , 2008 .

[27]  Kasper Hornbæk,et al.  Current practice in measuring usability: Challenges to usability studies and research , 2006, Int. J. Hum. Comput. Stud..

[28]  Andreas Sonderegger,et al.  The influence of design aesthetics in usability testing: effects on user performance and perceived usability. , 2010, Applied ergonomics.

[29]  Jennifer Preece,et al.  A multilevel analysis of sociability, usability, and community dynamics in an online health community , 2005, TCHI.

[30]  Young-June Choi,et al.  Evaluation of Mobile Based Consumer Products: Key Usability Factors and Evaluation Framework , 2004 .

[31]  Tamara Babaian,et al.  The Collaborative Critique: An Inspection Method for Expert Evaluation of User Interfaces , 2015, Int. J. Hum. Comput. Interact..

[32]  Wolfram Boucsein,et al.  Objective Emotional Assessment of Industrial Products , 2008 .

[33]  Veikko Surakka,et al.  Real-time estimation of emotional experiences from facial expressions , 2006, Interact. Comput..

[34]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[35]  Alexandra Neukum,et al.  Evaluating distraction of in-vehicle information systems while driving by predicting total eyes-off-road times with keystroke level modeling. , 2017, Applied ergonomics.

[36]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[37]  Neville A. Stanton,et al.  Usability Evaluation for In-Vehicle Systems , 2013 .

[38]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[39]  Terry C. Lansdown,et al.  Driver visual allocation and the introduction of intelligent transport systems , 2000 .

[40]  Neville A Stanton,et al.  A usability evaluation toolkit for In-Vehicle Information Systems (IVISs). , 2011, Applied ergonomics.

[41]  Inki Kim,et al.  Performance Comparisons Between Thumb-Based and Finger-Based Input on a Small Touch-Screen Under Realistic Variability , 2015, Int. J. Hum. Comput. Interact..

[42]  Yong Gu Ji,et al.  Assessment model for perceived visual complexity of automotive instrument cluster. , 2015, Applied ergonomics.

[43]  T Stewart,et al.  Ergonomics user interface standards: are they more trouble than they are worth? , 2000, Ergonomics.

[44]  Huhn Kim,et al.  Evaluation of the safety and usability of touch gestures in operating in-vehicle information systems with visual occlusion. , 2014, Applied ergonomics.

[45]  Vimla L. Patel,et al.  Usability evaluation of an experimental text summarization system and three search engines: implications for the reengineering of health care interfaces , 2002, AMIA.

[46]  G. Ferrigno,et al.  Finger Kinematic Modeling and Real-Time Hand Motion Estimation , 2007, Annals of Biomedical Engineering.

[47]  Bassam Hasan,et al.  Effects of interface style on user perceptions and behavioral intention to use computer systems , 2007, Comput. Hum. Behav..

[48]  Chris D. Nugent,et al.  A usability evaluation of medical software at an expert conference setting , 2014, Comput. Methods Programs Biomed..

[49]  James R. Miller,et al.  Conference Companion on Human Factors in Computing Systems , 1995, CHI 1995.