Understanding User Interaction in a Video Game by using Eye Tracking and Facial Expressions Analysis

The increasing importance and employment of usability testing has heightened the need for a careful and extensive study of usability evaluation methods and tools available. Usability testing provides a means for understanding the real picture of the product being used in a context. The aim of this Master‟s thesis is to understand user interaction in a video game by using the two data collection methods, eye tracking and facial expressions analysis. Usability testing in video games is one of the important factors, if carried out consistently and timely it can significantly make the video game more enjoyable, playable and provide a quality user experience to the gamers. Overall, the usability testing efforts contribute to the enhanced effectiveness, efficiency and satisfaction in the gaming experience. The eye movements and facial expressions provide data which is useful for researchers to understand the user interaction of players‟ while playing a video game, as what objects capture their attention, what objects were ignored or didn‟t get attention, difficulties in progressing through the game and also players emotional state when interacting with video game elements. Total eight participants were recruited including one pilot participant to perform the usability testing. The participants were asked to play Call of Duty: Modern Warfare 2 and progress through the game by completing the objectives. Data collected by using eye movement tracking and facial expressions analysis. Data analysis performed to generate results from usability testing, questionnaire and interviews.

[1]  James A. Holstein,et al.  Handbook of Interview Research , 2001 .

[2]  C. Darwin The Expression of the Emotions in Man and Animals , .

[3]  Takeo Kanade,et al.  Recognizing Action Units for Facial Expression Analysis , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Craig A. Anderson,et al.  Video games and aggressive thoughts, feelings, and behavior in the laboratory and in life. , 2000 .

[5]  James A. Holstein,et al.  Handbook of Interview Research: Context and Method , 2001 .

[6]  Mark Zirinsky Usability testing of computer documentation , 1986, SIGDOC '86.

[7]  Kim J. Vicente,et al.  The Human Factor - Revolutionizing the way people live with technology , 2004 .

[8]  R. Dodge,et al.  The angular velocity of eye movements , 1901 .

[9]  E. Javal,et al.  Essai sur la physiologie de la lecture , 1878 .

[10]  W. R. Ford,et al.  Tutorials for the first-time computer user , 1981, IEEE Transactions on Professional Communication.

[11]  R. G. Zuffo Lo "Spirito del tempo" del volume "Principles of Scientific Management" di Frederick Winslow Taylor. Ideologia e scienza , 2013 .

[12]  E. B. Delabarre A method of recording eye-movements. , 1898 .

[13]  H. Hartridge,et al.  METHODS OF INVESTIGATING EYE MOVEMENTS , 1948, The British journal of ophthalmology.

[14]  Pam J. Mayhew,et al.  Technical Review: Current Issues of Usability Testing , 2009 .

[15]  Jakob Nielsen,et al.  Eyetracking Web Usability , 2009 .

[16]  Regina Bernhaupt,et al.  Evaluating User Experience in Games - Concepts and Methods , 2010, Human-Computer Interaction Series.

[17]  Claude. Ghaoui Encyclopedia of human computer interaction / Claude Ghaoui, Editor. , 2006 .

[18]  K. Eason Information Technology and Organizational Change , 1989 .

[19]  Yi Wang,et al.  Multi-Layer Sparse Representation for Weighted LBP-Patches Based Facial Expression Recognition , 2015, Sensors.

[20]  Richard H. Spencer Computer usability testing and evaluation , 1985 .

[21]  Poika Isokoski,et al.  Chapter 22 – Voluntary Eye Movements in Human—Computer Interaction , 2003 .

[22]  P. Ekman,et al.  Strong evidence for universals in facial expressions: a reply to Russell's mistaken critique. , 1994, Psychological bulletin.

[23]  Vinay Bettadapura,et al.  Face Expression Recognition and Analysis: The State of the Art , 2012, ArXiv.

[24]  C. Anderson,et al.  Affect of the Game Player , 1986 .

[25]  D. Norman The psychology of everyday things , 1990 .

[26]  Rico Fischer,et al.  Eye tracking and its application in usability and media research , 2003, MMI Interakt..

[27]  Jeffrey Rubin,et al.  Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests , 1994 .

[28]  Michael T. Ghiselin,et al.  Darwin and Facial Expression: A Century of Research in Review.@@@Darwin on Man: A Psychological Study of Scientific Creativity. , 1974 .

[29]  Oleg Spakov,et al.  Gaze controlled games , 2009, Universal Access in the Information Society.

[30]  Andrew T. Duchowski,et al.  Eye Tracking Methodology: Theory and Practice , 2003, Springer London.

[31]  Robert J. K. Jacob,et al.  Eye tracking in human-computer interaction and usability research : Ready to deliver the promises , 2002 .

[32]  Karen E. Dill,et al.  Video games and aggressive thoughts, feelings, and behavior in the laboratory and in life. , 2000, Journal of personality and social psychology.

[33]  Adrian Hilton,et al.  Visual Analysis of Humans - Looking at People , 2013 .

[34]  Robert H. Gault,et al.  A History of the Questionnaire Method of Research in Psychology , 1907 .

[35]  E. B. Huey,et al.  Preliminary experiments in the physiology and psychology of reading , 1898 .

[36]  Claude Ghaoui,et al.  Encyclopedia of Human Computer Interaction , 2005 .

[37]  Kira Bailey,et al.  The effects of an action video game on visual and affective information processing , 2013, Brain Research.

[38]  Frederick Winslow Taylor,et al.  科学管理原理=The principles of scientific management , 2014 .