User Interaction Modelling for Adaptive Human Computer Interaction

The advancement of technology and computer systems requires continuous enhancement by means of the interaction between users and computers. Subsequently, the availability of unobtrusive visualised input modalities, such as eye trackers and RGB cameras has enabled the viable detection of users’ emotions and cognitive states. However, how to utilise such pervasive input modalities to enable a computer to actively interact with a user based on their current emotional and cognitive states is a challenging problem. This paper presents a research study that is currently taking place at Ulster University, which seeks to investigate creating a user model that facilitates future creation of Adaptive Human Computer Interaction. In other words, this research project focuses on exploiting visual-based input modalities to perceive and infer a user’s emotional and cognitive states in order to predicate adaptation of the graphical user interface or indeed the user interaction.

[1]  Christian D. Schunn,et al.  Integrating perceptual and cognitive modeling for adaptive and intelligent human-computer interaction , 2002, Proc. IEEE.

[2]  Shaogang Gong,et al.  Beyond Facial Expressions: Learning Human Emotion from Body Gestures , 2007, BMVC.

[3]  Dan Saffer,et al.  Designing for Interaction: Creating Innovative Applications and Devices , 2009 .

[4]  Hui Wang,et al.  Sensing Affective States Using Facial Expression Analysis , 2016, UCAmI.

[5]  David Benyon,et al.  Applying user modeling to human-computer interaction design , 1993, Artificial Intelligence Review.

[6]  Mary Czerwinski,et al.  Under pressure: sensing stress of computer users , 2014, CHI.

[7]  Tom Carey,et al.  ACM SIGCHI Curricula for Human-Computer Interaction , 1992 .

[8]  Milad Alemzadeh,et al.  Human-Computer Interaction: Overview on State of the Art , 2008 .

[9]  Brian P. Bailey,et al.  Categories & Subject Descriptors: H.5.2 [Information , 2022 .

[10]  Steven Heim.  The Resonant Interface: HCI Foundations for Interaction Design , 2007 .

[11]  Lars Bretzner,et al.  A Prototype System for Computer Vision Based Human Computer Interaction , 2001 .

[12]  Linden J. Ball,et al.  Eye Tracking in Human-Computer Interaction and Usability Research : Current Status and Future Prospects , 2004 .

[13]  V. Bruce.  What the human face tells the human mind: some challenges for the robot-human interface , 1992, [1992] Proceedings IEEE International Workshop on Robot and Human Communication.

[14]  Hugo Fuks,et al.  FX e-Makeup for Muscle Based Interaction , 2014, HCI.

[15]  Rosalind W. Picard.  Affective computing: challenges , 2003, Int. J. Hum. Comput. Stud..