Assessing haptic video interaction with neurocognitive tools

Haptic interaction is a form of a user-computer interaction where physical forces are delivered to the user via vibrations, displacements and rotations of special haptic devices. When quality of the experience of the haptic interaction is assessed, mostly subjective tests using various questionnaires are performed. We proposed novel neurocognitive tools for assessing both overall experience of the haptic interaction, as well as particular time-stamped activities. Our assessment tools are based on recognition of emotions and stress obtained from Electroencephalograms (EEG). We used them in a feasibility study on adding haptic interaction to Skype video conversation.

[1]  Olga Sourina,et al.  Real-time EEG-based emotion monitoring using stable features , 2015, The Visual Computer.

[2]  Kai Keng Ang,et al.  A Brain-Computer Interface for classifying EEG correlates of chronic mental stress , 2011, The 2011 International Joint Conference on Neural Networks.

[3]  Alexei Sourin,et al.  Image-Driven Haptic Rendering , 2014, Trans. Comput. Sci..

[4]  Jennifer Healey,et al.  Toward Machine Emotional Intelligence: Analysis of Affective Physiological State , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Mitsuru Ishizuka,et al.  iFeel_IM: innovative real-time communication system with rich emotional and haptic channels , 2010, CHI Extended Abstracts.

[6]  Ryohei Nakatsu,et al.  Mediating intimacy in long-distance relationships using kiss messaging , 2014, Int. J. Hum. Comput. Stud..

[7]  Olga Sourina,et al.  EEG Based Stress Monitoring , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[8]  A. El Saddik,et al.  HugMe: An interpersonal haptic communication system , 2008, 2008 IEEE International Workshop on Haptic Audio visual Environments and Games.

[9]  Haibo Li,et al.  Turn Your Mobile Into the Ball: Rendering Live Football Game Using Vibration , 2008, IEEE Transactions on Multimedia.

[10]  Martin R. Gibbs,et al.  Hug over a distance , 2005, CHI Extended Abstracts.

[11]  Yuan-Pin Lin,et al.  EEG-based emotion recognition in music listening: A comparison of schemes for multiclass support vector machine , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[12]  Olga Sourina,et al.  Stability of Features in Real-Time EEG-based Emotion Recognition Algorithm , 2014, 2014 International Conference on Cyberworlds.

[13]  T. Higuchi.  Approach to an irregular time series on the basis of the fractal theory , 1988 .

[14]  Michael Meehan,et al.  Physiological measures of presence in stressful virtual environments , 2002, SIGGRAPH.

[15]  Wei. Lei,et al.  Function-based visual and haptic rendering, interaction and collaboration in shared virtual spaces , 2011 .

[16]  Kazuaki Tanaka,et al.  Remote handshaking: touch enhances video-mediated social telepresence , 2014, CHI.

[17]  Dzmitry Tsetserukou,et al.  HaptiHug: A Novel Haptic Display for Communication of Hug over a Distance , 2010, EuroHaptics.

[18]  Leontios J. Hadjileontiadis,et al.  Emotion Recognition From EEG Using Higher Order Crossings , 2010, IEEE Transactions on Information Technology in Biomedicine.

[19]  Olga Sourina,et al.  EEG-enabled Affective Human-Computer Interfaces , 2014, HCI.

[20]  Ian Oakley,et al.  A tactile glove design and authoring system for immersive multimedia , 2010, IEEE MultiMedia.

[21]  Rajesh Aggarwal,et al.  Second Life™: a novel simulation platform for the training of surgical residents , 2014, Expert review of medical devices.

[22]  Wei Tech Ang,et al.  EEG-Based Human Factors Evaluation of Conflict Resolution Aid and Tactile User Interface in Future Air Traffic Control Systems , 2017 .

[23]  Anatole Lécuyer,et al.  Framework for enhancing video viewing experience with haptic effects of motion , 2012, 2012 IEEE Haptics Symposium (HAPTICS).

[24]  S. A. Hosseini,et al.  Higher Order Spectra Analysis of EEG Signals in Emotional Stress States , 2010, 2010 Second International Conference on Information Technology and Computer Science.