Leveraging human-computer interactions and social presence with physiological computing. (Améliorer les interactions homme-machine et la présence sociale avec l'informatique physiologique)

This thesis explores how physiological computing can contribute to human-computer interaction (HCI) and foster new communication channels among the general public. We investigated how physiological sensors, such as electroencephalography (EEG), could be employed to assess the mental state of the users and how they relate to other evaluation methods. We created the first brain-computer interface that could sense visual comfort during the viewing of stereoscopic images and shaped a framework that could help to assess the over all user experience by monitoring workload, attention and error recognition.To lower the barrier between end users and physiological sensors,we participated in the software integration of a low-cost and open hardware EEG device; used off-the shelf webcams to measure heart rate remotely, crafted we arables that can quickly equip users so that electrocardiography, electrodermal activity or EEG may be measured during public exhibitions. We envisioned new usages for our sensors, that would increase social presence. In a study about human-agent interaction, participants tended to prefer virtual avatars that were mirroring their own internal state. A follow-up study focused on interactions between users to describe how physiological monitoringcould alter our relationships. Advances in HCI enabled us to seam lesslyintegrate biofeedback to the physical world. We developped Teegi, apuppet that lets novices discover by themselves about their brain activity. Finally, with Tobe, a toolkit that encompasses more sensors and give more freedom about their visualizations, we explored how such proxy shifts our representations, about our selves as well as about the others.

[1]  Takashi Minato,et al.  Minimal Human Design Approach for sonzai-kan Media: Investigation of a Feeling of Human Presence , 2014, Cognitive Computation.

[2]  David R. Flatla,et al.  Calibration games: making calibration tasks enjoyable by adding motivating game elements , 2011, UIST.

[3]  Lennart E. Nacke,et al.  How does it play better?: exploring user testing and biometric storyboards in games user research , 2013, CHI.

[4]  J F Thayer,et al.  Facial muscle activity and EEG recordings: redundancy analysis. , 1991, Electroencephalography and clinical neurophysiology.

[5]  Alan J. Dix,et al.  Using frustration in the design of adaptive videogames , 2004, ACE '04.

[6]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[7]  Gilles Simon,et al.  An Augmented Reality Environment for Astronomy Learning in Elementary Grades: An Exploratory Study , 2013, IHM.

[8]  M van de Velde,et al.  Detection of muscle artefact in the normal human awake EEG. , 1998, Electroencephalography and clinical neurophysiology.

[9]  Christine L. Lisetti,et al.  Using Noninvasive Wearable Computers to Recognize Human Emotions from Physiological Signals , 2004, EURASIP J. Adv. Signal Process..

[10]  David M. Hoffman,et al.  The zone of comfort: Predicting visual discomfort with stereo displays. , 2011, Journal of vision.

[11]  G. Pfurtscheller,et al.  Optimal spatial filtering of single trial EEG during imagined hand movement. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[12]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[13]  Martin Hachet,et al.  PapARt: Interactive 3D graphics and multi-touch augmented paper for artistic creation , 2012, 2012 IEEE Symposium on 3D User Interfaces (3DUI).

[14]  A. Mognon,et al.  ADJUST: An automatic EEG artifact detector based on the joint use of spatial and temporal features. , 2011, Psychophysiology.

[15]  S. Fairclough,et al.  A metabolic measure of mental effort , 2004, Biological Psychology.

[16]  Pascal Mamassian,et al.  The Influence of Object Size and Surface Shape on Shape Constancy from Stereo , 2004, Perception.

[17]  Dietrich Lehmann,et al.  Reduced functional connectivity between cortical sources in five meditation traditions detected with lagged coherence using EEG tomography , 2012, NeuroImage.

[18]  Georgios N. Yannakakis,et al.  Player modeling using self-organization in Tomb Raider: Underworld , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[19]  Stefan Haufe,et al.  Single-trial analysis and classification of ERP components — A tutorial , 2011, NeuroImage.

[20]  Anton Nijholt,et al.  Measuring Multimodal Synchrony for Human-Computer Interaction , 2010, 2010 International Conference on Cyberworlds.

[21]  Hirofumi Tanaka,et al.  Age-predicted maximal heart rate revisited. , 2001, Journal of the American College of Cardiology.

[22]  Touradj Ebrahimi,et al.  Spatial filters for the classification of event-related potentials , 2006, ESANN.

[23]  Robert Oostenveld,et al.  Estimating workload using EEG spectral power and ERPs in the n-back task , 2012, Journal of neural engineering.

[24]  J. Hohnsbein,et al.  ERP components on reaction errors and their functional significance: a tutorial , 2000, Biological Psychology.

[25]  Egon L. van den Broek,et al.  Modality-specific Affective Responses and their Implications for Affective BCI , 2011 .

[26]  Nico M Schmidt,et al.  Online detection of error-related potentials boosts the performance of mental typewriters , 2012, BMC Neuroscience.

[27]  Rosalind W. Picard,et al.  A Wearable Sensor for Unobtrusive, Long-Term Assessment of Electrodermal Activity , 2010, IEEE Transactions on Biomedical Engineering.

[28]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[29]  Elsa Andrea Kirchner,et al.  Effects of eye artifact removal methods on single trial P300 detection, a comparative study , 2014, Journal of Neuroscience Methods.

[30]  Michel Besserve,et al.  Multimodal information improves the rapid detection of mental fatigue , 2013, Biomed. Signal Process. Control..

[31]  Christian Mühl,et al.  Review of the Use of Electroencephalography as an Evaluation Method for Human-Computer Interaction , 2013, PhyCS.

[32]  R. Brown,et al.  The assessment of fatigue: a practical guide for clinicians and researchers. , 2004, Journal of psychosomatic research.

[33]  S. Chaiken,et al.  Personality and Social Psychology Bulle- Tin Chen, Bargh / Consequences of Automatic Evaluation Immediate Behavioral Predispositions to Approach or Avoid the Stimulus , 2022 .

[34]  Maarten A. S. Boksem,et al.  Effects of mental fatigue on attention: an ERP study. , 2005, Brain research. Cognitive brain research.

[35]  Michael S. Horn,et al.  Comparing the use of tangible and graphical programming languages for informal science education , 2009, CHI.

[36]  Larissa Hjorth,et al.  Understanding physical activity through 3D printed material artifacts , 2014, CHI.

[37]  Frédo Durand,et al.  Eulerian video magnification for revealing subtle changes in the world , 2012, ACM Trans. Graph..

[38]  Shumin Zhai,et al.  Quantifying coordination in multiple DOF movement and its application to evaluating 6 DOF input devices , 1998, CHI.

[39]  Anne Bruseberg,et al.  Focus groups to support the industrial/product designer: a review based on current literature and designers' feedback. , 2002, Applied ergonomics.

[40]  Wolfgang Rosenstiel,et al.  Cognitive state monitoring and the design of adaptive instruction in digital environments: lessons learned from cognitive workload assessment using a passive brain-computer interface approach , 2014, Front. Neurosci..

[41]  W.J. Tompkins,et al.  ECG beat detection using filter banks , 1999, IEEE Transactions on Biomedical Engineering.

[42]  Otmar Hilliges,et al.  Steerable augmented reality with the beamatron , 2012, UIST.

[43]  Meredith Ringel Morris,et al.  SWARM: An Actuated Wearable for Mediating Affect , 2015, TEI.

[44]  Matthew Pike,et al.  CUES: Cognitive Usability Evaluation System , 2012, EuroHCIR.

[45]  Anthony J. Ries,et al.  Usability of four commercially-oriented EEG systems , 2014, Journal of neural engineering.

[46]  Gert Cauwenberghs,et al.  Wireless non-contact cardiac and neural monitoring , 2010, Wireless Health.

[47]  David M. Hoffman,et al.  Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. , 2008, Journal of vision.

[48]  Claus Bahlmann,et al.  In a Blink of an Eye and a Switch of a Transistor: Cortically Coupled Computer Vision , 2010, Proceedings of the IEEE.

[49]  Jérémy Frey,et al.  Assessing the zone of comfort in stereoscopic displays using EEG , 2014, CHI Extended Abstracts.

[50]  Vivian Genaro Motti,et al.  Users' Privacy Concerns About Wearables - Impact of Form Factor, Sensors and Type of Data Collected , 2015, Financial Cryptography Workshops.

[51]  Hiroshi Ishii,et al.  Illuminating clay: a 3-D tangible interface for landscape analysis , 2002, CHI.

[52]  Kathryn M. McMillan,et al.  N‐back working memory paradigm: A meta‐analysis of normative functional neuroimaging studies , 2005, Human brain mapping.

[53]  P. Tallgren,et al.  Evaluation of commercially available electrodes and gels for recording of slow EEG potentials , 2005, Clinical Neurophysiology.

[54]  Katherine Isbister,et al.  Designing for the physical margins of digital workspaces: fidget widgets in support of productivity and creativity , 2014, TEI '14.

[55]  Satoshi Umeda,et al.  Association between interoception and empathy: evidence from heartbeat-evoked brain potential. , 2011, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[56]  Kun Li,et al.  EEG-based detection and evaluation of fatigue caused by watching 3DTV , 2013, Displays.

[57]  Mitsuru Ishizuka,et al.  Evaluating Affective Feedback of the 3D Agent Max in a Competitive Cards Game , 2005, ACII.

[58]  Anatole Lécuyer,et al.  Exploring Large Virtual Environments by Thoughts Using a BrainComputer Interface Based on Motor Imagery and High-Level Commands , 2010, PRESENCE: Teleoperators and Virtual Environments.

[59]  Ivan Poupyrev,et al.  PAPILLON: designing curved display surfaces with printed optics , 2013, UIST.

[60]  Elise van den Hoven,et al.  Towards a more cherishable digital object , 2012, DIS '12.

[61]  Clifford Nass,et al.  Designing social presence of social actors in human computer interaction , 2003, CHI '03.

[62]  Jennifer Healey,et al.  Toward Machine Emotional Intelligence: Analysis of Affective Physiological State , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[63]  Anton Nijholt,et al.  Brain-Computer Interfaces and User Experience Evaluation , 2012 .

[64]  Regan L. Mandryk,et al.  Game Metrics and Biometrics : The Future of Player Experience Research , 2009 .

[65]  Jean-Yves Antoine,et al.  Affective Interaction with a Companion Robot for Hospitalized Children: a Linguistically based Model for Emotion Detection , 2011, LTC 2011.

[66]  Laurent Bougrain,et al.  Processing Stages of Visual Stimuli and Event-Related Potentials , 2012 .

[67]  D. Tucker,et al.  Scalp electrode impedance, infection risk, and EEG data quality , 2001, Clinical Neurophysiology.

[68]  Ricardo Chavarriaga,et al.  Error Processing of Self-paced Movements , 2013 .

[69]  Ricardo Chavarriaga,et al.  Adaptation of hybrid human-computer interaction systems using EEG error-related potentials , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[70]  M. Merello,et al.  Deep Brain Stimulation of the Subthalamic Nucleus for the Treatment of Parkinson's Disease , 2008 .

[71]  J. E. Korteling,et al.  Using neurophysiological signals that reflect cognitive or affective state: six recommendations to avoid common pitfalls , 2015, Front. Neurosci..

[72]  B. Oken,et al.  Vigilance, alertness, or sustained attention: physiological basis and measurement , 2006, Clinical Neurophysiology.

[73]  N. Farb,et al.  Interoception, contemplative practice, and health , 2015, Front. Psychol..

[74]  Constantine Stephanidis,et al.  3D Visualization and Multimodal Interaction with Temporal Information Using Timelines , 2013, INTERACT.

[75]  Michelle N. Lumicao,et al.  EEG correlates of task engagement and mental workload in vigilance, learning, and memory tasks. , 2007, Aviation, space, and environmental medicine.

[76]  Tatsuo Nakajima,et al.  Biofeedback Training with EmoPoker: Controlling Emotional Arousal for Better Poker Play , 2010 .

[77]  Robert J. K. Jacob,et al.  Combining Electroencephalograph and Functional Near Infrared Spectroscopy to Explore Users' Mental Workload , 2009, HCI.

[78]  Ken Hinckley,et al.  Passive real-world interface props for neurosurgical visualization , 1994, CHI '94.

[79]  Christian Mühl,et al.  Connecting Brains and Bodies: Applying Physiological Computing to Support Social Interaction , 2015, Interact. Comput..

[80]  S. Vosniadou,et al.  Designing learning environments to promote conceptual change in science , 2001 .

[81]  Tarek M. Mahmoud A New Fast Skin Color Detection Technique , 2008 .

[82]  K. Kallinen,et al.  Phasic Emotional Reactions to Video Game Events: A Psychophysiological Investigation , 2006 .

[83]  Christian Mühl,et al.  EEG-based workload estimation across affective contexts , 2014, Front. Neurosci..

[84]  M. Frese,et al.  Mental fatigue and the control of cognitive processes: effects on perseveration and planning. , 2003, Acta psychologica.

[85]  Sebastian Möller,et al.  Evaluating spoken dialogue systems according to de-facto standards: A case study , 2007, Comput. Speech Lang..

[86]  H. Momeni-Moghadam,et al.  Stereopsis with TNO and Titmus Tests in Symptomatic and Asymptomatic University Students , 2011 .

[87]  Alessandro De Gloria,et al.  > Replace This Line with Your Paper Identification Number (double-click Here to Edit) < , 2022 .

[88]  Anton Nijholt,et al.  Turning Shortcomings into Challenges: Brain-Computer Interfaces for Games , 2009, INTETAIN.

[89]  Robin Jeffries,et al.  Backtracking Events as Indicators of Usability Problems in Creation-Oriented Applications , 2012, TCHI.

[90]  Robert J. K. Jacob,et al.  Brain measurement for usability testing and adaptive interfaces: an example of uncovering syntactic workload with functional near infrared spectroscopy , 2009, CHI.

[91]  Frédéric Bousefsaf,et al.  Continuous wavelet filtering on webcam photoplethysmographic signals to remotely assess the instantaneous heart rate , 2013, Biomed. Signal Process. Control..

[92]  Marc Hassenzahl,et al.  From mental effort to perceived usability: transforming experiences into summary assessments , 2004, CHI EA '04.

[93]  Guangyuan Liu,et al.  MAPD: A Multi-subject Affective Physiological Database , 2014, 2014 Seventh International Symposium on Computational Intelligence and Design.

[94]  Timothy D. Wilson,et al.  Telling more than we can know: Verbal reports on mental processes. , 1977 .

[95]  Sara Kiesler,et al.  Social psychological aspects of computer-mediated communication , 1984 .

[96]  J. Wolpaw,et al.  EMG contamination of EEG: spectral and topographical characteristics , 2003, Clinical Neurophysiology.

[97]  R Schellenberg,et al.  Reflection of mental exercise in the dynamic quantitative topographical EEG. , 1995, Neuropsychobiology.

[98]  Martin Hachet,et al.  Toucheo: multitouch and stereo combined in a seamless workspace , 2011, UIST.

[99]  John Short,et al.  The social psychology of telecommunications , 1976 .

[100]  Stina Nylander,et al.  Snot, Sweat, Pain, Mud, and Snow: Performance and Experience in the Use of Sports Watches , 2015, CHI.

[101]  W. Klimesch,et al.  Induced alpha band power changes in the human EEG and attention , 1998, Neuroscience Letters.

[102]  Matthew Louis Mauriello,et al.  BodyVis: A New Approach to Body Learning Through Wearable Sensing and Visualization , 2015, CHI.

[103]  Ricardo Chavarriaga,et al.  Errare machinale est: the use of error-related potentials in brain-machine interfaces , 2014, Front. Neurosci..

[104]  J E Schwartz,et al.  The measurement of fatigue: a new instrument. , 1993, Journal of psychosomatic research.

[105]  Bryan Reimer,et al.  A Comparison of Heart Rate and Heart Rate Variability Indices in Distinguishing Single-Task Driving and Driving Under Secondary Cognitive Workload , 2017 .

[106]  R. Ward,et al.  EMG and EOG artifacts in brain computer interface systems: A survey , 2007, Clinical Neurophysiology.

[107]  Cláudio T. Silva,et al.  A User Study of Visualization Effectiveness Using EEG and Cognitive Load , 2011, Comput. Graph. Forum.

[108]  Sebastian Bosse,et al.  Toward a Direct Measure of Video Quality Perception Using EEG , 2012, IEEE Transactions on Image Processing.

[109]  Geraldine Fitzpatrick,et al.  Understanding heart rate sharing: towards unpacking physiosocial space , 2012, CHI.

[110]  Hussein A. Abbass,et al.  Augmented Cognition using Real-time EEG-based Adaptive Strategies for Air Traffic Control , 2014 .

[111]  Paul Dourish,et al.  Awareness and coordination in shared workspaces , 1992, CSCW '92.

[112]  José del R. Millán,et al.  Improving Human Performance in a Real Operating Environment through Real-Time Mental Workload Detection , 2007 .

[113]  Anatole Lécuyer,et al.  Using scalp electrical biosignals to control an object by concentration and relaxation tasks: Design and evaluation , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[114]  Chris Harrison,et al.  Unlocking the expressivity of point lights , 2012, CHI.

[115]  D. Ariely,et al.  The 'IKEA Effect': When Labor Leads to Love , 2011 .

[116]  Rebecca A. Grier,et al.  Fundamental dimensions of subjective state in performance settings: task engagement, distress, and worry. , 2002, Emotion.

[117]  Veikko Surakka,et al.  Pupil size variation as an indication of affective processing , 2003, Int. J. Hum. Comput. Stud..

[118]  Fabien Lotte,et al.  Brain-Computer Interfaces: Beyond Medical Applications , 2012, Computer.

[119]  Dieter Schmalstieg,et al.  ARToolKitPlus for Pose Trackin on Mobile Devices , 2007 .

[120]  Ernst Fernando Lopes Da Silva Niedermeyer,et al.  Electroencephalography, basic principles, clinical applications, and related fields , 1982 .

[121]  Paolo Giacometti,et al.  Compliant head probe for positioning electroencephalography electrodes and near-infrared spectroscopy optodes , 2013, Journal of biomedical optics.

[122]  Heinz Jäckel,et al.  A pseudodifferential amplifier for bioelectric events with DC-offset compensation using two-wired amplifying electrodes , 2006, IEEE Transactions on Biomedical Engineering.

[123]  Pierre Dillenbourg,et al.  System for assessing classroom attention , 2013, LAK '13.

[124]  Daniel J. Simons,et al.  What People Believe about How Memory Works: A Representative Survey of the U.S. Population , 2011, PloS one.

[125]  G. Pfurtscheller,et al.  EEG-based communication: presence of an error potential , 2000, Clinical Neurophysiology.

[126]  Andrew Wilson,et al.  MirageTable: freehand interaction on a projected augmented reality tabletop , 2012, CHI.

[127]  Bernd Fröhlich,et al.  Exploring geo-scientific data in virtual environments , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[128]  Luis Montesano,et al.  Single trial recognition of error-related potentials during observation of robot operation , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[129]  Jérémy Frey,et al.  TOBE: Tangible Out-of-Body Experience , 2015, TEI.

[130]  Jérémy Frey,et al.  Continuous Mental Effort Evaluation During 3D Object Manipulation Tasks Based on Brain and Physiological Signals , 2015, INTERACT.

[131]  Elisabeth André,et al.  Surface-poker: multimodality in tabletop games , 2010, ITS '10.

[132]  Javier Hernandez,et al.  SenseGlass: using google glass to sense daily emotions , 2014, UIST.

[133]  Regan L. Mandryk,et al.  Using psychophysiological techniques to measure user experience with entertainment technologies , 2006, Behav. Inf. Technol..

[134]  Daniel Afergan,et al.  Brain-based target expansion , 2014, UIST.

[135]  Ryan O. Murphy,et al.  Using Skin Conductance in Judgment and Decision Making Research , 2011 .

[136]  Ana Paiva,et al.  LEARNING BY FEELING: EVOKING EMPATHY WITH SYNTHETIC CHARACTERS , 2005, Appl. Artif. Intell..

[137]  Jérémy Frey,et al.  Teegi: tangible EEG interface , 2014, UIST.

[138]  Lennart E. Nacke,et al.  Electroencephalographic Assessment of Player Experience , 2011 .

[139]  Shuichi Nishio,et al.  Designing Robots for Well-being: Theoretical Background and Visual Scenes of Affectionate Play with a Small Humanoid Robot , 2013 .

[140]  Keetaek Kham,et al.  Measurement of 3D Visual Fatigue Using Event-Related Potential (ERP): 3D Oddball Paradigm , 2008, 2008 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[141]  Deborah Hix,et al.  User-centered design and evaluation of a real-time battlefield visualization virtual environment , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[142]  Pierre Cutellic,et al.  Augmented Iterations: Integrating neural activity in evolutionary computation for design , 2013 .

[143]  K. R. Ridderinkhof,et al.  Error-related brain potentials are differentially related to awareness of response errors: evidence from an antisaccade task. , 2001, Psychophysiology.

[144]  Danielle Wilde,et al.  Displaying heart rate data on a bicycle helmet to support social exertion experiences , 2014, TEI '14.

[145]  S. Wessely,et al.  Development of a fatigue scale. , 1993, Journal of psychosomatic research.

[146]  Anton Nijholt,et al.  Usability of Three Electroencephalogram Headsets for Brain-Computer Interfaces: A Within Subject Comparison , 2015, Interact. Comput..

[147]  Kirsten Rassmus-Gröhn,et al.  Supporting presence in collaborative environments by haptic force feedback , 2000, TCHI.

[148]  Stefan Haufe,et al.  The Berlin Brain–Computer Interface: Non-Medical Uses of BCI Technology , 2010, Front. Neurosci..

[149]  Larry Ambrose,et al.  The power of feedback. , 2002, Healthcare executive.

[150]  Regan L. Mandryk,et al.  A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies , 2007, Int. J. Hum. Comput. Stud..

[151]  J. Matias,et al.  Review on psychophysiological methods in game research , 2010 .

[152]  Robert J. K. Jacob,et al.  Using fNIRS brain sensing to evaluate information visualization interfaces , 2013, CHI.

[153]  Yoshifumi Kitamura,et al.  Things happening in the brain while humans learn to use new tools , 2003, CHI '03.

[154]  Jérémy Frey,et al.  Classifying EEG Signals during Stereoscopic Visualization to Estimate Visual Comfort , 2015, Comput. Intell. Neurosci..

[155]  Yang Wang,et al.  GSR and Blink Features for Cognitive Load Classification , 2013, INTERACT.

[156]  Jan B. F. van Erp,et al.  Brain-Based Indices for User System Symbiosis , 2010, Brain-Computer Interfaces.

[157]  Maureen Clerc,et al.  Enhancing visuospatial attention performance with brain-computer interfaces , 2013, CHI Extended Abstracts.

[158]  B. Latour,et al.  'The whole is always smaller than its parts': a digital test of Gabriel Tardes' monads. , 2012, The British journal of sociology.

[159]  Mehmet Göktürk,et al.  Psychophysiological measures of human cognitive states applied in human computer interaction , 2011, WCIT.

[160]  Stephen H. Fairclough,et al.  Use of auditory event-related potentials to measure immersion during a computer game , 2015, Int. J. Hum. Comput. Stud..

[161]  Martin Guthrie,et al.  Easy Rider: Monkeys Learn to Drive a Wheelchair to Navigate through a Complex Maze , 2014, PloS one.

[162]  G. Michael Poor,et al.  Mobility Matters: Identifying Cognitive Demands That Are Sensitive to Orientation , 2013, INTERACT.

[163]  Jonathan Klein,et al.  Frustrating the user on purpose: a step toward building an affective computer , 2002, Interact. Comput..

[164]  Sriram Subramanian,et al.  Comparison of User Performance in Mixed 2D-3D Multi-Display Environments , 2013, INTERACT.

[165]  Clemens Brunner,et al.  Better than random? A closer look on BCI results , 2008 .

[166]  Christine L. Lisetti,et al.  A User-Modeling Approach to Build User's Psycho-Physiological Maps of Emotions using Bio-Sensors , 2006, ROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication.

[167]  Stefan Carmien,et al.  Affective brain-computer interfaces: Psychophysiological markers of emotion in healthy persons and in persons with amyotrophic lateral sclerosis , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[168]  Chen Wang,et al.  Sensing a live audience , 2014, CHI.

[169]  Olga Sourina,et al.  Real-Time EEG-Based Emotion Recognition and Its Applications , 2011, Trans. Comput. Sci..

[170]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[171]  Johan Eriksson,et al.  Effects of interactivity and 3D-motion on mental rotation brain activity in an immersive virtual environment , 2010, CHI.

[172]  Matthew S. Goodwin,et al.  MEASURING AUTONOMIC AROUSAL DURING THERAPY , 2012 .

[173]  S. Nieuwenhuis,et al.  Mental fatigue and task control: planning and preparation. , 2000, Psychophysiology.

[174]  Evangelos Karapanos,et al.  Faceit: supporting reflection upon social anxiety events with lifelogging , 2013, CHI Extended Abstracts.

[175]  Pavlo D. Antonenko,et al.  Using Electroencephalography to Measure Cognitive Load , 2010 .

[176]  Dan Ziegler,et al.  Standardized tests of heart rate variability: normal ranges obtained from 309 healthy humans, and effects of age, gender, and heart rate , 2001, Clinical Autonomic Research.

[177]  Carmen Vidaurre,et al.  BioSig: The Free and Open Source Software Library for Biomedical Signal Processing , 2011, Comput. Intell. Neurosci..

[178]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[179]  Jérémy Frey,et al.  Estimating Visual Comfort in Stereoscopic Displays Using Electroencephalography: A Proof-of-Concept , 2015, INTERACT.

[180]  Paul A. Cairns,et al.  Measuring and defining the experience of immersion in games , 2008, Int. J. Hum. Comput. Stud..

[181]  Christian Kothe,et al.  Towards passive brain–computer interfaces: applying brain–computer interface technology to human–machine systems in general , 2011, Journal of neural engineering.

[182]  Wouter A. Serdijn,et al.  Framework for evaluating EEG signal quality of dry electrode recordings , 2013, 2013 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[183]  Richard M. Leahy,et al.  Brainstorm: A User-Friendly Application for MEG/EEG Analysis , 2011, Comput. Intell. Neurosci..

[184]  Frédo Durand,et al.  Riesz pyramids for fast phase-based video magnification , 2014, 2014 IEEE International Conference on Computational Photography (ICCP).

[185]  Eugenio Rodriguez,et al.  Studying Single-Trials of phase Synchronous Activity in the Brain , 2000, Int. J. Bifurc. Chaos.

[186]  Annemiek Drunen,et al.  Exploring workload and attention measurements with uLog mouse data , 2009, Behavior research methods.

[187]  L. Sörnmo,et al.  Delineation of the QRS complex using the envelope of the e.c.g. , 1983, Medical and Biological Engineering and Computing.

[188]  Tom Carey,et al.  ACM SIGCHI Curricula for Human-Computer Interaction , 1992 .

[189]  Anatole Lécuyer,et al.  An overview of research on "passive" brain-computer interfaces for implicit human-computer interaction , 2010 .

[190]  Maria V. Sanchez-Vives,et al.  How we experience immersive virtual environments: the concept of presence and its measurement * , 2009 .

[191]  Mohammad Soleymani,et al.  Affective Characterization of Movie Scenes Based on Content Analysis and Physiological Changes , 2009, Int. J. Semantic Comput..

[192]  Wojciech Samek,et al.  Transferring Subspaces Between Subjects in Brain--Computer Interfacing , 2012, IEEE Transactions on Biomedical Engineering.

[193]  P. Fitts The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[194]  Yu-Te Wang,et al.  Pervasive brain monitoring and data sharing based on multi-tier distributed computing and linked data technology , 2014, Front. Hum. Neurosci..

[195]  R. Krauss,et al.  Facial and autonomic manifestations of the dimensional structure of emotion , 1984 .

[196]  R. Mccraty,et al.  The Coherent Heart Heart-Brain Interactions, Psychophysiological Coherence, and the Emergence of System-Wide Order , 2009 .

[197]  Mtm Marc Lambooij,et al.  Visual Discomfort and Visual Fatigue of Stereoscopic Displays: A Review , 2009 .

[198]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[199]  Marcus A. Magnor,et al.  EEG analysis of implicit human visual perception , 2012, CHI.

[200]  Clay B. Holroyd,et al.  The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. , 2002, Psychological review.

[201]  Jérémy Frey,et al.  Pointing in Spatial Augmented Reality from 2D Pointing Devices , 2015, INTERACT.

[202]  Hussein A. Abbass,et al.  Neural and Speech Indicators of Cognitive Load for Sudoku Game Interfaces , 2012, ICONIP.

[203]  Chris Van Hoof,et al.  Soft, Comfortable Polymer Dry Electrodes for High Quality ECG and EEG Recording , 2014, Sensors.

[204]  Jérémy Frey,et al.  Framework for Electroencephalography-based Evaluation of User Experience , 2016, CHI.

[205]  J Farley Norman,et al.  Stereoscopic shape discrimination is well preserved across changes in object size. , 2009, Acta psychologica.

[206]  Yves Bestgen,et al.  Un baromètre affectif effectif. Corpus de référence et méthode pour déterminer la valence affective de phrases , 2004 .

[207]  Kazuhiro Kuwabara,et al.  Connectedness oriented communication: fostering a sense of connectedness to augment social relationships , 2002, Proceedings 2002 Symposium on Applications and the Internet (SAINT 2002).

[208]  Klas Ihme,et al.  A Dry EEG-System for Scientific Research and Brain–Computer Interfaces , 2010, Front. Neurosci..

[209]  G. Pfurtscheller,et al.  A fully automated correction method of EOG artifacts in EEG recordings , 2007, Clinical Neurophysiology.

[210]  F. Lotte,et al.  Self-Paced Brain-Computer Interaction with Virtual Worlds: A Quantitative and Qualitative Study "Out of the Lab" , 2008 .

[211]  Doug A. Bowman,et al.  A Survey of Usability Evaluation in Virtual Environments: Classification and Comparison of Methods , 2002, Presence: Teleoperators & Virtual Environments.

[212]  Mansooreh Mollaghasemi,et al.  Usability engineering of virtual environments (VEs): identifying multiple criteria that drive effective VE system design , 2003, Int. J. Hum. Comput. Stud..

[213]  Anton Nijholt,et al.  A Study in User-Centered Design and Evaluation of Mental Tasks for BCI , 2011, MMM.

[214]  Min-Koo Kang,et al.  Feasibility study for visual discomfort assessment on stereo images using EEG , 2012, 2012 International Conference on 3D Imaging (IC3D).

[215]  Ranjana K. Mehta,et al.  Neuroergonomics: a review of applications to physical and cognitive work , 2013, Front. Hum. Neurosci..

[216]  Jrc Jaap Ham,et al.  Making it not too obvious: the effect of ambient light feedback on space heating energy consumption , 2011 .

[217]  Martin Hachet,et al.  A Survey of Interaction Techniques for Interactive 3D Environments , 2013, Eurographics.

[218]  Michael J. Singer,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.

[219]  Chi Thanh Vi,et al.  Detecting error-related negativity for interaction design , 2012, CHI.

[220]  Edward Cutrell,et al.  BCI for passive input in HCI , 2007 .

[221]  Tzyy-Ping Jung,et al.  Real-time modeling and 3D visualization of source dynamics and connectivity using wearable EEG , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[222]  Nilli Lavie,et al.  The role of perceptual load in inattentional blindness , 2007, Cognition.

[223]  André van Schaik,et al.  Giga-Ohm High-Impedance FET Input Amplifiers for Dry Electrode Biosensor Circuits and Systems , 2011 .

[224]  Giovanni Cennini,et al.  Heart rate monitoring via remote photoplethysmography with motion artifacts reduction. , 2010, Optics express.

[225]  S. Kiesler,et al.  Group processes in computer-mediated communication☆ , 1986 .

[226]  J. Russell,et al.  The circumplex model of affect: An integrative approach to affective neuroscience, cognitive development, and psychopathology , 2005, Development and Psychopathology.

[227]  Cuntai Guan,et al.  Regularizing Common Spatial Patterns to Improve BCI Designs: Unified Theory and New Algorithms , 2011, IEEE Transactions on Biomedical Engineering.

[228]  Heinz Jäckel,et al.  Low-Noise Two-Wired Buffer Electrodes for Bioelectric Amplifiers , 2007, IEEE Transactions on Biomedical Engineering.

[229]  Greg Welch,et al.  Shader Lamps: Animating Real Objects With Image-Based Illumination , 2001, Rendering Techniques.

[230]  Peter A. Hancock,et al.  Hedonomics: The Power of Positive and Pleasurable Ergonomics , 2005 .

[231]  Lars Kai Hansen,et al.  The Smartphone Brain Scanner: A Portable Real-Time Neuroimaging System , 2013, PloS one.

[232]  Roozbeh Jafari,et al.  Characterizing contact impedance, signal quality and robustness as a function of the cardinality and arrangement of fingers on dry contact EEG electrodes , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[233]  J. Dichgans,et al.  Differential effects of central versus peripheral vision on egocentric and exocentric motion perception , 1973, Experimental Brain Research.

[234]  Janko Drnovsek,et al.  Non-contact heart rate and heart rate variability measurements: A review , 2014, Biomed. Signal Process. Control..

[235]  Desney S. Tan,et al.  Feasibility and pragmatics of classifying working memory load with an electroencephalograph , 2008, CHI.

[236]  Nicolas Roussel,et al.  1 € filter: a simple speed-based low-pass filter for noisy input in interactive systems , 2012, CHI.

[237]  Alessandro Rizzi,et al.  Assessing stereo blindness and stereo acuity on digital displays , 2014, Displays.

[238]  Klaus-Robert Müller,et al.  Spatio-spectral filters for improving the classification of single trial EEG , 2005, IEEE Transactions on Biomedical Engineering.

[239]  Gordon Cheng,et al.  Design and emotional expressiveness of Gertie (An open hardware robotic desk lamp) , 2012, 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication.

[240]  Klaus-Robert Müller,et al.  Stereoscopic depth increases intersubject correlations of brain networks , 2014, NeuroImage.

[241]  Laura Astolfi,et al.  On the Use of EEG or MEG Brain Imaging Tools in Neuromarketing Research , 2011, Comput. Intell. Neurosci..

[242]  Ravin Balakrishnan,et al.  Sphere: multi-touch interactions on a spherical display , 2008, UIST '08.

[243]  C. Mehring,et al.  Detection of Error Related Neuronal Responses Recorded by Electrocorticography in Humans during Continuous Movements , 2013, PloS one.

[244]  Shou-En Lu,et al.  The effects of workload on respiratory variables in simulated flight: A preliminary study , 2010, Biological Psychology.

[245]  Sean A. Spence,et al.  Descartes' Error: Emotion, Reason and the Human Brain , 1995 .

[246]  Lennart E. Nacke,et al.  Affective Ludology, Flow and Immersion in a First- Person Shooter: Measurement of Player Experience , 2009, ArXiv.

[247]  Vinzenz von Tscharner,et al.  Methodological aspects of EEG and body dynamics measurements during motion , 2014, Front. Hum. Neurosci..

[248]  Dan,et al.  [ACM Press the 15th International Academic MindTrek Conference - Tampere, Finland (2011.09.28-2011.09.30)] Proceedings of the 15th International Academic MindTrek Conference on Envisioning Future Media Environments - MindTrek \'11 - From game design elements to gamefulness , 2011 .

[249]  Kangsoo Kim,et al.  Empa talk: a physiological data incorporated human-computer interactions , 2014, CHI Extended Abstracts.

[250]  Ivan Poupyrev,et al.  3D User Interfaces: Theory and Practice , 2004 .

[251]  Guillaume Chanel,et al.  Emotion Assessment From Physiological Signals for Adaptation of Game Difficulty , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[252]  Masatoshi Okutomi,et al.  A user-friendly method to geometrically calibrate projector-camera systems , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[253]  James R. Lewis,et al.  UMUX-LITE: when there's no time for the SUS , 2013, CHI.

[254]  Bernd Fröhlich,et al.  Collaborative Interaction in Co-Located Two-User Scenarios , 2009, EGVE/ICAT/EuroVR.

[255]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[256]  Rajesh P. N. Rao,et al.  Electrocorticography-based brain computer Interface-the seattle experience , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[257]  D. Kort,et al.  Digital Games as Social Presence Technology: Development of the Social Presence in Gaming Questionnaire (SPGQ) , 2007 .

[258]  Maud Marchal,et al.  The Mind-Mirror: See your brain in action in your head using EEG and augmented reality , 2014, 2014 IEEE Virtual Reality (VR).

[259]  R Chavarriaga,et al.  Learning From EEG Error-Related Potentials in Noninvasive Brain-Computer Interfaces , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[260]  Wijnand A. IJsselsteijn,et al.  The Tell-Tale Heart: Perceived Emotional Intensity of Heartbeats , 2013, Int. J. Synth. Emot..

[261]  Ana L. N. Fred,et al.  Biosignals for Everyone , 2014, IEEE Pervasive Computing.

[262]  Hajime Mushiake,et al.  Bio-amplifier with Driven Shield Inputs to Reduce Electrical Noise and its Application to Laboratory Teaching of Electrophysiology , 2012, Journal of undergraduate neuroscience education : JUNE : a publication of FUN, Faculty for Undergraduate Neuroscience.

[263]  Pim Haselager,et al.  Researchers’ opinions about ethically sound dissemination of BCI research to the public media , 2011 .

[264]  P. Sajda,et al.  Response error correction-a demonstration of improved human-machine performance using real-time EEG monitoring , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[265]  Peter C. Wright,et al.  Empathy and experience in HCI , 2008, CHI.

[266]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[267]  Darryl Charles,et al.  Analyzing player behavior in Pacman using feature-driven decision theoretic predictive modeling , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[268]  Jelle Jolles,et al.  Neuromyths in Education: Prevalence and Predictors of Misconceptions among Teachers , 2012, Front. Psychology.

[269]  Atanas Gotchev,et al.  Relative importance of depth cues on portable autostereoscopic display , 2010, MoViD '10.

[270]  M. Bushnell,et al.  Autonomic responses to heat pain: Heart rate, skin conductance, and their relation to verbal ratings and stimulus intensity , 2011, PAIN®.