Applications of Optical Neuroimaging in Usability Research

In this article we review recent and potential applications of optical neuroimaging to human factors and usability research. We focus specifically on functional near-infrared spectroscopy (fNIRS) because of its cost-effectiveness and ease of implementation. Researchers have used fNIRS to assess a range of psychological phenomena relevant to human factors, such as cognitive workload, attention, motor activity, and more. It offers the opportunity to measure hemodynamic correlates of mental activity during task completion in human factors and usability studies. We also consider some limitations and future research directions.

[1]  Arezou Akbarian Azar.  Stimulus level estimation using functional near-infra-red data and neural network. , 2009, Conference proceedings : ... Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual Conference.

[2]  Robert J. K. Jacob,et al.  Using fNIRS brain sensing to evaluate information visualization interfaces , 2013, CHI.

[3]  Matthew Pike,et al.  Examining the Reliability of Using fNIRS in Realistic HCI Settings for Spatial and Verbal Tasks , 2015, CHI.

[4]  C. Vaidya,et al.  Sensitivity of fNIRS to cognitive state and load , 2014, Front. Hum. Neurosci..

[5]  Hasan Ayaz,et al.  Optical brain monitoring for operator training and mental workload assessment , 2012, NeuroImage.

[6]  Marco Ferrari,et al.  A brief review on the history of human functional near-infrared spectroscopy (fNIRS) development and fields of application , 2012, NeuroImage.

[7]  Martin Porcheron,et al.  Measuring the effect of think aloud protocols on workload using fNIRS , 2014, CHI.

[8]  Robert J. K. Jacob,et al.  This is your brain on interfaces: enhancing usability testing with functional near-infrared spectroscopy , 2011, CHI.

[9]  Ann-Christine Ehlis,et al.  Implicit emotion regulation in the presence of threat: Neural and autonomic correlates , 2014, NeuroImage.

[10]  Xu Cui,et al.  NIRS-based hyperscanning reveals increased interpersonal coherence in superior frontal cortex during cooperation , 2012, NeuroImage.

[11]  Sebastian Möller,et al.  Using fNIRS to Characterize Human Perception of TTS System Quality , Comprehension , and Fluency : Preliminary Findings , 2013 .

[12]  Robert J. K. Jacob,et al.  Designing a passive brain computer interface using real time classification of functional near-infrared spectroscopy , 2013, Int. J. Auton. Adapt. Commun. Syst..

[13]  Gary H. Glover,et al.  A quantitative comparison of NIRS and fMRI across multiple cognitive tasks , 2011, NeuroImage.

[14]  Jeannette R. Mahoney,et al.  fNIRS study of walking and walking while talking in young and old individuals. , 2011, The journals of gerontology. Series A, Biological sciences and medical sciences.

[15]  Martin Wolf,et al.  Task complexity relates to activation of cortical motor areas during uni- and bimanual performance: A functional NIRS study , 2009, NeuroImage.

[16]  Thibault Gateau,et al.  Real-Time State Estimation in a Flight Simulator Using fNIRS , 2015, PloS one.

[17]  S. Fairclough,et al.  Activation of the rostromedial prefrontal cortex during the experience of positive emotion in the context of esthetic experience. An fNIRS study , 2013, Frontiers in Human Neuroscience.

[18]  R. Parasuraman,et al.  Continuous monitoring of brain dynamics with functional near infrared spectroscopy as a tool for neuroergonomic research: empirical examples and a technological development , 2013, Front. Hum. Neurosci..

[19]  J. Schunk,et al.  Neuroenergetics Original Research Article , 2022 .

[20]  Sebastian Möller,et al.  Neurophysiological experimental facility for Quality of Experience (QoE) assessment , 2013, 2013 IFIP/IEEE International Symposium on Integrated Network Management (IM 2013).

[21]  Nir Giladi,et al.  Increased frontal brain activation during walking while dual tasking: an fNIRS study in healthy young adults , 2014, Journal of NeuroEngineering and Rehabilitation.

[22]  R. Poldrack.  Can cognitive processes be inferred from neuroimaging data? , 2006, Trends in Cognitive Sciences.

[23]  Robert J. K. Jacob,et al.  Using fNIRS brain sensing in realistic HCI settings: experiments and guidelines , 2009, UIST '09.

[24]  Louise Venables,et al.  The influence of task demand and learning on the psychophysiological response. , 2005, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[25]  Daniel Afergan,et al.  Investigation of fNIRS brain sensing as input to information filtering systems , 2013, AH.

[26]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .