Towards adaptive user interfaces using real time fNIRS

......................................................................................................... ii Acknowledgements ........................................................................................ iv Table of

[1]  P. Tsang,et al.  Diagnosticity and multidimensional subjective workload ratings. , 1996, Ergonomics.

[2]  Yushiro Yamashita,et al.  Prefrontal cerebral blood volume patterns while playing video games—A near-infrared spectroscopy study , 2006, Brain and Development.

[3]  Masayoshi Kurachi,et al.  Activation of the prefrontal cortex during memory learning: Near‐infrared spectroscopy study , 2007, Psychiatry and clinical neurosciences.

[4]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[5]  Erin M. Nishimura,et al.  A new approach to functional near-infrared technology , 2007, IEEE Engineering in Medicine and Biology Magazine.

[6]  Edward Cutrell,et al.  BCI for passive input in HCI , 2007 .

[7]  Erich E. Sutter,et al.  The brain response interface: communication through visually-induced electrical brain responses , 1992 .

[8]  Robert J. K. Jacob,et al.  Distinguishing Difficulty Levels with Non-invasive Brain Activity Measurements , 2009, INTERACT.

[9]  D. Fuller,et al.  Measurement of the EMG-force relationship in a human upper airway muscle. , 1995, Journal of applied physiology.

[10]  Charles W. Anderson,et al.  Classification of EEG Signals from Four Subjects During Five Mental Tasks , 2007 .

[11]  Tania S. Douglas,et al.  Motion Artifact Removal for Functional Near Infrared Spectroscopy: A Comparison of Methods , 2010, IEEE Transactions on Biomedical Engineering.

[12]  C. Markham,et al.  Hemodynamics for Brain-Computer Interfaces , 2008, IEEE Signal Processing Magazine.

[13]  S. Bunce,et al.  Functional near-infrared neuroimaging , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[14]  S. Bunce,et al.  Functional Brain Imaging Using Near-Infrared Technology Assessing Cognitive Activity in Real-Life Situations , 2007 .

[15]  Thorsten O. Zander,et al.  Enhancing Human-Computer Interaction with Input from Active and Passive Brain-Computer Interfaces , 2010, Brain-Computer Interfaces.

[16]  Marko Turpeinen,et al.  Designing Biofeedback for Games and Playful Applications , 2010 .

[17]  Atsushi Maki,et al.  Simultaneous Recording of Event-Related Auditory Oddball Response Using Transcranial Near Infrared Optical Topography and Surface EEG , 2002, NeuroImage.

[18]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[19]  S. Zeki,et al.  Regional changes in cerebral haemodynamics as a result of a visual stimulus measured by near infrared spectroscopy , 1995, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[20]  Johan Eriksson,et al.  Effects of interactivity and 3D-motion on mental rotation brain activity in an immersive virtual environment , 2010, CHI.

[21]  Melody Moore Jackson,et al.  An fNIR based BMI for letter construction using continuous control , 2009, CHI Extended Abstracts.

[22]  Birsen Yazici,et al.  Human performance assessment using fNIR , 2005, SPIE Defense + Commercial Sensing.

[23]  Thomas E. Nichols,et al.  Activation of the medial prefrontal cortex and extended amygdala by individual ratings of emotional arousal: a fMRI study , 2003, Biological Psychiatry.

[24]  Christos Faloutsos,et al.  FTW: fast similarity search under the time warping distance , 2005, PODS.

[25]  S. Coyle,et al.  Physiological noise in near-infrared spectroscopy: implications for optical brain computer interfacing , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[26]  Brendan Z. Allison,et al.  Workload assessment of computer gaming using a single-stimulus event-related potential paradigm , 2008, Biological Psychology.

[27]  David A. Kobus,et al.  Overview of the DARPA Augmented Cognition Technical Integration Experiment , 2004, Int. J. Hum. Comput. Interact..

[28]  C. Frith,et al.  Brain regions involved in prospective memory as determined by positron emission tomography , 2001, Neuropsychologia.

[29]  Zhiwei Zhu,et al.  Non-Intrusive Measurement of Workload in Real-Time , 2005 .

[30]  Robert J. K. Jacob,et al.  What you look at is what you get: eye movement-based interaction techniques , 1990, CHI '90.

[31]  Kari Kallinen,et al.  The effects of background music on using a pocket computer in a cafeteria: immersion, emotional responses, and social richness of medium , 2004, CHI EA '04.

[32]  Sandra P. Marshall,et al.  Integrating psychophysiological measures of cognitive workload and eye movements to detect strategy shifts , 2003, 36th Annual Hawaii International Conference on System Sciences, 2003. Proceedings of the.

[33]  Antti Poikola,et al.  Invisible eni: using gaze and pupil size to control a game , 2008, CHI Extended Abstracts.

[34]  Jenova Chen,et al.  Flow in games (and everything else) , 2007, CACM.

[35]  Takeshi Komori,et al.  Frontal Lobe Activity during the Performance of Spatial Tasks: fNIRS Study , 2008 .

[36]  Ann-Christine Ehlis,et al.  Reduced lateral prefrontal activation in adult patients with attention-deficit/hyperactivity disorder (ADHD) during a working memory task: a functional near-infrared spectroscopy (fNIRS) study. , 2008, Journal of psychiatric research.

[37]  Nicolas Roussel,et al.  Effect of Peripheral Communication Pace on Attention Allocation in a Dual-Task Situation , 2009, INTERACT.

[38]  Q. Luo,et al.  Gender difference in hemodynamic responses of prefrontal area to emotional stress by near-infrared spectroscopy , 2007, Behavioural Brain Research.

[39]  B. Chance,et al.  Cognition-activated low-frequency modulation of light absorption in human brain. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[40]  M.M. Moore,et al.  Real-world applications for brain-computer interface technology , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[41]  Kurtulus Izzetoglu,et al.  Differential time course and intensity of PFC activation for men and women in response to emotional stimuli: A functional near-infrared spectroscopy (fNIRS) study , 2006, Neuroscience Letters.

[42]  José del R. Millán,et al.  Adaptive brain interfaces , 2003, Commun. ACM.

[43]  José del R. Millán,et al.  The IDIAP Brain-Computer Interface: An Asynchronous Multiclass Approach , 2007 .

[44]  N. Mukawa,et al.  Brain Activity Comparison of Different-Genre Video Game Players , 2007, Second International Conference on Innovative Computing, Informatio and Control (ICICIC 2007).

[45]  Gisela Susanne Bahr,et al.  Brain computer interfaces: psychology and pragmatic perspectives for the future. , 2008 .

[46]  Desney S. Tan,et al.  Feasibility and pragmatics of classifying working memory load with an electroencephalograph , 2008, CHI.

[47]  José del R. Millán,et al.  BioSig: An Open-Source Software Library for BCI Research , 2007 .

[48]  M. Tanida,et al.  Relation between mental stress-induced prefrontal cortex activity and skin conditions: A near-infrared spectroscopy study , 2007, Brain Research.

[49]  Glenn F. Wilson,et al.  Real-Time Assessment of Mental Workload Using Psychophysiological Measures and Artificial Neural Networks , 2003, Hum. Factors.

[50]  E. Watanabe,et al.  Spatial and temporal analysis of human motor activity using noninvasive NIR topography. , 1995, Medical physics.

[51]  K. Hiraki,et al.  Prefrontal Cortex Deactivation During Video Game Play , 2005 .

[52]  Wen-Hung Huang,et al.  Effects of music tempo and task difficulty on multi-attribute decision-making: An eye-tracking approach , 2009, Comput. Hum. Behav..

[53]  F. Thomas Eggemeier,et al.  Workload assessment methodology. , 1986 .

[54]  Dina Q. Goldin,et al.  On Similarity Queries for Time-Series Data: Constraint Specification and Implementation , 1995, CP.

[55]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[56]  Desney S. Tan,et al.  Using a low-cost electroencephalograph for task classification in HCI research , 2006, UIST.

[57]  Kazuo Hiraki,et al.  Sustained decrease in oxygenated hemoglobin during video games in the dorsal prefrontal cortex: A NIRS study of children , 2006, NeuroImage.

[58]  Hanli Liu,et al.  Functional near-infrared spectroscopy to investigate hemodynamic responses to deception in the prefrontal cortex , 2009, Brain Research.

[59]  Amir Raz,et al.  Ecological nuances in functional magnetic resonance imaging (fMRI): psychological stressors, posture, and hydrostatics , 2005, NeuroImage.

[60]  Jürgen S. Sauer,et al.  Cognitive Demands of Collision Avoidance in Simulated Ship Control , 2003, Hum. Factors.

[61]  A. Owen,et al.  Anterior prefrontal cortex: insights into function from anatomy and neuroimaging , 2004, Nature Reviews Neuroscience.

[62]  Laura Pickup,et al.  The Integrated Workload Scale (IWS): a new self-report tool to assess railway signaller workload. , 2005, Applied ergonomics.

[63]  Paul C. Fletcher,et al.  Anterior prefrontal cortex and the recollection of contextual information , 2005, Neuropsychologia.

[64]  Meltem Izzetoglu,et al.  Motion artifact cancellation in NIR spectroscopy using Wiener filtering , 2005, IEEE Transactions on Biomedical Engineering.

[65]  Paul Pauli,et al.  Brain activation for alertness measured with functional near infrared spectroscopy (fNIRS). , 2008, Psychophysiology.

[66]  J G Hollands,et al.  ENGINEERING PSYCHOLOGY AND HUMAN PERFORMANCE - THIRD EDITION , 2000 .

[67]  Mark H. Chignell,et al.  Mental workload dynamics in adaptive interface design , 1988, IEEE Trans. Syst. Man Cybern..

[68]  James Alty.  Cognitive Workload and Adaptive Systems , 2003 .

[69]  A. Kok.  Event-related-potential (ERP) reflections of mental resource̊s: a review and synthesis , 1997, Biological Psychology.

[70]  James Tompkin,et al.  A novel brain-computer interface using a multi-touch surface , 2010, CHI.

[71]  Ian Daly,et al.  Towards natural human computer interaction in BCI , 2008 .

[72]  A. Toga,et al.  Mapping brain asymmetry , 2003, Nature Reviews Neuroscience.

[73]  Ellen S. Wilschut,et al.  Brain–machine interfaces in space: Using spontaneous rather than intentionally generated brain signals , 2010 .

[74]  Richard A. Mason,et al.  Prefrontal hemodynamic activity predicts false memory—A near-infrared spectroscopy study , 2006, NeuroImage.

[75]  Guillaume Chanel,et al.  Boredom, engagement and anxiety as indicators for adaptation to difficulty in games , 2008, MindTrek '08.

[76]  Robert J. K. Jacob,et al.  Brain measurement for usability testing and adaptive interfaces: an example of uncovering syntactic workload with functional near infrared spectroscopy , 2009, CHI.

[77]  Robert J. K. Jacob,et al.  Eye Movement-Based Human-Computer Interaction Techniques: Toward Non-Command Interfaces , 2003 .

[78]  Robert J. K. Jacob,et al.  From Brain Signals to Adaptive Interfaces: Using fNIRS in HCI , 2010, Brain-Computer Interfaces.

[79]  Bülent Sankur,et al.  Spectral Analysis of Event-Related Hemodynamic Responses in Functional Near Infrared Spectroscopy , 2005, Journal of Computational Neuroscience.

[80]  A. Villringer,et al.  Non-invasive optical spectroscopy and imaging of human brain function , 1997, Trends in Neurosciences.

[81]  E. Koechlin,et al.  Dissociating the role of the medial and lateral anterior prefrontal cortex in human planning. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[82]  José del R. Millán,et al.  Evaluation Criteria for BCI Research , 2007 .

[83]  Sohee Park,et al.  Verbal creativity and schizotypal personality in relation to prefrontal hemispheric laterality: A behavioral and near-infrared optical imaging study , 2005, Schizophrenia Research.

[84]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[85]  Mustapha Mouloua,et al.  Effects of Adaptive Task Allocation on Monitoring of Automated Systems , 1996, Hum. Factors.

[86]  Hiroshi Ishii,et al.  Token+constraint systems for tangible interaction with digital information , 2005, TCHI.

[87]  José del R. Millán,et al.  Graz-Brain-Computer Interface: State of Research , 2007 .

[88]  Motoki Oda,et al.  Changes of cerebral blood oxygenation and optical pathlength during activation and deactivation in the prefrontal cortex measured by time-resolved near infrared spectroscopy. , 2006, Life sciences.

[89]  Hasan Ayaz,et al.  Assessment of Cognitive Neural Correlates for a Functional Near Infrared-Based Brain Computer Interface System , 2009, HCI.

[90]  Brian P. Bailey,et al.  Categories & Subject Descriptors: H.5.2 [Information , 2022 .

[91]  Meltem Izzetoglu,et al.  Detecting deception in the brain: a functional near-infrared spectroscopy study of neural correlates of intentional deception , 2005, SPIE Smart Structures and Materials + Nondestructive Evaluation and Health Monitoring.

[92]  Evan D. Rapoport,et al.  Functional Near-Infrared Sensing (fNIR) and Environmental Control Applications , 2010, Brain-Computer Interfaces.

[93]  M. Leanne,et al.  Human-Computer Interaction and Brain Measurement Using Functional Near-Infrared Spectroscopy , 2007 .

[94]  Tom Chau,et al.  Decoding subjective preference from single-trial near-infrared spectroscopy signals , 2009, Journal of neural engineering.

[95]  Michael E. Smith,et al.  Neurophysiological measures of cognitive workload during human-computer interaction , 2003 .

[96]  Britton Chance,et al.  Functional Optical Brain Imaging Using Near-Infrared During Cognitive Tasks , 2004, Int. J. Hum. Comput. Interact..

[97]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[98]  P. Rolfe,et al.  In vivo near-infrared spectroscopy. , 2000, Annual review of biomedical engineering.

[99]  Theodore J. Huppert,et al.  Real-time imaging of human brain function by near-infrared spectroscopy using an adaptive general linear model , 2009, NeuroImage.

[100]  Anton Nijholt,et al.  Turning Shortcomings into Challenges: Brain-Computer Interfaces for Games , 2009, INTETAIN.

[101]  José del R. Millán,et al.  Brain-actuated interaction , 2004, Artif. Intell..

[102]  Joseph T. Coyne,et al.  Applying Real Time Physiological Measures of Cognitive Load to Improve Training , 2009, HCI.

[103]  Z. Keirn,et al.  A new mode of communication between man and his surroundings , 1990, IEEE Transactions on Biomedical Engineering.

[104]  Graham J Hole,et al.  How to Design and Report Experiments , 2002 .

[105]  R. Elliott,et al.  Response inhibition and impulsivity: an fMRI study , 2003, Neuropsychologia.

[106]  Cuntai Guan,et al.  Temporal classification of multichannel near-infrared spectroscopy signals of motor imagery for developing a brain–computer interface , 2007, NeuroImage.

[107]  Shirley M Coyle,et al.  Brain–computer interface using a simplified functional near-infrared spectroscopy system , 2007, Journal of neural engineering.

[108]  Kiyoto Kasai,et al.  Multiple-time replicability of near-infrared spectroscopy recording during prefrontal activation task in healthy men , 2007, Neuroscience Research.

[109]  Desney S. Tan,et al.  Brain, body and bytes: psychophysiological user interaction , 2010, CHI EA '10.

[110]  Donald J. Berndt,et al.  Finding Patterns in Time Series: A Dynamic Programming Approach , 1996, Advances in Knowledge Discovery and Data Mining.

[111]  D. V. Cramon,et al.  Investigating the post-stimulus undershoot of the BOLD signal—a simultaneous fMRI and fNIRS study , 2006, NeuroImage.

[112]  Robert Oostenveld,et al.  MATLAB-Based Tools for BCI Research , 2010, Brain-Computer Interfaces.

[113]  Thomas G. Dietterich.  Machine Learning for Sequential Data: A Review , 2002, SSPR/SPR.

[114]  Tao Lin,et al.  Do physiological data relate to traditional usability indexes? , 2005, OZCHI.

[115]  Wendy Ju,et al.  The Design of Implicit Interactions: Making Interactive Systems Less Obnoxious , 2008, Design Issues.

[116]  S. Cerutti,et al.  Non-invasive neuroimaging: Generalized Linear Models for interpreting functional Near Infrared Spectroscopy signals , 2007, 2007 3rd International IEEE/EMBS Conference on Neural Engineering.

[117]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[118]  Stephen H. Fairclough,et al.  A research agenda for physiological computing , 2004, Interact. Comput..

[119]  B. Chance,et al.  A novel method for fast imaging of brain function, non-invasively, with light. , 1998, Optics express.

[120]  Brian P. Bailey,et al.  Towards an index of opportunity: understanding changes in mental workload during task execution , 2004, CHI.

[121]  Roel Vertegaal,et al.  Towards a Physiological Model of User Interruptability , 2007, INTERACT.

[122]  Nobuto Fujii,et al.  Brain activity during playing video game correlates with player level , 2008, ACE '08.

[123]  Ambuj K. Singh,et al.  Similarity searching for multi-attribute sequences , 2002, Proceedings 14th International Conference on Scientific and Statistical Database Management.

[124]  Alessandro Torricelli,et al.  Bilateral prefrontal cortex oxygenation responses to a verbal fluency task: a multichannel time-resolved near-infrared topography study. , 2005, Journal of biomedical optics.

[125]  Yunjie Tong,et al.  Spatially weighted BOLD signal for comparison of functional magnetic resonance imaging and near-infrared imaging of the brain , 2006, NeuroImage.

[126]  Mathias Benedek,et al.  Creativity meets neuroscience: experimental tasks for the neuroscientific study of creative thinking. , 2007, Methods.

[127]  Robert J. K. Jacob,et al.  Combining Electroencephalograph and Functional Near Infrared Spectroscopy to Explore Users' Mental Workload , 2009, HCI.

[128]  S. Bunce,et al.  fNIR spectroscopy as a measure of cognitive task load , 2003, Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439).

[129]  Klaus-Robert Müller,et al.  Berlin Brain-Computer Interface - The HCI communication channel for discovery , 2007, Int. J. Hum. Comput. Stud..

[130]  Ann-Christine Ehlis,et al.  Enhancement of activity of the primary visual cortex during processing of emotional stimuli as measured with event‐related functional near‐infrared spectroscopy and event‐related potentials , 2008, Human brain mapping.

[131]  Ehud Sharlin,et al.  Using bio-electrical signals to influence the social behaviours of domesticated robots , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[132]  Jan Kallenbach,et al.  Measuring Interaction Experiences : Integration of Multiple Psychophysiological Methods , 2010 .

[133]  Robert J. K. Jacob,et al.  Using fNIRS brain sensing in realistic HCI settings: experiments and guidelines , 2009, UIST '09.

[134]  J. M. Peter,et al.  The Efficacy of Psychophysiological Measures for Implementing Adaptive Technology , 2001 .

[135]  Glenn F. Wilson,et al.  Performance Enhancement in an Uninhabited Air Vehicle Task Using Psychophysiologically Determined Adaptive Aiding , 2007, Hum. Factors.

[136]  Kenneth W. Bauer,et al.  Improving pilot mental workload classification through feature exploitation and combination: a feasibility study , 2005, Comput. Oper. Res..

[137]  D. Yves von Cramon,et al.  Shortening intertrial intervals in event-related cognitive studies with near-infrared spectroscopy , 2004, NeuroImage.

[138]  Yoshihiro Tanaka,et al.  Anticipatory anxiety-induced changes in human lateral prefrontal cortex activity , 2007, Biological Psychology.

[139]  A. Villringer,et al.  Near infrared spectroscopy (NIRS): A new tool to study hemodynamic changes during activation of brain function in human adults , 1993, Neuroscience Letters.

[140]  Earl L. Wiener,et al.  Human factors of advanced technology (glass cockpit) transport aircraft , 1989 .

[141]  Stephen H. Fairclough,et al.  Fundamentals of physiological computing , 2009, Interact. Comput..

[142]  Junichiro Wakatsuki,et al.  Changes in Concentration of Oxygenated Hemoglobin in the Prefrontal Cortex while Absorbed in Listening to Music , 2009, 2009 International Conference on Biometrics and Kansei Engineering.

[143]  M. Sawan,et al.  A New Brain Imaging Device Based on fNIRS , 2007, 2007 IEEE Biomedical Circuits and Systems Conference.

[144]  J. Leon-Carrion,et al.  A lasting post-stimulus activation on dorsolateral prefrontal cortex is produced when processing valence and arousal in visual affective stimuli , 2007, Neuroscience Letters.

[145]  Susana Rubio,et al.  Evaluation of Subjective Mental Workload: A Comparison of SWAT, NASA‐TLX, and Workload Profile Methods , 2004 .

[146]  G. Wilson,et al.  Cognitive task classification based upon topographic EEG data , 1995, Biological Psychology.