Implicit Engagement Detection for Interactive Museums Using Brain-Computer Interfaces

A rich museum experience is one that is engaging, educating and enjoyable to the visitors, such experiences can only be achieved by personalizing and enriching the museum experience according to the visitor's state. Neural signals from the brain can provide information about the affective and cognitive state of the person implicitly. With the rise of commercial Brain-Computer Interface devices, this technology can be utilized in extracting information to adapt various experiences to the state of the person. We propose a concept and preliminary study which uses brain signals from commercial grade Brain-Computer Interface (BCI) devices to implicitly detect museum visitors' engagement in the exhibited objects. Our concept and output of the study envision an experience where real time feedback based on visitors engagement is provided and the whole museum experience is tailored to each visitor's taste. In future work, we aim to gain external validity by testing our prototype in a museum setting.

[1]  Antonis A. Argyros,et al.  PaperView: augmenting physical surfaces with location-aware digital information , 2010, TEI.

[2]  J. H. Gilmore,et al.  Welcome to the experience economy. , 1998, Harvard business review.

[3]  Qing Zhang,et al.  Analysis of positive and negative emotions in natural scene using brain activity and GIST , 2009, Neurocomputing.

[4]  Sherry Hsi,et al.  RFID enhances visitors' museum experience at the Exploratorium , 2005, CACM.

[5]  C. Camarero,et al.  Visitors' experience, mood and satisfaction in a heritage context: evidence from an interpretation center. , 2008 .

[6]  S. Pan-ngum,et al.  Brain signal detection methodology for attention training using minimal EEG channels , 2012, 2012 Tenth International Conference on ICT and Knowledge Engineering.

[7]  Stefan Schneegass,et al.  Exploring Exhibits: Interactive Methods for Enriching Cultural Heritage Items , 2014 .

[8]  Keith W. Brawner,et al.  Efficacy of Measuring Engagement during Computer-Based Training with Low-Cost Electroencephalogram (EEG) Sensor Outputs , 2012 .

[9]  A. Pope,et al.  Biocybernetic system evaluates indices of operator engagement in automated task , 1995, Biological Psychology.

[10]  John J. B. Allen,et al.  Frontal EEG asymmetry, emotion, and psychopathology: the first, and the next 25 years , 2004, Biological Psychology.

[11]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[12]  Lars Schmidt-Thieme,et al.  RFID-Enhanced Museum for Interactive Experience , 2011, MM4CH.

[13]  C. Joyce,et al.  Automatic removal of eye movement and blink artifacts from EEG data using blind component separation. , 2004, Psychophysiology.

[14]  Markus Funk,et al.  MediaBrain: Annotating Videos based on Brain-Computer Interaction , 2012, Mensch & Computer.

[15]  Joonho Kwon,et al.  NeuroWander: a BCI game in the form of interactive fairy tale , 2010, UbiComp '10 Adjunct.

[16]  Jonathan P. Bowen,et al.  Personalization And The Web From A Museum Perspective , 2013 .

[17]  J. Russell A circumplex model of affect. , 1980 .

[18]  Juan E. Gilbert,et al.  Let's learn!: enhancing user's engagement levels through passive brain-computer interfaces , 2013, CHI Extended Abstracts.

[19]  Jie Liu,et al.  FOCUS: enhancing children's engagement in reading by using contextual BCI training sessions , 2014, CHI.

[20]  Eva Hornecker,et al.  “I don’t understand it either, but it is cool” - visitor interactions with a multi-touch table in a museum , 2008, 2008 3rd IEEE International Workshop on Horizontal Interactive Human Computer Systems.

[21]  Lora Aroyo,et al.  A personalized walk through the museum: the CHIP interactive tour guide , 2009, CHI Extended Abstracts.

[22]  Antonis A. Argyros,et al.  A Prototypical Interactive exhibition for the Archaeological Museum of Thessaloniki , 2013 .

[23]  Bilge Mutlu,et al.  Pay attention!: designing adaptive agents that monitor and improve user engagement , 2012, CHI.