MulseBox: Portable Multisensory Interactive Device

This paper presents MulseBox, a new multisensory interactive device, which can simulate real-life situations in order to help learning and transfer of learning in daily-life. Indeed, multisensory interaction is known to improve learning performances. MulseBox can easily be enriched with real objects and virtual objects. It is evolving. MulseBox was designed because the literature highlighted the lack of a unique multisensory device to work on common problematics. Indeed, six disciplines at least are investigating multisensory with the shared secondary objectives to increase users’ Quality of Experience and to design for all (that is taking disabilities into account). MulseBox may also be a test-bed for researchers to solve identified problematics. An exploratory evaluation of acceptability showed promising results which make us think that MulseBox is relevant.

[1]  Mirko Gelsomini,et al.  Playful Supervised Smart Spaces (P3S) -- A Framework for Designing, Implementing and Deploying Multisensory Play Experiences for Children with Special Needs , 2015, 2015 Euromicro Conference on Digital System Design.

[2]  Christian Timmerer,et al.  A test-bed for quality of multimedia experience evaluation of Sensory Effects , 2009, 2009 International Workshop on Quality of Multimedia Experience.

[3]  Gabriel-Miro Muntean,et al.  Perceived Synchronization of Mulsemedia Services , 2015, IEEE Transactions on Multimedia.

[4]  P. Rabardel.  Les hommes et les technologies; approche cognitive des instruments contemporains , 1995 .

[5]  Weisi Lin,et al.  Mulsemedia: State of the Art, Perspectives, and Challenges , 2014, TOMM.

[6]  J. Stroop.  Studies of interference in serial verbal reactions. , 1992 .

[7]  Gabriel-Miro Muntean,et al.  Is Multimedia Multisensorial? - A Review of Mulsemedia Systems , 2018, ACM Comput. Surv..

[8]  Monica Gori,et al.  Developing a pedagogical framework for designing a multisensory serious gaming environment , 2017, MIE@ICMI.

[9]  Débora C. Muchaluat-Saade,et al.  Modeling sensory effects as first-class entities in multimedia applications , 2018, MMSys.

[10]  A. Brem,et al.  Multisensory innovation: Haptic input and its role in product design , 2017, IEEE Engineering Management Review.

[11]  Yevgeniya Sulema,et al.  Mulsemedia vs. Multimedia: State of the art and future trends , 2016, 2016 International Conference on Systems, Signals and Image Processing (IWSSIP).

[12]  Abdenour Bouzouane,et al.  Developing Serious Games Specifically Adapted to People Suffering from Alzheimer , 2012, SGDA.

[13]  Maurizio Murroni,et al.  IoT architecture for multisensorial media , 2017, 2017 IEEE URUCON.

[14]  Richard Prettyman,et al.  Multi-sensory therapy in psychiatric care , 2002 .

[15]  Yi-Bing Lin,et al.  Low-Cost Four-Dimensional Experience Theater Using Home Appliances , 2019, IEEE Transactions on Multimedia.

[16]  Ryohei Nakatsu,et al.  Tongue Mounted Interface for Digitally Actuating the Sense of Taste , 2012, 2012 16th International Symposium on Wearable Computers.

[17]  Celso A. S. Santos,et al.  Coping With the Challenges of Delivering Multiple Sensorial Media , 2019, IEEE MultiMedia.

[18]  J C Chung,et al.  Snoezelen for dementia. , 2002, The Cochrane database of systematic reviews.

[19]  Maurizio Murroni,et al.  Enhancing TV broadcasting services: A survey on mulsemedia quality of experience , 2017, 2017 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB).

[20]  Wei Liu,et al.  Multisensory musical entertainment systems , 2004, IEEE MultiMedia.

[21]  Sujin Lee,et al.  How 4D effects cause different types of presence experience? , 2011, VRCAI '11.

[22]  Carlos Velasco,et al.  Integrating Mid-Air Haptics into Movie Experiences , 2017, TVX.

[23]  Gabriel-Miro Muntean,et al.  Can Multisensorial Media Improve Learner Experience? , 2017, MMSys.

[24]  Ellen Yi-Luen Do,et al.  Tainted: Smell the Virtual Ghost , 2017, Creativity & Cognition.

[25]  Celso A. S. Santos,et al.  PlaySEM: a Platform for Rendering MulSeMedia Compatible with MPEG-V , 2015, WebMedia.

[26]  Marianna Obrist.  Mastering the Senses in HCI: Towards Multisensory Interfaces , 2017, CHItaly.

[27]  Chi Thanh Vi,et al.  Multisensory Experiences in HCI , 2017, IEEE MultiMedia.

[28]  Raúl Casillas Figueroa.  Personal spaces for multisensory stimulation as support to rehabilitate patients with cognitive disabilities , 2017, Interacción.

[29]  John P. Wilson.  The Transfer of Learning: Participants' Perspectives of Adult Education and Training , 2007 .

[30]  George Ghinea,et al.  A user perspective of olfaction-enhanced mulsemedia , 2010, MEDES.

[31]  Sarah Tomaszewski Farias,et al.  The relationship between neuropsychological performance and daily functioning in individuals with Alzheimer's disease: ecological validity of neuropsychological tests. , 2003, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[32]  Sriram Subramanian,et al.  Emotions Mediated Through Mid-Air Haptics , 2015, CHI.

[33]  Gabriel-Miro Muntean,et al.  Quality of experience study for multiple sensorial media delivery , 2014, 2014 International Wireless Communications and Mobile Computing Conference (IWCMC).

[34]  Marvin M Chun,et al.  Concurrent working memory load can reduce distraction. , 2005, Proceedings of the National Academy of Sciences of the United States of America.