Vibrotactile and vibroacoustic communications: pairs in interaction and play—an interactive structure and bodies in an urban environment

AbstractWe designed a vibrotactile vest and The Humming Wall, a vibroacoustic interactive furniture set in an urban environment to interact with each other. We developed the vibrotactile patterns in the vest as a form of vibrotactile language to convey information to the wearer. In addition, we designed a set of interactive movements on The Humming Wall that would trigger patterns on the vest and elicit sensations and encourage body movements onto the wearer’s body. We invited people to interact in pairs at The Humming Wall, with one at the wall and one wearing the vest (they later swapped roles). Actions by the one at the wall, such as swiping or knocking on the wall were repeated on the vest wearer’s body. In addition, participants could ‘feel’ (vibroacoustically) and hear their own heartbeats and breath rates at the wall. We conducted a field trial with 39 participants over a 5-week period. Participants wearing the vest (and their pair) completed a set of tasks. We logged use and responses, recorded all activities on video and conducted post-experiment interviews and questionnaires. The results depicted the participants’ experience, communication and connection while wearing the vibrotactile vest and interacting with the wall. The findings show convincing, strong and positive responses to novel interactions between the responsive vibroacoustic environment and the vibrotactile vest. This work constitutes the first field trial with people ‘working’ in pairs with a vibrotactile wearable responding to and driving vibroacoustic displays with an interactive vibroacoustic environment.

[1]  Wijnand A. IJsselsteijn,et al.  The Virtual Midas Touch: Helping Behavior After a Mediated Social Touch , 2009, IEEE Trans. Haptics.

[2]  Hiroshi Ishii,et al.  Design of haptic interfaces for therapy , 2009, CHI.

[3]  Ann Morrison,et al.  First Insights with a Vibrotactile Interface for Children with Multiple Disabilities , 2015, CHI Extended Abstracts.

[4]  E. Deci,et al.  The "What" and "Why" of Goal Pursuits: Human Needs and the Self-Determination of Behavior , 2000 .

[5]  H. Olausson,et al.  The skin as a social organ , 2010, Experimental Brain Research.

[6]  Ann Morrison,et al.  Vibrotactile and vibroacoustic interventions into health and well-being , 2018, Universal Access in the Information Society.

[7]  Youngwoo Park,et al.  How do couples use CheekTouch over phone calls? , 2012, CHI.

[8]  Bea Tiemens,et al.  Music-assisted relaxation to improve sleep quality: meta-analysis. , 2009, Journal of advanced nursing.

[9]  Ann Morrison,et al.  Designing a Vibrotactile Language for a Wearable Vest , 2015, HCI.

[10]  Eha Rüütel,et al.  The Experience of Vibroacoustic Therapy in the Therapeutic Intervention of Adolescent Girls , 2004 .

[11]  F. A. Geldard,et al.  The Cutaneous "Rabbit": A Perceptual Illusion , 1972, Science.

[12]  Roshan Lalintha Peiris,et al.  Huggy Pajama: a mobile parent and child hugging communication system , 2008, IDC.

[13]  Klaus W. Lange,et al.  Good Vibrations – Effects of Whole Body Vibration on Attention in Healthy Individuals and Individuals with ADHD , 2014, PloS one.

[14]  Matthew Chan,et al.  CalmMeNow: exploratory research and design of stress mitigating mobile interventions , 2011, CHI Extended Abstracts.

[15]  Mia Pless,et al.  Effects of Motor Skill Intervention on Developmental Coordination Disorder: A Meta-Analysis , 2000 .

[16]  Hsien-Tsai Wu,et al.  Assessment of the impact of acupuncture on peripheral blood flow with multi-channel photoplethysmography , 2014, 2014 IEEE International Conference on Electron Devices and Solid-State Circuits.

[17]  Walter D. Potter,et al.  Vibrotactile Glove guidance for semi-autonomous wheelchair operations , 2008, ACM-SE 46.

[18]  Eha Rüütel M. Sc. The Psychophysiological Effects of Music and Vibroacoustic Stimulation , 2002 .

[19]  Oscar Tomico,et al.  Tactile Dialogues: Personalization of Vibrotactile Behavior to Trigger Interpersonal Communication , 2015, TEI.

[20]  Hua Wang,et al.  Study on Heartbeat Information Acquired from Pressure Cushion Based on Body Sensor Network , 2013, 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing.

[21]  Ravinder Dahiya,et al.  Robotic Tactile Sensing: Technologies and System , 2012 .

[22]  Seungmoon Choi,et al.  Vibrotactile Display: Perception, Technology, and Applications , 2013, Proceedings of the IEEE.

[23]  Maurizio Valle,et al.  Tactile Sensing Technologies , 2013 .

[24]  Anton Nijholt,et al.  Audio-tactile stimulation: a tool to improve health and well-being? , 2013, Int. J. Auton. Adapt. Commun. Syst..

[25]  Fei Tang,et al.  Development of a low-cost tactile sleeve for autism intervention , 2014, 2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games (HAVE) Proceedings.

[26]  Koen van Boerdonk,et al.  Contact through canvas: an entertaining encounter , 2009, Personal and Ubiquitous Computing.

[27]  T. Field Touch for Socioemotional and Physical Well-Being: A Review. , 2010 .

[28]  J. Loewy,et al.  The Effects of Music Therapy on Vital Signs, Feeding, and Sleep in Premature Infants , 2013, Pediatrics.

[29]  Martin R. Gibbs,et al.  Hug over a distance , 2005, CHI Extended Abstracts.

[30]  D. Neumann,et al.  Comprar Kinesiology of the Musculoskeletal System, 2nd Edition. Foundations for Rehabilitation | Donald A. Neumann | 9780323039895 | Mosby , 2009 .

[31]  Ann Morrison,et al.  Follow the vibes: A comparison between two tactile displays in a navigation task in the field , 2016, PsychNology J..

[32]  P. Anderson Touching: The Human Significance of the Skin , 1978 .

[33]  Sethuraman Panchanathan,et al.  MOVeMENT: A framework for systematically mapping vibrotactile stimulations to fundamental body movements , 2010, 2010 IEEE International Symposium on Haptic Audio Visual Environments and Games.

[34]  Joseph A. Paradiso,et al.  ListenTree: Audio-Haptic Display In The Natural Environment , 2015, CHI Extended Abstracts.

[35]  Ben J. A. Kröse,et al.  The TaSSt: Tactile sleeve for social touch , 2013, 2013 World Haptics Conference (WHC).

[36]  Sethuraman Panchanathan,et al.  Design, Implementation, and Case Study of a Pragmatic Vibrotactile Belt , 2011, IEEE Transactions on Instrumentation and Measurement.

[37]  Lauren K King,et al.  Short-term effects of vibration therapy on motor impairments in Parkinson's disease. , 2009, NeuroRehabilitation.

[38]  E. O. Dijk,et al.  Breathe with the Ocean: a System for Relaxation using Audio, Haptic and Visual Stimuli , 2011 .

[39]  C. Spence,et al.  The science of interpersonal touch: An overview , 2010, Neuroscience & Biobehavioral Reviews.

[40]  V. Braun,et al.  Using thematic analysis in psychology , 2006 .

[41]  Lynette A. Jones,et al.  Tactile Displays: Guidance for Their Design and Application , 2008, Hum. Factors.

[42]  D. Amso,et al.  Contributions of Neuroscience to Our Understanding of Cognitive Development , 2008, Current directions in psychological science.

[43]  Ling Zhu,et al.  Acu3D: A Cross-Platform Three-Dimensional Visualization System for the Meridians and Acupoints of Human Body , 2015, 2015 7th International Conference on Information Technology in Medicine and Education (ITME).

[44]  Alexander Toet,et al.  Social Touch in Human–Computer Interaction , 2015, Front. Digit. Humanit..

[45]  Donald Neumann,et al.  Kinesiology of the Musculoskeletal System : Foundations for Rehabilitation , 2009 .

[46]  Marko Punkanen,et al.  Contemporary Vibroacoustic Therapy: Perspectives on Clinical Practice, Research, and Training , 2012 .

[47]  Yvonne Rogers,et al.  Buzzing to play: lessons learned from an in the wild study of real-time vibrotactile feedback , 2011, CHI.

[48]  Walter A. Talbott,et al.  Restoring Balance: Replacing the Vestibular Sense with Wearable Vibrotactile Feedback , 2011 .

[49]  Ann Morrison,et al.  Investigating Tactile Stimulation in Symbiotic Systems , 2016, Symbiotic.

[50]  Jan O. Borchers,et al.  Tactile motion instructions for physical activities , 2009, CHI.

[51]  Yoshihisa Koike,et al.  Effects of Vibroacoustic Therapy on Elderly Nursing Home Residents with Depression , 2012 .

[52]  H. Marsh,et al.  Development and Validation of a Scale to Measure Optimal Experience: The Flow State Scale , 1996 .

[53]  A. Carreras,et al.  MEDIATE : An interactive multisensory environment for children with severe autism and no verbal communication . , 2004 .