The Terrain of Digital Touch Communication

This chapter provides a descriptive map of digitally mediated touch communication. Whilst acknowledging our everyday interaction with touch screens, our focus is on emergent and semi-speculative touch technologies that want us to be able to touch and feel objects in new ways: from tangibles, wearables, haptics for virtual reality, through to the tactile internet of skin. It gives an overview of current state-of-the-art digital touch technologies, that enable new forms of touch communication in various contexts, such as work, leisure, learning, personal and social relationships and health and well-being. The chapter assess the scope, extent and findings of user studies to date, and identifies emerging issues around the social aspects of digital touch communication, that might involve human-object, human-human, human to robot or robot to human touch. In so doing, this map documents the resources for touch, the touch interactions supported and the kinds of touch communication practices that are being designed and identifies the social potentials and constraints of touch that are taken up by the designers of ‘digital touch’.

[1]  S. Shyam Sundar,et al.  Can you hold my hand? Physical warmth in human-robot interaction , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[2]  Takanori Shibata,et al.  Comparison of Verbal and Emotional Responses of Elderly People with Mild/Moderate Dementia and Those with Severe Dementia in Responses to Seal Robot, PARO , 2014, Front. Aging Neurosci..

[3]  Jeremy N. Bailenson,et al.  Virtual Interpersonal Touch: Expressing and Recognizing Emotions Through Haptic Devices , 2007, Hum. Comput. Interact..

[4]  Matteo Bianchi,et al.  Human and Robot Hands: Sensorimotor Synergies to Bridge the Gap Between Neuroscience and Robotics , 2016 .

[5]  Gijs Huisman,et al.  Social Touch Technology: A Survey of Haptic Technology for Social Touch , 2017, IEEE Transactions on Haptics.

[6]  Toshiharu Mukai,et al.  Development of a nursing-care assistant robot RIBA that can lift a human in its arms , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  David A. Ross,et al.  Wearable interfaces for orientation and wayfinding , 2000, Assets '00.

[8]  Roope Raisamo,et al.  Experiences on haptic interfaces for visually impaired young children , 2004, ICMI '04.

[9]  Linda Sheppard,et al.  Tactile graphics: A beginner's guide to graphics for visually impaired children , 2000 .

[10]  Christian J. A. M. Willemse A warm touch of affect? , 2015, 2015 International Conference on Affective Computing and Intelligent Interaction (ACII).

[11]  Andrea Lockerd Thomaz,et al.  Touched by a robot: An investigation of subjective responses to robot-initiated touch , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[12]  Stephen A. Brewster,et al.  Textured surfaces for ultrasound haptic displays , 2017, ICMI.

[13]  Ryan Robidoux,et al.  Investigating the Mathematical Discourse of Young Learners Involved in Multi-Modal Mathematical Investigations: The Case of Haptic Technologies , 2013 .

[14]  Jodi Forlizzi,et al.  The Hug: an exploration of robotic form for intimate communication , 2003, The 12th IEEE International Workshop on Robot and Human Interactive Communication, 2003. Proceedings. ROMAN 2003..

[15]  Sriram Subramanian,et al.  UltraHaptics: multi-point mid-air haptic feedback for touch surfaces , 2013, UIST.

[16]  Matteo Bianchi,et al.  Human and Robot Hands , 2016, Springer Series on Touch and Haptic Systems.

[17]  Allison M. Okamura,et al.  Haptics: The Present and Future of Artificial Touch Sensation , 2018, Annu. Rev. Control. Robotics Auton. Syst..

[18]  Shuo Wang,et al.  Squeeze me, but don't tease me: Human and mechanical touch enhance visual attention and emotion discrimination , 2011, Social neuroscience.

[19]  Shuichi Nishio,et al.  Effect of perspective change in body ownership transfer to teleoperated android robot , 2012, 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication.

[20]  Tilbe Göksun,et al.  Sensation: Measuring the Effects of a Human-to-Human Social Touch Based Controller on the Player Experience , 2016, CHI.

[21]  A. El Saddik,et al.  EmoJacket: Consumer centric wearable affective jacket to enhance emotional immersion , 2012, 2012 International Conference on Innovations in Information Technology (IIT).

[22]  Emanuele Menegatti,et al.  Teaching by touching: Interpretation of tactile instructions for motion development , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Karen B. Chen,et al.  Immersion of virtual reality for rehabilitation - Review. , 2018, Applied ergonomics.

[24]  A. D. Heyes Human navigation by sound , 1983 .

[25]  Yasutoshi Makino,et al.  Active touch perception produced by airborne ultrasonic haptic hologram , 2015, 2015 IEEE World Haptics Conference (WHC).

[26]  Takao Someya,et al.  Imperceptible Electronic Skin , 2014 .

[27]  Hideo Mitsuhashi,et al.  Improving Shared Experiences by Haptic Telecommunication , 2011, 2011 International Conference on Biometrics and Kansei Engineering.

[28]  Luigi Pinna,et al.  Towards the integration of e-skin into prosthetic devices , 2016, 2016 12th Conference on Ph.D. Research in Microelectronics and Electronics (PRIME).

[29]  Marta Blazquez Cano,et al.  The influence of image interactivity upon user engagement when using mobile touch screens , 2017, Comput. Hum. Behav..

[30]  Hussein Al Osman,et al.  Affective Haptics: Current Research and Future Directions , 2016, IEEE Access.

[31]  The potential effect of a vibrotactile glove rehabilitation system on motor recovery in chronic post-stroke hemiparesis. , 2017, Technology and health care : official journal of the European Society for Engineering and Medicine.

[32]  Katherine J Kuchenbecker,et al.  Evaluation of a Vibrotactile Simulator for Dental Caries Detection , 2017, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[33]  Ali Israr,et al.  TeslaTouch: electrovibration for touch surfaces , 2010, UIST.

[34]  José Pascual Molina,et al.  Identifying Virtual 3D Geometric Shapes with a Vibrotactile Glove , 2016, IEEE Computer Graphics and Applications.

[35]  Ireneusz Brzozowski,et al.  Thermal tablet for the blind , 2016 .

[36]  R. Remington Calming Music and Hand Massage With Agitated Elderly , 2002, Nursing research.

[37]  Alexander Toet,et al.  Social Touch in Human–Computer Interaction , 2015, Front. Digit. Humanit..

[38]  Danica Kragic,et al.  What's in the container? Classifying object contents from vision and touch , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[39]  Fulvio Mastrogiovanni,et al.  Skinware 2.0: A real-time middleware for robot skin , 2015 .

[40]  Roope Raisamo,et al.  Touch gestures in communicating emotional intention via vibrotactile stimulation , 2013, Int. J. Hum. Comput. Stud..

[41]  Jérôme Szewczyk,et al.  Tactile Rendering With Shape-Memory-Alloy Pin-Matrix , 2008, IEEE Transactions on Instrumentation and Measurement.

[42]  Elizabeth Broadbent,et al.  Physiological effects of a companion robot on blood pressure of older people in residential care facility: A pilot study , 2015, Australasian journal on ageing.

[43]  Karon E. MacLean,et al.  Communicating emotion through a haptic link: Design space and methodology , 2007, Int. J. Hum. Comput. Stud..

[44]  Takayuki Kanda,et al.  Interactive Humanoid Robots for a Science Museum , 2007, IEEE Intell. Syst..

[45]  Selma Sabanovic,et al.  Getting in Touch: How imagined, actual, and physical contact affect evaluations of robots , 2016, 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[46]  Orestis Georgiou,et al.  Mid-Air Haptics for Control Interfaces , 2018, CHI Extended Abstracts.

[47]  Joseph Wang,et al.  Wearable Electrochemical Sensors and Biosensors: A Review , 2013 .

[48]  Mike J. Chantler,et al.  Interactivity to enhance perception: does increased interactivity in mobile visual presentation tools facilitate more accurate rating of textile properties? , 2011, Mobile HCI.

[49]  Koji Yamada,et al.  Touch-based information transfer from a robot modeled on the hearing dog , 2015, 2015 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[50]  Emanuel Todorov,et al.  Design of a highly biomimetic anthropomorphic robotic hand towards artificial limb regeneration , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[51]  Avijit Banerjee,et al.  Researching haptics in higher education: The complexity of developing haptics virtual learning systems and evaluating its impact on students' learning , 2012, Comput. Educ..

[52]  Ali Israr,et al.  Tactile display for the visually impaired using TeslaTouch , 2011, CHI Extended Abstracts.

[53]  Roope Raisamo,et al.  The micole architecture: multimodal support for inclusion of visually impaired children , 2007, ICMI '07.

[54]  Laura M. Hiatt,et al.  Touch recognition and learning from demonstration (LfD) for collaborative human-robot firefighting teams , 2016, 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[55]  P. Singhi,et al.  Effectiveness of virtual reality rehabilitation for children and adolescents with cerebral palsy: an updated evidence-based systematic review. , 2017, Physiotherapy.

[56]  Adriana Tapus,et al.  Let's handshake and I'll know who you are: Gender and personality discrimination in human-human and human-robot handshaking interaction , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[57]  Benjamin C. K. Tee,et al.  25th Anniversary Article: The Evolution of Electronic Skin (E‐Skin): A Brief History, Design Considerations, and Recent Progress , 2013, Advanced materials.

[58]  Roshan Lalintha Peiris,et al.  Huggy Pajama: a mobile parent and child hugging communication system , 2008, IDC.

[59]  Sara Price,et al.  Exploring how children interact with 3D shapes using haptic technologies , 2018, IDC.

[60]  Tong Lu,et al.  iSkin: Flexible, Stretchable and Visually Customizable On-Body Touch Sensors for Mobile Computing , 2015, CHI.

[61]  Adrian David Cheok,et al.  Ring*U: a wearable system for intimate communication using tactile lighting expressions , 2014, Advances in Computer Entertainment.

[62]  Karon E. MacLean,et al.  The Haptic Bridge: Towards a Theory for Haptic-Supported Learning , 2017, IDC.

[63]  Katherine J. Kuchenbecker,et al.  A wrist-squeezing force-feedback system for robotic surgery training , 2017, 2017 IEEE World Haptics Conference (WHC).

[64]  Hiroyuki Umemuro,et al.  Emotion Evoked by Texture and Application to Emotional Communication , 2015, CHI Extended Abstracts.

[65]  David H. Warren,et al.  Chapter 4 – PERCEPTION BY THE BLIND , 1978 .

[66]  Karon E. MacLean,et al.  A tool to study affective touch , 2009, CHI Extended Abstracts.

[67]  Karon E. MacLean,et al.  Design and assessment of the Haptic Creature's affect display , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[68]  Rongrong Wang,et al.  Keep in touch: channel, expectation and experience , 2012, CHI.

[69]  Leon Adam Watts,et al.  YourGloves, hothands and hotmits: devices to hold hands at a distance , 2012, UIST.

[70]  C. Magnusson,et al.  Navigation and recognition in complex haptic virtual environments: Reports from an extensive study with blind users , 2002 .