Revue et Perspectives du Toucher Social en IHM

Le toucher est l’un des principaux canaux intervenant dans la communication non verbale. Il permet de transmettre des emotions et de renforcer les liens affectifs entre les personnes. Son utilisation a deja ete envisage en Interaction Homme-Machine comme un moyen d’interaction avec des dispositifs, mais rarement pour une communication emotionnelle directe entre individus. Cet article presente un etat de l’art du toucher social en IHM. Considerant les travaux en psychologie, en IHM, en haptique et de informatique affective, nous expliquons en premier lieu le role et l’importance du toucher social dans la communication et la transmission des emotions. Nous evoquons ensuite les technologies existantes et emergentes pour effectuer un toucher social et enfin nous presentons de nouvelles perspectives pour les interfaces en IHMs.

[1]  Abu Saleh Md. Mahfujur Rahman,et al.  Measurements of Multimodal Approach to Haptic Interaction in Second Life Interpersonal Communication System , 2011, IEEE Transactions on Instrumentation and Measurement.

[2]  A. F. Rovers,et al.  HIM: a framework for haptic instant messaging , 2004, CHI EA '04.

[3]  Seungmoon Choi,et al.  Vibrotactile Display: Perception, Technology, and Applications , 2013, Proceedings of the IEEE.

[4]  J.B.F. van Erp,et al.  A multi-purpose tactile vest for astronauts in the international space station , 2003 .

[5]  Andrew Olney,et al.  Upending the Uncanny Valley , 2005, AAAI.

[6]  Abu Saleh Md. Mahfujur Rahman,et al.  HKiss: Real world based haptic interaction with virtual 3D avatars , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[7]  Desney S. Tan,et al.  Skinput: appropriating the body as an input surface , 2010, CHI.

[8]  Suranga Nanayakkara,et al.  AugmentedForearm: exploring the design space of a display-enhanced forearm , 2013, AH.

[9]  Naohiro Ishii,et al.  Augmentative and alternative communication with digital assistant for autistic children , 2012, 2012 IEEE International Conference on Emerging Signal Processing Applications.

[10]  Gijs Huisman,et al.  Social Touch Technology: A Survey of Haptic Technology for Social Touch , 2017, IEEE Transactions on Haptics.

[11]  A. Cranny-Francis Semefulness: a social semiotics of touch , 2011 .

[12]  Florian Müller,et al.  PalmRC: imaginary palm-based remote control for eyes-free television interaction , 2012, EuroITV.

[13]  Stephen A. Brewster,et al.  Multi-moji: Combining Thermal, Vibrotactile & Visual Stimuli to Expand the Affective Range of Feedback , 2017, CHI.

[14]  Madeline Gannon,et al.  ExoSkin: On-Body Fabrication , 2016, CHI.

[15]  A. Billhult,et al.  Light pressure massage for patients with severe anxiety. , 2009, Complementary therapies in clinical practice.

[16]  Tong Lu,et al.  iSkin: Flexible, Stretchable and Visually Customizable On-Body Touch Sensors for Mobile Computing , 2015, CHI.

[17]  Gijs Huisman,et al.  Observing Touch from Video: The Influence of Social Cues on Pleasantness Perceptions , 2016, EuroHaptics.

[18]  J. Wessberg,et al.  Discriminative and Affective Touch: Sensing and Feeling , 2014, Neuron.

[19]  Jun Rekimoto,et al.  BrainyHand: a wearable computing device without HMD and it's interaction techniques , 2010, AVI.

[20]  Gierad Laput,et al.  SkinTrack: Using the Body as an Electrical Waveguide for Continuous Finger Tracking on the Skin , 2016, CHI.

[21]  R. Heslin,et al.  Hands touching hands: affective and evaluative effects of an interpersonal touch. , 1976, Sociometry.

[22]  Luis M. Camarinha-Matos,et al.  Innovative and Creative Developments in Multimodal Interaction Systems , 2014, IFIP Advances in Information and Communication Technology.

[23]  S. Hudson,et al.  CHI '08 Extended Abstracts on Human Factors in Computing Systems , 2009, CHI 2009.

[24]  J. Wessberg,et al.  Coding of pleasant touch by unmyelinated afferents in humans , 2009, Nature Neuroscience.

[25]  Neil Davey,et al.  Designing & developing QueBall, a robotic device for autism therapy , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[26]  C. Spence,et al.  The science of interpersonal touch: An overview , 2010, Neuroscience & Biobehavioral Reviews.

[27]  D. Keltner,et al.  The communication of emotion via touch. , 2009, Emotion.

[28]  Eyal Ofek,et al.  NormalTouch and TextureTouch: High-fidelity 3D Haptic Shape Rendering on Handheld Virtual Reality Controllers , 2016, UIST.

[29]  Sam Bucolo,et al.  The design of a tangible interaction device to alleviate anxiety and pain in paediatric burns patients , 2006, CHI Extended Abstracts.

[30]  Jan O. Borchers,et al.  Pinstripe: eyes-free continuous input anywhere on interactive clothing , 2010, UIST '10.

[31]  Karon E. MacLean,et al.  Gesture Recognition in the Haptic Creature , 2010, EuroHaptics.

[32]  Youngwoo Park,et al.  CheekTouch: an affective interaction technique while speaking on the mobile phone , 2010, CHI Extended Abstracts.

[33]  Max Mühlhäuser,et al.  EarPut: augmenting behind-the-ear devices for ear-based interaction , 2013, CHI Extended Abstracts.

[34]  Aduén Darriba Frederiks,et al.  Affective Touch at a Distance , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[35]  Karon E. MacLean,et al.  Designing with haptic feedback , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[36]  Christian Holz,et al.  DuoSkin: rapidly prototyping on-skin user interfaces using skin-friendly materials , 2016, SEMWEB.

[37]  Eva-Lotta Sallnäs,et al.  Haptic Feedback Increases Perceived Social Presence , 2010, EuroHaptics.

[38]  Wen-Huang Cheng,et al.  FingerPad: private and subtle interaction using fingertips , 2013, UIST.

[39]  Karon E. MacLean,et al.  Affective touch gesture recognition for a furry zoomorphic machine , 2013, TEI '13.

[40]  Tiffany M Field,et al.  Touch in Early Development , 1995 .

[41]  Hiroshi Ishii,et al.  Design of haptic interfaces for therapy , 2009, CHI.

[42]  Wijnand A. IJsselsteijn,et al.  The Virtual Midas Touch: Helping Behavior After a Mediated Social Touch , 2008, IEEE Transactions on Haptics.

[43]  P. Andersen,et al.  International Patterns of Interpersonal Tactile Communication: A Field Study , 1998 .

[44]  Fumihito Arai,et al.  Novel touch sensor with piezoelectric thin film for microbial separation , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[45]  J. Russell Evidence of Convergent Validity on the Dimensions of Affect , 1978 .

[46]  T. Field Touch for Socioemotional and Physical Well-Being: A Review. , 2010 .

[47]  Takao Someya,et al.  Imperceptible magnetoelectronics , 2015, Nature Communications.

[48]  Sethuraman Panchanathan,et al.  VibroGlove: an assistive technology aid for conveying facial expressions , 2010, CHI Extended Abstracts.

[49]  Giulio Sandini,et al.  An embedded artificial skin for humanoid robots , 2008, 2008 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems.

[50]  Hiroshi Ishiguro,et al.  Does A Robot’s Touch Encourage Human Effort? , 2017, Int. J. Soc. Robotics.

[51]  J. V. Erp,et al.  Vibrotactile in-vehicle navigation system , 2004 .

[52]  M. Heller The Psychology of Touch , 1991 .

[53]  H. Schlosberg Three dimensions of emotion. , 1954, Psychological review.

[54]  Jeremy N. Bailenson,et al.  Virtual Interpersonal Touch: Expressing and Recognizing Emotions Through Haptic Devices , 2007, Hum. Comput. Interact..

[55]  Vincent Hayward,et al.  A role for haptics in mobile interaction: initial design using a handheld tactile display prototype , 2006, CHI.

[56]  Clayton Shepard,et al.  A longitudinal study of emoticon use in text messaging from smartphones , 2012, Comput. Hum. Behav..

[57]  Takanori Shibata,et al.  Physical and affective interaction between human and mental commit robot , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[58]  J. Hornik Effects of physical contact on customers' shopping time and behavior , 1992 .

[59]  Ali Israr,et al.  Feel Effects , 2014, ACM Trans. Appl. Percept..

[60]  Berit Seiger Cronfalk,et al.  Being in safe hands : The experiences of soft tissue massage as a complement in palliative care. Intervention studies concerning patients, relatives and nursing staff , 2008 .

[61]  Dzmitry Tsetserukou,et al.  HaptiHug: A Novel Haptic Display for Communication of Hug over a Distance , 2010, EuroHaptics.

[62]  Karon E. MacLean,et al.  The Role of Affective Touch in Human-Robot Interaction: Human Intent and Expectations in Touching the Haptic Creature , 2012, Int. J. Soc. Robotics.

[63]  Ivan Poupyrev,et al.  AIRREAL: tactile interactive experiences in free air , 2013, UIST '13 Adjunct.

[64]  J. Bottorff,et al.  The use and meaning of touch in caring for patients with cancer. , 1993, Oncology nursing forum.

[65]  Leonardo Bonanni,et al.  TapTap: a haptic wearable for asynchronous distributed touch therapy , 2006, CHI Extended Abstracts.

[66]  Hiroshi Ishii,et al.  Haptic Edge Display for Mobile Tactile Interaction , 2016, CHI.

[67]  Mehdi Ammi,et al.  EmotionAir: Perception of Emotions from Air Jet Based Tactile Stimulation , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[68]  John Sarik,et al.  Lab kits using the Arduino prototyping platform , 2010, 2010 IEEE Frontiers in Education Conference (FIE).

[69]  Wijnand A. IJsselsteijn,et al.  Mediated social touch: a review of current research and future directions , 2006, Virtual Reality.

[70]  Paul Lemmens,et al.  A body-conforming tactile jacket to enrich movie viewing , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[71]  Gordon Cheng,et al.  Event-based signaling for large-scale artificial robotic skin - realization and performance evaluation , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[72]  Aduén Darriba Frederiks,et al.  Touching Virtual Agents: Embodiment and Mind , 2013, eNTERFACE.

[73]  Dirk Heylen,et al.  Touching the Void -- Introducing CoST: Corpus of Social Touch , 2014, ICMI.

[74]  Alexander Toet,et al.  Social Touch in Human–Computer Interaction , 2015, Front. Digit. Humanit..

[75]  Leonardo Bonanni,et al.  Affective TouchCasting , 2006, SIGGRAPH '06.

[76]  Shafiq ur Réhman,et al.  iFeeling: Vibrotactile Rendering of Human Emotions on Mobile Phones , 2008, WMMP.

[77]  J. Wessberg,et al.  The neurophysiology of unmyelinated tactile afferents , 2010, Neuroscience & Biobehavioral Reviews.

[78]  Yon-Kyu Park,et al.  Robot fingertip tactile sensing module with a 3D-curved shape using molding technique , 2013 .

[79]  Hiroyuki Kajimoto,et al.  Novel tactile display for emotional tactile experience , 2009, Advances in Computer Entertainment Technology.

[80]  Gijs Huisman,et al.  With Us or Against Us: Simulated Social Touch by Virtual Agents in a Cooperative or Competitive Setting , 2014, IVA.

[81]  Chris Harrison,et al.  OmniTouch: wearable multitouch interaction everywhere , 2011, UIST.

[82]  Timothy W. Bickmore,et al.  Empathic Touch by Relational Agents , 2010, IEEE Transactions on Affective Computing.

[83]  H. Olausson,et al.  The skin as a social organ , 2010, Experimental Brain Research.

[84]  Nikolaos G. Bourbakis,et al.  A Survey on Wearable Sensor-Based Systems for Health Monitoring and Prognosis , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[85]  Wendy E. Mackay,et al.  Stretchis: Fabricating Highly Stretchable User Interfaces , 2016, UIST.

[86]  Martin Buss,et al.  Handshake: Realistic Human-Robot Interaction in Haptic Enhanced Virtual Reality , 2011, PRESENCE: Teleoperators and Virtual Environments.

[87]  Allison Druin,et al.  Technology probes: inspiring design for and with families , 2003, CHI '03.

[88]  D. Keltner,et al.  Touch communicates distinct emotions. , 2006, Emotion.

[89]  Benoit P. Delhaye,et al.  Texture-induced vibrations in the forearm during tactile exploration , 2012, Front. Behav. Neurosci..

[90]  S. Kopp,et al.  Touch perception and emotional appraisal for a virtual agent , 2007 .

[91]  Pei-Yu Chi,et al.  Stress outsourced: a haptic social network via crowdsourcing , 2009, CHI Extended Abstracts.

[92]  Aduén Darriba Frederiks,et al.  Towards tactile expressions of emotion through mediated touch , 2013, CHI Extended Abstracts.

[93]  Cristina P. Santos,et al.  Applications of simple robots to encourage social receptiveness of adolescents with autism , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[94]  Francis McGlone,et al.  Sensory and affective judgments of skin during inter- and intrapersonal touch. , 2009, Acta psychologica.

[95]  Ivan Poupyrev,et al.  Project Jacquard: Interactive Digital Textiles at Scale , 2016, CHI.

[96]  Karon E. MacLean,et al.  Hapticat: exploration of affective touch , 2005, ICMI '05.

[97]  Cynthia Breazeal,et al.  Design of a therapeutic robotic companion for relational, affective touch , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[98]  Jürgen Steimle,et al.  More than touch: understanding how people use skin as an input surface for mobile computing , 2014, CHI.

[99]  Sriram Subramanian,et al.  UltraHaptics: multi-point mid-air haptic feedback for touch surfaces , 2013, UIST.

[100]  Abu Saleh Md. Mahfujur Rahman,et al.  HugMe: synchronous haptic teleconferencing , 2009, ACM Multimedia.

[101]  K. MacLean,et al.  The Haptic Creature Project : Social Human-Robot Interaction through Affective Touch , 2008 .

[102]  P. Ekman,et al.  Strong evidence for universals in facial expressions: a reply to Russell's mistaken critique. , 1994, Psychological bulletin.

[103]  G. Essick,et al.  Quantitative assessment of pleasant touch , 2010, Neuroscience & Biobehavioral Reviews.