Enriching social situational awareness in remote interactions: insights and inspirations from disability focused research

In this paper we present a new perspective into developing technologies for enriching social presence among remote interaction partners. Inspired by the abilities and limitations faced by people who are disabled during their everyday social interactions, we propose novel portable and wearable technologies that could potentially enrich remote interactions even in audio and video deprived settings. We describe the important challenges faced by people who are disabled during everyday dyadic and group social interactions and correlate them to the challenges faced by participants in remote interactions. With a case study of visually impaired individuals, we demonstrate how assistive technologies developed for social assistance of people who are disabled can help in increasing the social situational awareness, and hence social presence, of remote interaction partners.

[1]  Everett M. Rogers,et al.  Edward T.Hall and The History of Intercultural Communication : The United States and Japan , 2002 .

[2]  Rana El Kaliouby,et al.  Self-Cam: feedback from what would be your social partner , 2006, SIGGRAPH '06.

[3]  Sethuraman Panchanathan,et al.  VibroGlove: an assistive technology aid for conveying facial expressions , 2010, CHI Extended Abstracts.

[4]  N. Ambady,et al.  Thin slices of expressive behavior as predictors of interpersonal consequences: A meta-analysis. , 1992 .

[5]  V. Balasubramanian,et al.  Using a haptic belt to convey non-verbal communication cues during social interactions to individuals who are blind , 2008, 2008 IEEE International Workshop on Haptic Audio visual Environments and Games.

[6]  Wijnand A. IJsselsteijn,et al.  Mediated social touch: a review of current research and future directions , 2006, Virtual Reality.

[7]  Sethuraman Panchanathan,et al.  A pragmatic approach to the design and implementation of a vibrotactile belt and its applications , 2009, 2009 IEEE International Workshop on Haptic Audio visual Environments and Games.

[8]  Chwen Jen Chen,et al.  Guiding Exploration Through Three-Dimensional Virtual Environments: A Cognitive Load Reduction Approach , 2008 .

[9]  Divya Jindal-Snape,et al.  Generalization and Maintenance of Social Skills of Children with Visual Impairments: Self-evaluation and the Role of Feedback , 2004 .

[10]  Alex Pentland,et al.  Using the influence model to recognize functional roles in meetings , 2007, ICMI '07.

[11]  M. Knapp,et al.  Nonverbal communication in human interaction , 1972 .

[12]  Kristen Shinohara,et al.  Observing Sara: a case study of a blind person's interactions with technology , 2007, Assets '07.

[13]  Uwe Altmann,et al.  Analysis of Nonverbal Involvement in Dyadic Interactions , 2007, COST 2102 Workshop.

[14]  Jeremy N. Bailenson,et al.  The Effect of Behavioral Realism and Form Realism of Real-Time Avatar Faces on Verbal Disclosure, Nonverbal Disclosure, Emotion Recognition, and Copresence in Dyadic Interaction , 2006, PRESENCE: Teleoperators and Virtual Environments.

[15]  Sethuraman Panchanathan,et al.  Using tactile rhythm to convey interpersonal distances to individuals who are blind , 2009, CHI Extended Abstracts.

[16]  Jerold L. Hale,et al.  Relational Messages Associated with Nonverbal Behaviors. , 1984 .

[17]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[18]  C. Wetzel,et al.  The Midas Touch , 1984 .

[19]  Crystal L. Hoyt,et al.  Social Inhibition in Immersive Virtual Environments , 2003, Presence: Teleoperators & Virtual Environments.

[20]  Fabio Pianesi,et al.  Automatic detection of group functional roles in face to face interactions , 2006, ICMI '06.

[21]  Jeremy N. Bailenson,et al.  Virtual interpersonal touch: Haptic interaction and copresence in collaborative virtual environments , 2008, Multimedia Tools and Applications.

[22]  Edward T. Hall,et al.  A System for the Notation of Proxemic Behavior1 , 1963 .

[23]  Sethuraman Panchanathan,et al.  Person-Specific Characteristic Feature Selection for Face Recognition , 2010 .

[24]  Sethuraman Panchanathan,et al.  A Systematic Requirements Analysis and Development of an Assistive Device to Enhance the Social Interaction of People Who are Blind or Visually Impaired , 2008 .

[25]  Josh D. Tenenberg,et al.  A blind person's interactions with technology , 2009, Commun. ACM.