Dites-moi: wearable feedback on conversational behavior

Interpersonal communication skills are critical in certain industry sectors like sales and marketing. Recent advances in wearable technology are enabling the design of real-time behavioral feedback tools for apprentices in aforementioned industries. This paper describes the design and implementation of a conversational behavior awareness tool based on Google Glass. The goal of the system is to provide real-time feedback to young sales apprentices about the amount of time they talk in an interaction with a client. We evaluated our system with a pilot study involving 15 apprentices (ages 16--20). Overall, participants found the system fun, little distracting and useful. Furthermore, manual coding of the recorded videos, showed that wearable sensing and real-time feedback did not negatively influence the dyadic social interaction.

[1]  Daniel Gatica-Perez,et al.  StressSense: detecting stress in unconstrained acoustic environments using smartphones , 2012, UbiComp.

[2]  Paul Lukowicz,et al.  Physics education with Google Glass gPhysics experiment app , 2014, UbiComp Adjunct.

[3]  Johannes Schöning,et al.  Augmenting Social Interactions: Realtime Behavioural Feedback using Social Signal Processing Techniques , 2015, CHI.

[4]  Caroline Parker,et al.  An examination of the effects of a wearable display on informal face-to-face communication , 2006, CHI.

[5]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[6]  M. Knapp,et al.  Nonverbal communication in human interaction , 1972 .

[7]  Alex Pentland,et al.  Honest signals: how social networks shape human behavior , 2011, ACM Multimedia.

[8]  Mahadev Satyanarayanan,et al.  Towards wearable cognitive assistance , 2014, MobiSys.

[9]  L. Allspach,et al.  Relationship between nonverbal sensitivity, encoding, and relational satisfaction , 2001 .

[10]  Alex Pentland,et al.  Honest Signals - How They Shape Our World , 2008 .

[11]  Sumit Basu.  A linked-HMM model for robust voicing and speech detection , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[12]  Daniel Gatica-Perez,et al.  Hire me: Computational Inference of Hirability in Employment Interviews Based on Nonverbal Behavior , 2014, IEEE Transactions on Multimedia.

[13]  Richard Kazelskis,et al.  Relative Contributions of Verbal, Articulative, and Nonverbal Communication to Employment Decisions in the Job Interview Setting. , 1979 .

[14]  Daniel Gatica-Perez,et al.  Automatic nonverbal analysis of social interaction in small groups: A review , 2009, Image Vis. Comput..

[15]  Shamsi T. Iqbal,et al.  Reducing disruption from subtle information delivery during a conversation: mode and bandwidth investigation , 2013, CHI.

[16]  Pierre Dillenbourg,et al.  Reflect: An Interactive Table for Regulating Face-to-Face Collaborative Learning , 2008, EC-TEL.

[17]  Walter Bender,et al.  Influencing group participation with a shared display , 2004, CSCW.

[18]  Janienke Sturm,et al.  Influencing social dynamics in meetings through a peripheral display , 2007, ICMI '07.

[19]  A. Pentland,et al.  Thin slices of negotiation: predicting outcomes from conversational dynamics within the first 5 minutes. , 2007, The Journal of applied psychology.

[20]  Daniel Gatica-Perez,et al.  Estimating Cohesion in Small Groups Using Audio-Visual Nonverbal Behavior , 2010, IEEE Transactions on Multimedia.

[21]  S. Gosling,et al.  A very brief measure of the Big-Five personality domains , 2003 .

[22]  Mark V. Redmond,et al.  Interpersonal Communication: Relating to Others , 1995 .

[23]  Alex Pentland,et al.  Meeting mediator: enhancing group collaboration with sociometric feedback , 2008, CHI Extended Abstracts.

[24]  Mohammed E. Hoque,et al.  Rhema: A Real-Time In-Situ Intelligent Interface to Help People with Public Speaking , 2015, IUI.

[25]  D. Gática-Pérez,et al.  A Nonverbal Behavior Approach to Identify Emergent Leaders in Small Groups , 2012, IEEE Transactions on Multimedia.

[26]  Daniel Gildea,et al.  Automated prediction and analysis of job interview performance: The role of what you say and how you say it , 2015, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[27]  H. Pashler.  Dual-task interference in simple tasks: data and theory. , 1994, Psychological bulletin.