Immediate or Reflective?: Effects of Real-timeFeedback on Group Discussions over Videochat

Having a group discussion with the members holding conflicting viewpoints is difficult. It is especially challenging for machine-mediated discussions in which the subtle social cues are hard to notice. We present a fully automated videochat framework that can automatically analyze audio-video data of the participants and provide real-time feedback on participation, interruption, volume, and facial emotion. In a heated discourse, these features are especially aligned with the undesired characteristics of dominating the conversation without taking turns, interrupting constantly, raising voice, and expressing negative emotion. We conduct a treatment-control user study with 40 participants having 20 sessions in total. We analyze the immediate and the reflective effects of real-time feedback on participants. Our findings show that while real-time feedback can make the ongoing discussion significantly less spontaneous, its effects propagate to successive sessions bringing significantly more expressiveness to the team. Our explorations with instant and propagated impacts of real-time feedback can be useful for developing design strategies for various collaborative environments.

[1]  Abigail Sellen,et al.  Remote Conversations: The Effects of Mediating Talk With Technology , 1995, Hum. Comput. Interact..

[2]  Pedro Sánchez,et al.  Collaborative technology and group process feedback: their impact on interactive sequences in meetings , 1990, CSCW '90.

[3]  D. Strayer,et al.  Modeling cognitive load effects of conversation between a passenger and driver , 2017, Attention, perception & psychophysics.

[4]  Murray R. Barrick,et al.  Relating member ability and personality to work-team processes and team effectiveness. , 1998 .

[5]  Rousiley Celi Moreira Maia,et al.  Respect and Disrespect in Deliberation Across the Networked Media Environment: Examining Multiple Paths of Political Talk , 2016, J. Comput. Mediat. Commun..

[6]  Martin Tomitsch,et al.  Energy-Efficient Integration of Continuous Context Sensing and Prediction into Smartwatches , 2015, Sensors.

[7]  Norah E. Dunbar,et al.  Perceptions of power and interactional dominance in interpersonal relationships , 2005 .

[8]  Mary Czerwinski,et al.  Regulating Feelings During Interpersonal Conflicts by Changing Voice Self-perception , 2018, CHI.

[9]  Janice Nadler.  Rapport in Negotiation and Conflict Resolution , 2004 .

[10]  J. McGrath,et al.  Groups Interacting with Technology: Ideas, Evidence, Issues and an Agenda , 1993 .

[11]  D. Murphey,et al.  The Righteous Mind: Why Good People Are Divided by Politics and Religion , 2013 .

[12]  Alex Pentland,et al.  Awareness as an antidote to distance: making distributed groups cooperative and consistent , 2012, CSCW.

[13]  E. Salas,et al.  Collective Behavior and Team Performance , 1992 .

[14]  Elizabeth A. Ottesen,et al.  Reflection in teacher education , 2007 .

[15]  David A. Huffaker,et al.  The Language of Coalition Formation in Online Multiparty Negotiations , 2011 .

[16]  Edward Sazonov,et al.  Development of the RT-GAIT, a Real-Time feedback device to improve Gait of individuals with stroke , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[17]  Xun Cao,et al.  Why Did They Do That?: Exploring Attribution Mismatches Between Native and Non-Native Speakers Using Videoconferencing , 2017, CSCW.

[18]  H. Leavitt.  Some effects of certain communication patterns on group performance. , 1951, Journal of abnormal psychology.

[19]  Gillian R. Hayes,et al.  SayWAT: Augmenting Face-to-Face Conversations for Adults with Autism , 2016, CHI.

[20]  Susan G. Straus,et al.  Getting a Clue , 1996 .

[21]  Nojin Kwak,et al.  Mobile Communication and Civil Society: Linking Patterns and Places of Use to Engagement with Others in Public , 2011 .

[22]  David Kotz,et al.  NoCloud: Exploring Network Disconnection through On-Device Data Analysis , 2018, IEEE Pervasive Computing.

[23]  Linda Blake,et al.  The effects of video on cognitive load and social presence in multimedia-learning , 2008, Comput. Hum. Behav..

[24]  A. Freitas-Magalhães.  Facial Expression of Emotion , 2012 .

[25]  Gillian R. Hayes,et al.  Designing for interaction immediacy to enhance social skills of children with autism , 2010, UbiComp.

[26]  Susan R. Fussell,et al.  Supporting intercultural collaboration with dynamic feedback systems: preliminary evidence from a creative design task , 2009, CHI Extended Abstracts.

[27]  H. S. Sullivan,et al.  Clinical Studies in Psychiatry , 1956 .

[28]  P. McLeod,et al.  Process Feedback in Task Groups: An Application of Goal Setting , 1992 .

[29]  Theodore A. Lamb.  Nonverbal and Paraverbal Control in Dyads and Triads: Sex or Power Differences? , 1981 .

[30]  Mohammed E. Hoque,et al.  Rhema: A Real-Time In-Situ Intelligent Interface to Help People with Public Speaking , 2015, IUI.

[31]  Jeremy N. Bailenson,et al.  Virtual Interpersonal Touch: Expressing and Recognizing Emotions Through Haptic Devices , 2007, Hum. Comput. Interact..

[32]  Esther Derby,et al.  Agile Retrospectives: Making Good Teams Great , 2006 .

[33]  Shamsi T. Iqbal,et al.  Reducing disruption from subtle information delivery during a conversation: mode and bandwidth investigation , 2013, CHI.

[34]  A. Follesdal.  The Place of Self-Interest and the Role of Power in the Deliberative Democracy , 2010 .

[35]  J. Husu,et al.  Developing Teachers’ Competencies in Reflecting on Teaching , 2007 .

[36]  J. Burgoon,et al.  Applying a social meaning model to relational message interpretations of conversational involvement: Comparing observer and participant perspectives , 1991 .

[37]  Mary Czerwinski,et al.  Honest signals in video conferencing , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[38]  Takeshi Naemura,et al.  Analysis of Human Nodding Behavior during Group Work for Designing Nodding Robots , 2016, GROUP.

[39]  Norah E. Dunbar,et al.  Interpersonal Dominance in Relational Conflict: A View from Dyadic Power Theory , 2008 .

[40]  Malte F. Jung.  Coupling Interactions and Performance: Predicting Team Performance from Thin Slices of Conflict , 2016, ACM Trans. Comput. Hum. Interact..

[41]  Michael Nowak,et al.  Social visualization and negotiation: effects of feedback configuration and status , 2012, CSCW.

[42]  Dan Cosley,et al.  Feedback for guiding reflection on teamwork practices , 2007, GROUP.

[43]  Carman Neustaedter,et al.  How and why teenagers use video chat , 2013, CSCW.

[44]  Carman Neustaedter,et al.  Sharing conversation and sharing life: video conferencing in the home , 2010, CHI.

[45]  Daniel McDuff,et al.  AFFDEX SDK: A Cross-Platform Real-Time Multi-Face Expression Recognition Toolkit , 2016, CHI Extended Abstracts.

[46]  A. Rothenberg,et al.  On anger. , 1971, The American journal of psychiatry.

[47]  Zhihong Zeng,et al.  A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[48]  James W. Pennebaker,et al.  Improving teamwork using real-time language feedback , 2013, CHI.

[49]  Christine M. Pearson,et al.  Tit for Tat? The Spiraling Effect of Incivility in the Workplace , 1999 .

[50]  Xiang Cao,et al.  Home video communication: mediating 'closeness' , 2010, CSCW '10.

[51]  Natasha Merat,et al.  Effects of Cognitive Load on Driving Performance: The Cognitive Control Hypothesis , 2017, Hum. Factors.

[52]  Morgan G. Ames,et al.  Making love in the network closet: the benefits and work of family videochat , 2010, CSCW '10.

[53]  Susan R. Fussell,et al.  Leveraging partner's insights for distributed collaborative sensemaking , 2013, CSCW '13.

[54]  Jennifer Healey,et al.  Toward Machine Emotional Intelligence: Analysis of Affective Physiological State , 2001, IEEE Trans. Pattern Anal. Mach. Intell..