GroupMedia: distributed multi-modal interfaces

In this paper, we describe the GroupMedia system, which uses wireless wearable computers to measure audio features, head-movement, and galvanic skin response (GSR) for dyads and groups of interacting people. These group sensor measurements are then used to build a real-time <i>group interest index</i>. The group interest index can be used to control group displays, annotate the group discussion for later retrieval, and even to modulate and guide the group discussion itself. We explore three different situations where this system has been introduced, and report experimental results.

[1]  Joan Morris DiMicco,et al.  Designing interfaces that influence group processes , 2004, CHI EA '04.

[2]  Alex Pentland,et al.  Sensing and modeling human networks , 2004 .

[3]  Darren Leigh,et al.  Social net: using patterns of physical proximity over time to infer shared interests , 2002, CHI Extended Abstracts.

[4]  T. Chartrand,et al.  The chameleon effect: the perception-behavior link and social interaction. , 1999, Journal of personality and social psychology.

[5]  A. Pentland.  Social Dynamics: The Voice of Power and Influence , 2004 .

[6]  Jennifer Healey,et al.  StartleCam: a cybernetic wearable camera , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[7]  Ashish Kapoor,et al.  A real-time head nod and shake detector , 2001, PUI '01.

[8]  Sumit Basu,et al.  Conversational scene analysis , 2002 .

[9]  Lucy E. Dunne,et al.  A shoulder pad insert vibrotactile display , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[10]  Alex Pentland,et al.  Social Network Computing , 2003, UbiComp.

[11]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[12]  Alex Pentland,et al.  MIThril 2003: applications and architecture , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[13]  Richard E Petty,et al.  Overt head movements and persuasion: a self-validation analysis. , 2003, Journal of personality and social psychology.

[14]  Alex Pentland,et al.  Coupled hidden Markov models for complex action recognition , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.