Tree-Based Mining for Discovering Patterns of Human Interaction in Meetings

Discovering semantic knowledge is significant for understanding and interpreting how people interact in a meeting discussion. In this paper, we propose a mining method to extract frequent patterns of human interaction based on the captured content of face-to-face meetings. Human interactions, such as proposing an idea, giving comments, and expressing a positive opinion, indicate user intention toward a topic or role in a discussion. Human interaction flow in a discussion session is represented as a tree. Tree-based interaction mining algorithms are designed to analyze the structures of the trees and to extract interaction flow patterns. The experimental results show that we can successfully extract several interesting patterns that are useful for the interpretation of human behavior in meeting discussions, such as determining frequent interactions, typical interaction flows, and relationships between different types of interactions.

[1]  Philip Smith.  Roger Bakeman John M. Gottman , 1987, Animal Behaviour.

[2]  Nikos Mamoulis,et al.  Mining frequent spatio-temporal sequential patterns , 2005, Fifth IEEE International Conference on Data Mining (ICDM'05).

[3]  Samy Bengio,et al.  Automatic analysis of multimodal group actions in meetings , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Chengqi Zhang,et al.  Mining Impact-Targeted Activity Patterns in Imbalanced Data , 2008, IEEE Transactions on Knowledge and Data Engineering.

[5]  Katashi Nagao,et al.  Discussion Ontology: Knowledge Discovery from Human Activities in Meetings , 2006, JSAI.

[6]  Rakesh Agarwal,et al.  Fast Algorithms for Mining Association Rules , 1994, VLDB 1994.

[7]  Gemma C. Garriga.  Discovering Unbounded Episodes in Sequential Data , 2003, PKDD.

[8]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[9]  Yunhao Liu,et al.  Mining Frequent Trajectory Patterns for Activity Monitoring Using Radio Frequency Tag Arrays , 2012, IEEE Transactions on Parallel and Distributed Systems.

[10]  Tomasz Imielinski,et al.  Mining association rules between sets of items in large databases , 1993, SIGMOD Conference.

[11]  Mohammed J. Zaki.  Efficiently mining frequent trees in a forest: algorithms and applications , 2005, IEEE Transactions on Knowledge and Data Engineering.

[12]  L. Anolli.  The hidden structure of interaction : from neurons to culture patterns , 2005 .

[13]  Lynn Wilcox,et al.  Room with a Rear View: Meeting Capture in a Multimedia Conference Room , 2000, IEEE Multim..

[14]  Walter Bender,et al.  The Impact of Increased Awareness While Face-to-Face , 2007, Hum. Comput. Interact..

[15]  Gudberg K. Jonsson,et al.  Application to T-pattern detection and analysis in sport research , 2001 .

[16]  Michael Kipp,et al.  ANVIL - a generic annotation tool for multimodal dialogue , 2001, INTERSPEECH.

[17]  K. Otsuka,et al.  Automatic interface of cross-modal nonverbal interactions in multiparty conversation , 2007 .

[18]  Kazunobu Yamauchi,et al.  Extraction of important interactions in medical interviewsusing nonverbal information , 2007, ICMI '07.

[19]  Chen Wang,et al.  Efficient Pattern-Growth Methods for Frequent Tree Pattern Mining , 2004, PAKDD.

[20]  Samy Bengio,et al.  Detecting group interest-level in meetings , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[21]  Alexander H. Waibel,et al.  Modeling focus of attention for meeting indexing based on multiple cues , 2002, IEEE Trans. Neural Networks.

[22]  Judy Kay,et al.  Clustering and Sequential Pattern Mining of Online Collaborative Learning Data , 2009, IEEE Transactions on Knowledge and Data Engineering.

[23]  Anton Nijholt,et al.  Online and off-line visualization of meeting information and meeting support , 2006, The Visual Computer.

[24]  Yuichi Nakamura,et al.  Smart meeting systems: A survey of state-of-the-art and open issues , 2010, CSUR.

[25]  Christos Faloutsos,et al.  Graph mining: Laws, generators, and algorithms , 2006, CSUR.

[26]  Hiroshi Sawada,et al.  Automatic inference of cross-modal nonverbal interactions in multiparty conversations: "who responds to whom, when, and how?" from gaze, head gestures, and utterances , 2007, ICMI '07.

[27]  Zhiyong Yu,et al.  Capture, recognition, and visualization of human semantic interactions in meetings , 2010, 2010 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[28]  Gregory D. Abowd,et al.  Towards a Smarter Meeting Record—Capture and Access of Meetings Revisited , 2005, Multimedia Tools and Applications.

[29]  M S Magnusson,et al.  Discovering hidden time patterns in behavior: T-patterns and their detection , 2000, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[30]  Xingshe Zhou,et al.  Inferring Human Interactions in Meetings: A Multimodal Approach , 2009, UIC.

[31]  Xindong Wu,et al.  10 Challenging Problems in Data Mining Research , 2006, Int. J. Inf. Technol. Decis. Mak..

[32]  Yasuyuki Sumi,et al.  A pattern mining method for interpretation of interaction , 2005, ICMI '05.

[33]  Zicheng Liu,et al.  Requirements and recommendations for an enhanced meeting viewing experience , 2008, ACM Multimedia.

[34]  Yuichi Nakamura,et al.  Towards smart meeting: enabling technologies and a real-world application , 2007, ICMI '07.