A system that assists group conversation of older adults by evaluating speech duration and facial expression of each participant during conversation

In super aged society, system that assists social activities of older adults is needed for cognitive enhancement. Group conversation is one of the social activities. One of the largest problems for older adults is the imbalance of participation to conversation. Our approach is to develop a system that assists group conversation of older adults, by evaluating speech duration and facial expression of each participant during conversation. It enables all participants evenly to take part in the conversation, which tends to be difficult for older adults. We analyzed 15 group conversations for calculating the parameters used for evaluating the conversation. The effectiveness of the system using the obtained parameters was validated through the experiment. The system which evaluates only speech duration of each participant and the system which evaluates both speech duration and facial expression of each participant during group conversation were compared by analyzing 8 group conversations for each. The results demonstrated that the system which evaluates both speech duration and facial expression of each participant can make all participants to take part in the conversation evenly and actively. We successfully developed the system that can support group conversation regardless of the contents.

[1]  A. Mehrabian,et al.  Inference of attitudes from nonverbal communication in two channels. , 1967, Journal of consulting psychology.

[2]  Hiroshi G. Okuno,et al.  Design and Implementation of Robot Audition System 'HARK' — Open Source Software for Listening to Three Simultaneous Speakers , 2010, Adv. Robotics.

[3]  Margaret Wilson,et al.  An oscillator model of the timing of turn-taking , 2005, Psychonomic bulletin & review.

[4]  Takanori Shibata,et al.  Living With Seal Robots—Its Sociopsychological and Physiological Influences on the Elderly at a Care House , 2007, IEEE Transactions on Robotics.

[5]  Tetsunori Kobayashi,et al.  Framework of Communication Activation Robot Participating in Multiparty Conversation , 2010, AAAI Fall Symposium: Dialog with Robots.

[6]  Kenji Kimura,et al.  Development of a communication robot Ifbot , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[7]  B. Winblad,et al.  An active and socially integrated lifestyle in late life might protect against dementia , 2004, The Lancet Neurology.

[8]  L. R. Peterson,et al.  Short-term retention of individual verbal items. , 1959, Journal of experimental psychology.

[9]  泰義 横小路,et al.  IEEE International Conference on Robotics and Automation , 1992 .

[10]  Constantine G Lyketsos,et al.  Influence of social network characteristics on cognition and functional status with aging , 2008, International journal of geriatric psychiatry.

[11]  Paul B. Baltes,et al.  Theoretical propositions of life-span developmental psychology : On the dynamics between growth and decline , 1987 .