Modelling the influence of cultural information on vision-based human home activity recognition

Daily life activities, such as eating and sleeping, are deeply influenced by a person's culture, hence generating differences in the way a same activity is performed by individuals belonging to different cultures. We argue that taking cultural information into account can improve the performance of systems for the automated recognition of human activities. We propose four different solutions to the problem and present a system which uses a Naive Bayes model to associate cultural information with semantic information extracted from still images. Preliminary experiments with a dataset of images of individuals lying on the floor, sleeping on a futon and sleeping on a bed suggest that: i) solutions explicitly taking cultural information into account are more accurate than culture-unaware solutions; and ii) the proposed system is a promising starting point for the development of culture-aware Human Activity Recognition methods.

[1]  Antonio Fernández-Caballero,et al.  A survey of video datasets for human action and activity recognition , 2013, Comput. Vis. Image Underst..

[2]  Thestaffofthebenjaminrosehos MULTIDISCIPLINARY studies of illness in aged persons. II. A new classification of functional status in activities of daily living. , 1959, Journal of chronic diseases.

[3]  Antonio Sgorbissa,et al.  A cloud-based scene recognition framework for in-home assistive robots , 2017, 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[4]  Zeenat Meghani-Wise,et al.  Why This Interest in Minority Ethnic Groups? , 1996 .

[5]  Ronald Poppe,et al.  A survey on vision-based human action recognition , 2010, Image Vis. Comput..

[6]  Alexander Waibel,et al.  A Novel Greeting Selection System for a Culture-Adaptive Humanoid Robot , 2015 .

[7]  Sean Andrist,et al.  Effects of Culture on the Credibility of Robot Speech: A Comparison between English and Arabic , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[8]  Mohammad Obaid,et al.  Investigating the influence of culture on proxemic behaviors for humanoid robots , 2013, 2013 IEEE RO-MAN.

[9]  Irena Papadopoulos,et al.  Transcultural Health and Social Care: development of culturally competent practitioners , 2006 .

[10]  Jaap Ham,et al.  Cross-cultural study on human-robot greeting interaction: acceptance and discomfort by Egyptians and Japanese , 2013, Paladyn J. Behav. Robotics.

[11]  Wei-Yun Yau,et al.  Human Action Recognition With Video Data: Research and Evaluation Challenges , 2014, IEEE Transactions on Human-Machine Systems.

[12]  Elena Torta,et al.  Design of Robust Robotic Proxemic Behaviour , 2011, ICSR.

[13]  M. Lawton,et al.  Assessment of Older People: Self-Maintaining and Instrumental Activities of Daily Living , 1969 .

[14]  M. Joosse,et al.  Cultural differences in how an engagement-seeking robot should approach a group of people , 2014, CABS '14.

[15]  U P Wyss,et al.  Activities of daily living in non-Western cultures: range of motion requirements for hip and knee joint implants , 2001, International journal of rehabilitation research. Internationale Zeitschrift fur Rehabilitationsforschung. Revue internationale de recherches de readaptation.