Comparing models for gesture recognition of children's bullying behaviors

We explored gesture recognition applied to the problem of classifying natural physical bullying behaviors by children. To capture natural bullying behavior data, we developed a humanoid robot that used hand-coded gesture recognition to identify basic physical bullying gestures and responded by explaining why the gestures were inappropriate. Children interacted with the robot by trying various bullying behaviors, thereby allowing us to collect a natural bullying behavior dataset for training the classifiers. We trained three different sequence classifiers using the collected data and compared their effectiveness at classifying different types of common physical bullying behaviors. Overall, Hidden Conditional Random Fields achieved the highest average F1 score (0.645) over all tested gesture classes.

[1]  T. Kanda,et al.  Why do children abuse robots , 2016 .

[2]  Rahul Sukthankar,et al.  Violence Detection in Video Using Computer Vision Techniques , 2011, CAIP.

[3]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .

[4]  Tapio Seppänen,et al.  Physical Violence Detection for Preventing School Bullying , 2014, Adv. Artif. Intell..

[5]  Joseph A. Paradiso,et al.  The gesture recognition toolkit , 2014, J. Mach. Learn. Res..

[6]  Mark A. Barnett,et al.  Antisocial and Prosocial Teasing among Children: Perceptions and Individual Differences. , 2004 .

[7]  Tal Hassner,et al.  Violent flows: Real-time detection of violent crowd behavior , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[8]  Jing Zhang,et al.  RGB-D-based action recognition datasets: A survey , 2016, Pattern Recognit..

[9]  E. Costello,et al.  Adult psychiatric outcomes of bullying and being bullied by peers in childhood and adolescence. , 2013, JAMA psychiatry.

[10]  Li-Yun Wang,et al.  Violence Detection in Movies , 2011, 2011 Eighth International Conference Computer Graphics, Imaging and Visualization.

[11]  Rémi Ronfard,et al.  A survey of vision-based methods for action representation, segmentation and recognition , 2011, Comput. Vis. Image Underst..

[12]  D. Olweus,et al.  Revised Olweus Bully/Victim Questionnaire , 2012 .

[13]  Brian Scassellati,et al.  Comparing Models of Disengagement in Individual and Group Interactions , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[14]  Frank Hopfgartner,et al.  Violence detection in hollywood movies by the fusion of visual and mid-level audio cues , 2013, ACM Multimedia.

[15]  Trevor Darrell,et al.  Hidden Conditional Random Fields , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Guy Lapalme,et al.  A systematic analysis of performance measures for classification tasks , 2009, Inf. Process. Manag..

[17]  Brian Scassellati,et al.  Classification of Children's Social Dominance in Group Interactions with Robots , 2015, ICMI.

[18]  R. Iannotti,et al.  School bullying among adolescents in the United States: physical, verbal, relational, and cyber. , 2009, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[19]  Tapio Seppänen,et al.  An instance-based physical violence detection algorithm for school bullying prevention , 2015, 2015 International Wireless Communications and Mobile Computing Conference (IWCMC).

[20]  D. Olweus.  Bully/victim problems in school: Facts and intervention , 1997 .

[21]  Donald J. Berndt,et al.  Using Dynamic Time Warping to Find Patterns in Time Series , 1994, KDD Workshop.

[22]  Roy F. Baumeister,et al.  A Three-Component Model of Children's Teasing: Aggression, Humor, and Ambiguity , 1991 .

[23]  Ming-yu Chen,et al.  Recognition of aggressive human behavior using binary local motion descriptors , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[24]  Cristian Sminchisescu,et al.  The Moving Pose: An Efficient 3D Kinematics Descriptor for Low-Latency Action Recognition and Detection , 2013, 2013 IEEE International Conference on Computer Vision.

[25]  Trevor Darrell,et al.  Hidden Conditional Random Fields for Gesture Recognition , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[26]  D. Olweus,et al.  Prevalence estimation of school bullying with the Olweus Bully Victim Questionnaire , 2003 .

[27]  K. Lagerspetz,et al.  Do Girls Manipulate and Boys Fight? Developmental Trends in Regard to Direct and Indirect Aggression , 1992 .

[28]  Michael I. Jordan,et al.  On Discriminative vs. Generative Classifiers: A comparison of logistic regression and naive Bayes , 2001, NIPS.

[29]  Ramani S. Pilla,et al.  Bullying Behaviors Among US Youth: Prevalence and Association With Psychosocial Adjustment , 2001 .