Automatic behavior analysis in tag games: from traditional spaces to interactive playgrounds

Tag is a popular children’s playground game. It revolves around taggers that chase and then tag runners, upon which their roles switch. There are many variations of the game that aim to keep children engaged by presenting them with challenges and different types of gameplay. We argue that the introduction of sensing and floor projection technology in the playground can aid in providing both variation and challenge. To this end, we need to understand players’ behavior in the playground and steer the interactions using projections accordingly. In this paper, we first analyze the behavior of taggers and runners in a traditional tag setting. We focus on behavioral cues that differ between the two roles. Based on these, we present a probabilistic role recognition model. We then move to an interactive setting and evaluate the model on tag sessions in an interactive tag playground. Our model achieves 77.96 % accuracy, which demonstrates the feasibility of our approach. We identify several avenues for improvement. Eventually, these should lead to a more thorough understanding of what happens in the playground, not only regarding player roles but also when the play breaks down, for example when players are bored or cheat.

[1]  F. Hughes,et al.  Children, play, and development , 1991 .

[2]  Peter Carr,et al.  Assessing team strategy using spatiotemporal data , 2013, KDD.

[3]  Vittorio Murino,et al.  Decentralized particle filter for joint individual-group tracking , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Ronald Poppe,et al.  A survey on vision-based human action recognition , 2010, Image Vis. Comput..

[5]  Fei-Fei Li,et al.  Socially-Aware Large-Scale Crowd Forecasting , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  James M. Rehg,et al.  Quasi-periodic event analysis for social game retrieval , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[7]  Silvio Savarese,et al.  Learning context for collective activity recognition , 2011, CVPR 2011.

[8]  Luc Van Gool,et al.  Improving Data Association by Joint Modeling of Pedestrian Trajectories and Groupings , 2010, ECCV.

[9]  Ming-Ching Chang,et al.  Probabilistic group-level motion analysis and scenario recognition , 2011, 2011 International Conference on Computer Vision.

[10]  Amit K. Roy-Chowdhury,et al.  Context-Aware Modeling and Recognition of Activities in Video , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Mubarak Shah,et al.  Multi-agent event recognition by preservation of spatiotemporal relationships between probabilistic models , 2013, Image Vis. Comput..

[12]  Luis E. Ortiz,et al.  Who are you with and where are you going? , 2011, CVPR 2011.

[13]  J.K. Aggarwal,et al.  Human activity analysis , 2011, ACM Comput. Surv..

[14]  Ioannis A. Kakadiaris,et al.  Activity analysis in crowded environments using social cues for group discovery and human interaction modeling , 2014, Pattern Recognit. Lett..

[15]  Kaj Grønbæk,et al.  Designing training games for soccer , 2015, Interactions.

[16]  Xiaojing Chen,et al.  An Online Learned Elementary Grouping Model for Multi-target Tracking , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  James M. Rehg,et al.  Decoding Children's Social Behavior , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Robby van Delden,et al.  Interactive Playgrounds for Children , 2014 .

[19]  Vittorio Murino,et al.  Analyzing Groups: A Social Signaling Perspective , 2012, Video Analytics for Business Intelligence.

[20]  Sridha Sridharan,et al.  Recognising Team Activities from Noisy Data , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[21]  Yaser Sheikh,et al.  Representing and Discovering Adversarial Team Behaviors Using Player Roles , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Robert T. Collins,et al.  Vision-Based Analysis of Small Groups in Pedestrian Crowds , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Bingbing Ni,et al.  Recognizing human group activities with localized causalities , 2009, CVPR 2009.

[24]  Anthony D. Pellegrini,et al.  The Role of Play in Human Development , 2009 .

[25]  Ronald Poppe,et al.  "You're It!": Role Identification Using Pairwise Interactions in Tag Games , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[26]  Greg Mori,et al.  Social roles in hierarchical models for human activity recognition , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Dariu Gavrila,et al.  Monocular Pedestrian Detection: Survey and Experiments , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Alessio Del Bue,et al.  Human behavior analysis in video surveillance: A Social Signal Processing perspective , 2013, Neurocomputing.

[29]  Irfan A. Essa,et al.  Motion fields to predict play evolution in dynamic sport scenes , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[30]  Robby van Delden,et al.  Augmenting traditional playground games to enhance game experience , 2015, 2015 7th International Conference on Intelligent Technologies for Interactive Entertainment (INTETAIN).

[31]  Michael Beetz,et al.  ASPOGAMO: Automated Sports Games Analysis Models , 2009, Int. J. Comput. Sci. Sport.

[32]  Vittorio Murino,et al.  Social interactions by visual focus of attention in a three‐dimensional environment , 2013, Expert Syst. J. Knowl. Eng..

[33]  Silvio Savarese,et al.  Understanding Collective Activitiesof People from Videos , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Qi Tian,et al.  Group Activity Recognition by Gaussian Processes Estimation , 2010, 2010 20th International Conference on Pattern Recognition.

[35]  Yanxi Liu,et al.  Tracking Sports Players with Context-Conditioned Motion Models , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Robby van Delden,et al.  Socially Aware Interactive Playgrounds , 2013, IEEE Pervasive Computing.

[37]  Maja Pantic,et al.  Towards the automatic detection of spontaneous agreement and disagreement based on nonverbal behaviour: A survey of related cues, databases, and tools , 2013, Image Vis. Comput..

[38]  Robby van Delden,et al.  Steering Gameplay Behavior in the Interactive Tag Playground , 2014, AmI.

[39]  L. Barnett,et al.  Developmental Benefits of Play for Children , 1990 .

[40]  M. Argyle,et al.  EYE-CONTACT, DISTANCE AND AFFILIATION. , 1965, Sociometry.