Automated and unobtrusive measurement of physical activity in an interactive playground

Abstract Promoting physical activity is one of the main goals of interactive playgrounds. To validate whether this goal is met, we need to measure the amount of physical player activity. Traditional methods of measuring activity, such as observations or annotations of game sessions, require time and personnel. Others, such as heart rate monitors and accelerometers, need to be worn by the player. In this paper, we investigate whether physical activity can be measured unobtrusively by tracking players using depth cameras and applying computer vision algorithms. In a user study with 32 players, we measure the players’ speed while playing a game of tag, and demonstrate that our measures correlate well with exertion measured using heart rate sensors. This makes the method an attractive alternative to either manual coding or the use of worn devices. We also compare our approach to other exertion measurement methods. Finally, we demonstrate and discuss its potential for automated, unobtrusive measurements and real-time game adaptation.

[1]  A. Jeukendrup,et al.  Heart Rate Monitoring , 2003, Sports medicine.

[2]  Darren Edge,et al.  Designing for Bodily Interplay in Social Exertion Games , 2017, ACM Trans. Comput. Hum. Interact..

[3]  John Brennan,et al.  Alpha testing of the rapid recovery Kayaking-based exergame , 2015, 2015 IEEE Games Entertainment Media Conference (GEM).

[4]  Robby van Delden,et al.  Socially Aware Interactive Playgrounds , 2013, IEEE Pervasive Computing.

[5]  M. Bedu,et al.  Heart rate running speed relationships-during exhaustive bouts in the laboratory. , 2004, Canadian journal of applied physiology = Revue canadienne de physiologie appliquee.

[6]  Yvonne de Kort,et al.  OPOS: an observation scheme for evaluating head-up play , 2008, NordiCHI.

[7]  Mark Blades,et al.  Youth and New Media , 2013 .

[8]  Elise van den Hoven,et al.  Hanging off a bar , 2012, CHI Extended Abstracts.

[9]  Robby van Delden,et al.  A Thing of Beauty: Steering Behavior in an Interactive Playground , 2017, CHI.

[10]  T. C. Nicholas Graham,et al.  Designing for Exertion: How Heart-Rate Power-ups Increase Physical Activity in Exergames , 2015, CHI PLAY.

[11]  Anton Nijholt,et al.  Design of an Interactive Playground Based on Traditional Children's Play , 2012, INTETAIN.

[12]  Robby van Delden,et al.  Interactive Playgrounds for Children , 2014 .

[13]  Christoph Bartneck,et al.  Enhancing player engagement through game balancing in digitally augmented physical games , 2017, Int. J. Hum. Comput. Stud..

[14]  Robby van Delden,et al.  Steering Gameplay Behavior in the Interactive Tag Playground , 2014, AmI.

[15]  JungYounbo,et al.  Wii, Myself, and Size: The Influence of Proteus Effect and Stereotype Threat on Overweight Children's Exercise Motivation and Behavior in Exergames. , 2014 .

[16]  G. Sandercock,et al.  Temporal relationships between screen-time and physical activity with cardiorespiratory fitness in English schoolchildren: a 2-year longitudinal study. , 2012, Preventive medicine.

[17]  S. Intille,et al.  Estimating activity and sedentary behavior from an accelerometer on the hip or wrist. , 2013, Medicine and science in sports and exercise.

[18]  Robby van Delden,et al.  Augmenting playspaces to enhance the game experience: A tag game case study , 2016, Entertain. Comput..

[19]  T. C. Nicholas Graham,et al.  Heart rate control of exercise video games , 2009, Graphics Interface.

[20]  Jeffrey Heer,et al.  Balancing exertion experiences , 2012, CHI.

[21]  Sandra L. Calvert,et al.  The promise of exergames as tools to measure physical health , 2011, Entertain. Comput..

[22]  Panos Markopoulos,et al.  Play it our way: customization of game rules in children's interactive outdoor games , 2014, IDC.

[23]  F. Mueller,et al.  Bubble Popper: considering body contact in games , 2012, FnG '12.

[24]  Narcís Parés,et al.  Controlling and modulating physical activity through Interaction Tempo in exergames: A quantitative empirical analysis , 2014, J. Ambient Intell. Smart Environ..

[25]  Michael Tomasello,et al.  The effects of collaboration and minimal-group membership on children's prosocial behavior, liking, affiliation, and trust. , 2015, Journal of experimental child psychology.

[26]  G. Borg Psychophysical bases of perceived exertion. , 1982, Medicine and science in sports and exercise.

[27]  Bradley J. Bond,et al.  Electronic gaming and the obesity crisis. , 2013, New directions for child and adolescent development.

[28]  Robby van Delden,et al.  Hang in There: A Novel Body-Centric Interactive Playground , 2013, eNTERFACE.

[29]  C. Ferguson,et al.  Friends, fun, frustration and fantasy: Child motivations for video game play , 2013 .

[30]  Beth Hands,et al.  Physical Activity Measurement Methods for Young Children: A Comparative Study , 2006 .

[31]  Marc N. Potenza,et al.  Video-Gaming Among High School Students: Health Correlates, Gender Differences, and Problematic Gaming , 2010, Pediatrics.

[32]  Bradley J. Cardinal,et al.  Measuring Children's Physical Activity and Sedentary Behaviors , 2011 .

[33]  Jenny S. Radesky,et al.  Increased Screen Time: Implications for Early Childhood Development and Behavior. , 2016, Pediatric clinics of North America.

[34]  Robby van Delden,et al.  An Annotation Scheme for Social Interaction in Digital Playgrounds , 2012, ICEC.

[35]  Narcís Parés,et al.  Quality of physical activity of children in exergames: Sequential body movement analysis and its implications for interaction design , 2016, Int. J. Hum. Comput. Stud..

[36]  Stephen Hunter,et al.  Systematic review of sedentary behaviour and health indicators in school-aged children and youth: an update. , 2016, Applied physiology, nutrition, and metabolism = Physiologie appliquee, nutrition et metabolisme.

[37]  R. Pate,et al.  Physical Activity Assessment in Children and Adolescents , 2001, Sports medicine.

[38]  Ronald Poppe,et al.  Automatic behavior analysis in tag games: from traditional spaces to interactive playgrounds , 2016, Journal on Multimodal User Interfaces.

[39]  Jih-Hsuan Lin,et al.  Using Active Video Games for Physical Activity Promotion , 2013, Health education & behavior : the official publication of the Society for Public Health Education.

[40]  Regan L. Mandryk,et al.  Exertion Games , 2016, Found. Trends Hum. Comput. Interact..