BlobSnake: gamification of feature extraction for 'plug and play' human activity recognition

We present BlobSnake, a casual game designed to help generate new feature representations in the context of Human Activity Recognition. Feature selection is an essential task to be completed in the context of developing any non-trivial activity recognition system for a new set of activities. Presently, using anything other than a set of standard features requires a considerable amount of effort to be expended upon expert driven algorithm development. BlobSnake is an alternative approach which uses direct interaction with real sensor data by non-experts in order to develop additional features, thus lowering the cost and expertise otherwise required to produce more effective recognition performance. Our experiments demonstrate that our method improves upon the state of the art performance of standard features in a challenging recognition scenario.

[1]  Henry A. Kautz,et al.  Real-time crowd labeling for deployable activity recognition , 2013, CSCW.

[2]  Tim J. Hutton.  The Organic Builder: A Public Experiment in Artificial Chemistries and Self-Replication , 2009, Artificial Life.

[3]  Paul Lukowicz,et al.  Wearable Activity Tracking in Car Manufacturing , 2008, IEEE Pervasive Computing.

[4]  C. Lintott,et al.  Galaxy Zoo Green Peas: discovery of a class of compact extremely star-forming galaxies , 2009, 0907.4155.

[5]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[6]  Daniel Jackson,et al.  The break-time barometer: an exploratory system forworkplace break-time social awareness , 2013, UbiComp.

[7]  Peter Andras,et al.  On preserving statistical characteristics of accelerometry data using their empirical cumulative distribution , 2013, ISWC '13.

[8]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[9]  Jeffrey M. Hausdorff,et al.  Wearable Assistant for Parkinson’s Disease Patients With the Freezing of Gait Symptom , 2010, IEEE Transactions on Information Technology in Biomedicine.

[10]  Cassim Ladha,et al.  Dog's life: wearable activity recognition for dogs , 2013, UbiComp.

[11]  Z. Popovic,et al.  Increased Diels-Alderase activity through backbone remodeling guided by Foldit players , 2012, Nature Biotechnology.

[12]  Jesper Juul,et al.  Easy to use and incredibly difficult: on the mythical border between interface and gameplay , 2009, FDG.

[13]  Joe Marks,et al.  Human-guided search , 2010, J. Heuristics.

[14]  Didier Stricker,et al.  Confidence-based multiclass AdaBoost for physical activity monitoring , 2013, ISWC '13.

[15]  Vincent Martin,et al.  FIDO - facilitating interactions for dogs with occupations: wearable dog-activated interfaces , 2013, ISWC '13.

[16]  Walter S. Lasecki,et al.  Finding dependencies between actions using the crowd , 2014, CHI.

[17]  Ricardo Chavarriaga,et al.  The Opportunity challenge: A benchmark database for on-body sensor-based activity recognition , 2013, Pattern Recognit. Lett..

[18]  A. Imran Nordin,et al.  Chapter 0 Immersion in Digital Games : a Review of Gaming Experience Research , 2012 .

[19]  Laura A. Dabbish,et al.  Designing games with a purpose , 2008, CACM.

[20]  Bernt Schiele,et al.  Analyzing features for activity recognition , 2005, sOc-EUSAI '05.

[21]  Shie Mannor,et al.  Activity and Gait Recognition with Time-Delay Embeddings , 2010, AAAI.

[22]  Daniel Roggen,et al.  Automatic correction of annotation boundaries in activity datasets by class separation maximization , 2013, UbiComp.

[23]  Agata Rozga,et al.  Automatic assessment of problem behavior in individuals with developmental disabilities , 2012, UbiComp.

[24]  Richard Walker,et al.  PD Disease State Assessment in Naturalistic Environments Using Deep Learning , 2015, AAAI.

[25]  Bernt Schiele,et al.  A tutorial on human activity recognition using body-worn inertial sensors , 2014, CSUR.

[26]  Matthew S. Goodwin,et al.  Detecting stereotypical motor movements in the classroom using accelerometry and pattern recognition algorithms , 2012, Pervasive Mob. Comput..

[27]  James Alexander,et al.  Nature and significance of play as A cultural phenomenon , 2016 .

[28]  Katie Salen,et al.  Rules of play: game design fundamentals , 2003 .

[29]  Patrick Olivier,et al.  Dancing with horses: automated quality feedback for dressage riders , 2015, UbiComp.

[30]  Matthew S. Goodwin,et al.  Automated Detection of Stereotypical Motor Movements , 2011, Journal of autism and developmental disorders.