Activity recognition in naturalistic environments using body-worn sensors

Faculty of Science, Agriculture and Engineering School of Computing Science Doctor of Philosophy Activity Recognition in Naturalistic Environments using Body-Worn Sensors by Nils Yannick Hammerla The research presented in this thesis investigates how deep learning and feature learning can address challenges that arise for activity recognition systems in naturalistic, ecologically valid surroundings such as the private home. One of the main aims of ubiquitous computing is the development of automated recognition systems for human activities and behaviour that are sufficiently robust to be deployed in realistic, in-the-wild environments. In most cases, the targeted application scenarios are people’s daily lives, where systems have to abide by practical usability and privacy constraints. We discuss how these constraints impact data collection and analysis and demonstrate how common approaches to the analysis of movement data effectively limit the practical use of activity recognition systems in every-day surroundings. In light of these issues we develop a novel approach to the representation and modelling of movement data based on a data-driven methodology that has applications in activity recognition, behaviour imaging, and skill assessment in ubiquitous computing. A number of case studies illustrate the suitability of the proposed methods and outline how study design can be adapted to maximise the benefit of these techniques, which show promising performance for clinical applications in particular.

[1]  Christian Thiel,et al.  Classification on Soft Labels Is Robust against Label Noise , 2008, KES.

[2]  Paul Lukowicz,et al.  Performance metrics for activity recognition , 2011, TIST.

[3]  Gregory D. Abowd,et al.  Recognizing mimicked autistic self-stimulatory behaviors using HMMs , 2005, Ninth IEEE International Symposium on Wearable Computers (ISWC'05).

[4]  Eric Foxlin,et al.  Pedestrian tracking with shoe-mounted inertial sensors , 2005, IEEE Computer Graphics and Applications.

[5]  Kenneth Meijer,et al.  Activity identification using body-mounted sensors—a review of classification techniques , 2009, Physiological measurement.

[6]  Guang-Zhong Yang,et al.  Real-Time Pervasive Monitoring for Postoperative Care , 2007, BSN.

[7]  Stephen Kwek,et al.  A boosting approach to remove class label noise , 2005, Fifth International Conference on Hybrid Intelligent Systems (HIS'05).

[8]  Sophia Menache,et al.  Dogs and Human Beings: A Story of Friendship , 1998 .

[9]  Nitish Srivastava,et al.  Improving neural networks by preventing co-adaptation of feature detectors , 2012, ArXiv.

[10]  Cassim Ladha,et al.  ClimbAX: skill assessment for climbing enthusiasts , 2013, UbiComp.

[11]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[12]  Mohan M. Trivedi,et al.  Head Pose Estimation in Computer Vision: A Survey , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Fu Jie Huang,et al.  A Tutorial on Energy-Based Learning , 2006 .

[14]  Ian T. Jolliffe,et al.  Principal Component Analysis , 2002, International Encyclopedia of Statistical Science.

[15]  Catrine Tudor-Locke,et al.  Comparison of pedometer and accelerometer accuracy under controlled conditions. , 2003, Medicine and science in sports and exercise.

[16]  Nassir Navab,et al.  Motif Discovery in OR Sensor Data with Application to Surgical Workflow Analysis and Activity Detection , 2009 .

[17]  Geoffrey E. Hinton Training Products of Experts by Minimizing Contrastive Divergence , 2002, Neural Computation.

[18]  Hugo Fuks,et al.  Qualitative activity recognition of weight lifting exercises , 2013, AH.

[19]  A F Bobick,et al.  Movement, activity and action: the role of knowledge in the perception of motion. , 1997, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[20]  Daniel Mills,et al.  The Encyclopedia of Applied Animal Behaviour and Welfare , 2010 .

[21]  Gerhard Tröster,et al.  Monitoring Kinematic Changes With Fatigue in Running Using Body-Worn Sensors , 2012, IEEE Transactions on Information Technology in Biomedicine.

[22]  O. Lindvall,et al.  Use and interpretation of on/off diaries in Parkinson’s disease , 2004, Journal of Neurology, Neurosurgery & Psychiatry.

[23]  Bernt Schiele,et al.  Multi Activity Recognition Based on Bodymodel-Derived Primitives , 2009, LoCA.

[24]  Stewart G Trost,et al.  Conducting accelerometer-based activity assessments in field-based research. , 2005, Medicine and science in sports and exercise.

[25]  V. van der Meer,et al.  Accuracy of Objective Ambulatory Accelerometry in Detecting Motor Complications in Patients With Parkinson Disease , 2004, Clinical neuropharmacology.

[26]  Paul H Chappell,et al.  Marker placement to describe the wrist movements during activities of daily living in cyclical tasks. , 2004, Clinical biomechanics.

[27]  Zhenyu He,et al.  Activity recognition from acceleration data based on discrete consine transform and SVM , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[28]  Irfan A. Essa,et al.  Discovering Characteristic Actions from On-Body Sensor Data , 2006, 2006 10th IEEE International Symposium on Wearable Computers.

[29]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition , 2012 .

[30]  Paul Lukowicz,et al.  Collecting complex activity datasets in highly rich networked sensor environments , 2010, 2010 Seventh International Conference on Networked Sensing Systems (INSS).

[31]  Dimitrios I. Fotiadis,et al.  Automated Levodopa-induced dyskinesia assessment , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[32]  Paul Lukowicz,et al.  Gesture spotting using wrist worn microphone and 3-axis accelerometer , 2005, sOc-EUSAI '05.

[33]  Luca Benini,et al.  Activity Recognition from On-Body Sensors: Accuracy-Power Trade-Off by Dynamic Sensor Selection , 2008, EWSN.

[34]  Paul Lukowicz,et al.  Recognizing Workshop Activity Using Body Worn Microphones and Accelerometers , 2004, Pervasive.

[35]  JoAnne K. Gronley,et al.  Use of cluster analysis for gait pattern classification of patients in the early and late recovery phases following stroke. , 2003, Gait & posture.

[36]  Suchi Saria,et al.  Discovering Deformable Motifs in Continuous Time Series Data , 2011, IJCAI.

[37]  Johnny L. Matson,et al.  A Review of Behavioral Treatments for Self-Injurious Behaviors of Persons With Autism Spectrum Disorders , 2008, Behavior modification.

[38]  Paolo Bonato,et al.  Monitoring Motor Fluctuations in Patients With Parkinson's Disease Using Wearable Sensors , 2009, IEEE Transactions on Information Technology in Biomedicine.

[39]  Farrokh Ayazi,et al.  Micromachined inertial sensors , 1998, Proc. IEEE.

[40]  Kristof Van Laerhoven,et al.  What shall we teach our pants? , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[41]  Ian D. Reid,et al.  A general method for human activity recognition in video , 2006, Comput. Vis. Image Underst..

[42]  Gary M. Weiss,et al.  Activity recognition using cell phone accelerometers , 2011, SKDD.

[43]  Shuangquan Wang,et al.  Human activity recognition with user-free accelerometers in the sensor networks , 2005, 2005 International Conference on Neural Networks and Brain.

[44]  R.V. Patel,et al.  Design of a sensorized instrument for skills assessment and training in minimally invasive surgery , 2008, 2008 2nd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics.

[45]  Ricardo Chavarriaga,et al.  Dynamic Quantification of Activity Recognition Capabilities in Opportunistic Systems , 2011, 2011 IEEE 73rd Vehicular Technology Conference (VTC Spring).

[46]  Gerhard Tröster,et al.  Experts lift differently: Classification of weight-lifting athletes , 2013, 2013 IEEE International Conference on Body Sensor Networks.

[47]  Gerhard Tröster,et al.  Recognizing turns and other snowboarding activities with a gyroscope , 2010, International Symposium on Wearable Computers (ISWC) 2010.

[48]  B. Kröse,et al.  Bayesian Activity Recognition in Residence for Elders , 2007 .

[49]  Geoffrey E. Hinton,et al.  Modeling pixel means and covariances using factorized third-order boltzmann machines , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[50]  Ling Bao,et al.  A context-aware experience sampling tool , 2003, CHI Extended Abstracts.

[51]  Ben J. A. Kröse,et al.  Efficient Greedy Learning of Gaussian Mixture Models , 2003, Neural Computation.

[52]  Alex Pentland,et al.  A Wearable Computer Based American Sign Language Recognizer , 1997, SEMWEB.

[53]  Lin Sun,et al.  Activity Recognition on an Accelerometer Embedded Mobile Phone with Varying Positions and Orientations , 2010, UIC.

[54]  M. Turvey,et al.  Symmetry, broken symmetry, and handedness in bimanual coordination dynamics , 2004, Experimental Brain Research.

[55]  Gwenn Englebienne,et al.  Accurate activity recognition in a home setting , 2008, UbiComp.

[56]  Paul Lukowicz,et al.  Gesture spotting with body-worn inertial sensors to detect user activities , 2008, Pattern Recognit..

[57]  Gregory D. Abowd,et al.  Context-Awareness in Wearable and Ubiquitous Computing , 1997, SEMWEB.

[58]  Kristof Van Laerhoven,et al.  Spine versus porcupine: a study in distributed wearable activity recognition , 2004, Eighth International Symposium on Wearable Computers.

[59]  V. Vardaxis,et al.  The effect of total hip arthroplasty surgical approach on gait , 2004, Journal of orthopaedic research : official publication of the Orthopaedic Research Society.

[60]  Guang-Zhong Yang,et al.  Development of a Wireless Sensor Glove for Surgical Skills Assessment , 2009, IEEE Transactions on Information Technology in Biomedicine.

[61]  Ronald Poppe,et al.  A survey on vision-based human action recognition , 2010, Image Vis. Comput..

[62]  Guang-Zhong Yang,et al.  The use of pervasive sensing for behaviour profiling - a survey , 2009, Pervasive Mob. Comput..

[63]  K. Chou A novel approach to predicting protein structural classes in a (20–1)‐D amino acid composition space , 1995, Proteins.

[64]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[65]  Guang-Zhong Yang,et al.  An HMM framework for optimal sensor selection with applications to BSN sensor glove design , 2007, EmNets '07.

[66]  Ronald Poppe,et al.  Evaluating the Future of HCI: Challenges for the Evaluation of Emerging Applications , 2007, Artifical Intelligence for Human Computing.

[67]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[68]  Wim G. M. Janssen,et al.  Determinants of the sit-to-stand movement: a review. , 2002, Physical therapy.

[69]  ScienceDirect Archives of physical medicine and rehabilitation , 1953 .

[70]  Philippe Bolon,et al.  Entropy as a global variable of the learning process , 1994 .

[71]  V. Heyward,et al.  Energy expenditure and physiological responses during indoor rock climbing. , 1997, British journal of sports medicine.

[72]  M. Breteler,et al.  Epidemiology of Parkinson's disease , 2006, The Lancet Neurology.

[73]  Bernt Schiele,et al.  ADL recognition based on the combination of RFID and accelerometer sensing , 2008, 2008 Second International Conference on Pervasive Computing Technologies for Healthcare.

[74]  Gregory D. Abowd,et al.  Automatic Synchronization of Wearable Sensors and Video-Cameras for Ground Truth Annotation -- A Practical Approach , 2012, 2012 16th International Symposium on Wearable Computers.

[75]  R. G. Smith,et al.  Antecedent influences on behavior disorders. , 1997, Journal of applied behavior analysis.

[76]  Patrick Olivier,et al.  Slice&Dice: Recognizing Food Preparation Activities Using Embedded Accelerometers , 2009, AmI.

[77]  Branislav Kveton,et al.  Inferring Identity Using Accelerometers in Television Remote Controls , 2009, Pervasive.

[78]  A. Atiya,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2005, IEEE Transactions on Neural Networks.

[79]  I Frosio,et al.  3D analysis of the body center of mass in rock climbing. , 2007, Human movement science.

[80]  Eamonn J. Keogh,et al.  Segmenting Time Series: A Survey and Novel Approach , 2002 .

[81]  Janet M. Baker,et al.  The Design for the Wall Street Journal-based CSR Corpus , 1992, HLT.

[82]  Emiliano Miluzzo,et al.  A survey of mobile phone sensing , 2010, IEEE Communications Magazine.

[83]  Gregory D. Abowd,et al.  The Aware Home: A Living Laboratory for Ubiquitous Computing Research , 1999, CoBuild.

[84]  Simon G. M. Koo,et al.  A Survey on Context-Aware Sensing for Body Sensor Networks , 2010, Wirel. Sens. Netw..

[85]  Ahmed H. Tewfik,et al.  Novel pattern detection in children with Autism Spectrum Disorder using Iterative Subspace Identification , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[86]  V. L. Nickel,et al.  Gait parameters following stroke: a practical assessment. , 1995, Journal of rehabilitation research and development.

[87]  Gerhard Tröster,et al.  Out of the lab and into the woods: kinematic analysis in running using wearable sensors , 2011, UbiComp '11.

[88]  Sharon C. Lyter,et al.  Diagnostic and Statistical Manual of Mental Disorders: Making it Work for Social Work , 2012 .

[89]  Guang-Zhong Yang,et al.  Body Sensor Networks for Monitoring Rowing Technique , 2009, 2009 Sixth International Workshop on Wearable and Implantable Body Sensor Networks.

[90]  Matthew S. Goodwin,et al.  Recognizing stereotypical motor movements in the laboratory and classroom: a case study with children on the autism spectrum , 2009, UbiComp.

[91]  Nello Cristianini,et al.  Kernel Methods for Pattern Analysis , 2004 .

[92]  Jack W. Judy,et al.  Microelectromechanical systems (MEMS): fabrication, design and applications , 2001 .

[93]  Patrick Olivier,et al.  Feature Learning for Activity Recognition in Ubiquitous Computing , 2011, IJCAI.

[94]  Adrian Hilton,et al.  A survey of advances in vision-based human motion capture and analysis , 2006, Comput. Vis. Image Underst..

[95]  Christopher G. Atkeson,et al.  Predicting human interruptibility with sensors , 2005, TCHI.

[96]  Daniel Jackson,et al.  Towards a pervasive kitchen infrastructure for measuring cooking competence , 2011, 2011 5th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops.

[97]  Daniel Arthur James,et al.  Towards a wearable device for skill assessment and skill acquisition of a tennis player during the first serve , 2009 .

[98]  P. Fentem,et al.  ABC of Sports Medicine: Benefits of exercise in health and disease , 1994 .

[99]  W. Eric L. Grimson,et al.  Gait analysis for recognition and classification , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[100]  Gaetano Borriello,et al.  A Practical Approach to Recognizing Physical Activities , 2006, Pervasive.

[101]  Jakob E. Bardram,et al.  Phase recognition during surgical procedures using embedded and body-worn sensors , 2011, 2011 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[102]  Gregory D. Hager,et al.  Fast and Globally Convergent Pose Estimation from Video Images , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[103]  Sabine Fenstermacher,et al.  Research In Psychology Methods And Design , 2016 .

[104]  Eric Horvitz,et al.  Layered representations for human activity recognition , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[105]  Mi Zhang,et al.  USC-HAD: a daily activity dataset for ubiquitous activity recognition using wearable sensors , 2012, UbiComp.

[106]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[107]  Guang-Zhong Yang,et al.  Sensor Positioning for Activity Recognition Using Wearable Accelerometers , 2011, IEEE Transactions on Biomedical Circuits and Systems.

[108]  James A. Landay,et al.  The Mobile Sensing Platform: An Embedded Activity Recognition System , 2008, IEEE Pervasive Computing.

[109]  Frank M. Gresham,et al.  Functional Behavioral Assessment: Principles, Procedures, and Future Directions , 2001 .

[110]  J Rojahn,et al.  The Behavior Problems Inventory: An Instrument for the Assessment of Self-Injury, Stereotyped Behavior, and Aggression/Destruction in Individuals with Developmental Disabilities , 2001, Journal of autism and developmental disorders.

[111]  Paul Lukowicz,et al.  Activity Recognition of Assembly Tasks Using Body-Worn Microphones and Accelerometers , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[112]  Christian Wojek,et al.  Activity Recognition and Room-Level Tracking in an Office Environment , 2006, 2006 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems.

[113]  Chengjie Xiong,et al.  Unified Parkinson's Disease Rating Scale-Motor Exam: inter-rater reliability of advanced practice nurse and neurologist assessments. , 2010, Journal of advanced nursing.

[114]  X. Huo,et al.  A Survey of Manifold-Based Learning Methods , 2007 .

[115]  Brian Kingsbury,et al.  New types of deep neural network learning for speech recognition and related applications: an overview , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[116]  J.K. Aggarwal,et al.  Human activity analysis , 2011, ACM Comput. Surv..

[117]  Tony R. Martinez,et al.  Reduction Techniques for Instance-Based Learning Algorithms , 2000, Machine Learning.

[118]  Huosheng Hu,et al.  Integration of Vision and Inertial Sensors for 3D Arm Motion Tracking in Home-based Rehabilitation , 2007, Int. J. Robotics Res..

[119]  Jeffrey M. Hausdorff,et al.  Gait asymmetry in patients with Parkinson’s disease and elderly fallers: when does the bilateral coordination of gait require attention? , 2007, Experimental Brain Research.

[120]  R. Mccoy,et al.  Prevalence and risk factors of maladaptive behaviour in young children with Autistic Disorder. , 2008, Journal of intellectual disability research : JIDR.

[121]  G Ellis,et al.  Sport-specific power assessment for rock climbing. , 2011, The Journal of sports medicine and physical fitness.

[122]  D. Ly,et al.  Neural Networks on GPUs : Restricted Boltzmann Machines , 2009 .

[123]  Jeffrey M. Hausdorff Gait dynamics in Parkinson's disease: common and distinct behavior among stride length, gait variability, and fractal-like scaling. , 2009, Chaos.

[124]  Michael L. Littman,et al.  Activity Recognition from Accelerometer Data , 2005, AAAI.

[125]  J. E. Carr,et al.  Functional analysis of aberrant behavior maintained by automatic reinforcement: assessments of specific sensory reinforcers. , 2000, Research in developmental disabilities.

[126]  Bernt Schiele,et al.  Analyzing features for activity recognition , 2005, sOc-EUSAI '05.

[127]  Sydney Katz Assessing Self‐maintenance: Activities of Daily Living, Mobility, and Instrumental Activities of Daily Living , 1983, Journal of the American Geriatrics Society.

[128]  M. Testa,et al.  Effects of the type of holds and movement amplitude on postural control associated with a climbing task. , 1999, Gait & posture.

[129]  Diogo R. Ferreira,et al.  Preprocessing techniques for context recognition from accelerometer data , 2010, Personal and Ubiquitous Computing.

[130]  Adam G. Rehorn,et al.  State-of-the-art methods and results in tool condition monitoring: a review , 2005 .

[131]  B. Tonge,et al.  Behaviour and emotional problems in toddlers with pervasive developmental disorders and developmental delay: associations with parental mental health and family functioning. , 2006, Journal of intellectual disability research : JIDR.

[132]  Bodo Rosenhahn,et al.  Multisensor-fusion for 3D full-body human motion capture , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[133]  Brian A Iwata,et al.  Functional analysis of problem behavior: a review. , 2003, Journal of applied behavior analysis.

[134]  Guang-Zhong Yang,et al.  ClimBSN: Climber performance monitoring with BSN , 2008, 2008 5th International Summer School and Symposium on Medical Devices and Biosensors.

[135]  D. J. White,et al.  A Time Motion Analysis of Bouldering Style Competitive Rock Climbing , 2010, Journal of strength and conditioning research.

[136]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[137]  Matthias Kranz,et al.  GymSkill: A personal trainer for physical exercises , 2012, 2012 IEEE International Conference on Pervasive Computing and Communications.

[138]  Jennifer Healey,et al.  A Long-Term Evaluation of Sensing Modalities for Activity Recognition , 2007, UbiComp.

[139]  Ahmed H. Tewfik,et al.  Automatic characterization and detection of behavioral patterns using linear predictive coding of accelerometer sensor data , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[140]  Bernt Schiele,et al.  Daily Routine Recognition through Activity Spotting , 2009, LoCA.

[141]  Shie Mannor,et al.  Activity and Gait Recognition with Time-Delay Embeddings , 2010, AAAI.

[142]  Geoffrey E. Hinton,et al.  Factored conditional restricted Boltzmann Machines for modeling motion style , 2009, ICML '09.

[143]  Agata Rozga,et al.  Automatic assessment of problem behavior in individuals with developmental disabilities , 2012, UbiComp.

[144]  W. Browne,et al.  Number and ownership profiles of cats and dogs in the UK , 2010, Veterinary Record.

[145]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.

[146]  D T Barry,et al.  Muscle fatigue measured with evoked muscle vibrations , 1992, Muscle & nerve.

[147]  Ye Xu,et al.  Enabling large-scale human activity inference on smartphones using community similarity networks (csn) , 2011, UbiComp '11.

[148]  Eliathamby Ambikairajah,et al.  Classification of a known sequence of motions and postures from accelerometry data using adapted Gaussian mixture models. , 2006, Physiological measurement.

[149]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[150]  G. Bath A Natural History of Domesticated Mammals , 2001 .

[151]  Bernt Schiele,et al.  Exploring semi-supervised and active learning for activity recognition , 2008, 2008 12th IEEE International Symposium on Wearable Computers.

[152]  Kristof Van Laerhoven,et al.  Detecting leisure activities with dense motif discovery , 2012, UbiComp.

[153]  Diane J. Cook,et al.  How smart are our environments? An updated look at the state of the art , 2007, Pervasive Mob. Comput..

[154]  Norbert Gyorbíró,et al.  An Activity Recognition System For Mobile Phones , 2009, Mob. Networks Appl..

[155]  Christopher John Chapman Real-Time American Sign Language gesture generator , 1998 .

[156]  Bernt Schiele,et al.  A tutorial on human activity recognition using body-worn inertial sensors , 2014, CSUR.

[157]  Blaine Nelson,et al.  Support Vector Machines Under Adversarial Label Noise , 2011, ACML.

[158]  Daniel P. Siewiorek,et al.  Activity recognition and monitoring using multiple sensors on different body positions , 2006, International Workshop on Wearable and Implantable Body Sensor Networks (BSN'06).

[159]  Gavin C. Cawley,et al.  Preventing Over-Fitting during Model Selection via Bayesian Regularisation of the Hyper-Parameters , 2007, J. Mach. Learn. Res..

[160]  Gernot A. Fink,et al.  Markov models for offline handwriting recognition: a survey , 2009, International Journal on Document Analysis and Recognition (IJDAR).

[161]  Jeffrey M. Hausdorff,et al.  Wearable Assistant for Parkinson’s Disease Patients With the Freezing of Gait Symptom , 2010, IEEE Transactions on Information Technology in Biomedicine.

[162]  S. Hamid Nawab,et al.  Dynamic neural network detection of tremor and dyskinesia from wearable sensor data , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[163]  Peter C. Thomson,et al.  Behavioral and physiological predictors of guide dog success , 2011 .

[164]  Gunnar Rätsch,et al.  Kernel PCA and De-Noising in Feature Spaces , 1998, NIPS.

[165]  Paul S. Martin,et al.  Measuring Behaviour: An Introductory Guide , 1986 .

[166]  Tatsuya Yamazaki,et al.  Ubiquitous home: real-life testbed for home context-aware service , 2005, First International Conference on Testbeds and Research Infrastructures for the DEvelopment of NeTworks and COMmunities.

[167]  Daniel Jackson,et al.  The french kitchen: task-based learning in an instrumented kitchen , 2012, UbiComp.

[168]  David Andre,et al.  Recent Advances in Free-Living Physical Activity Monitoring: A Review , 2007, Journal of diabetes science and technology.

[169]  Young-Koo Lee,et al.  Semi-Markov conditional random fields for accelerometer-based activity recognition , 2010, Applied Intelligence.

[170]  Patrick Olivier,et al.  The mobile fitness coach: Towards individualized skill assessment using personalized mobile devices , 2013, Pervasive Mob. Comput..

[171]  Rajesh Aggarwal,et al.  Synchronized video and motion analysis for the assessment of procedures in the operating theater. , 2005, Archives of surgery.

[172]  Lian-Wen Jin,et al.  Activity recognition from acceleration data using AR model representation and SVM , 2008, 2008 International Conference on Machine Learning and Cybernetics.

[173]  J. Blacher,et al.  Preschool children with intellectual disability: syndrome specificity, behaviour problems, and maternal well-being. , 2005, Journal of intellectual disability research : JIDR.

[174]  Patrick Olivier,et al.  Assessing Motor Performance with PCA , 2011 .

[175]  Jeff A. Bilmes,et al.  A gentle tutorial of the em algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models , 1998 .

[176]  J. Jankovic,et al.  Movement Disorder Society‐sponsored revision of the Unified Parkinson's Disease Rating Scale (MDS‐UPDRS): Scale presentation and clinimetric testing results , 2008, Movement disorders : official journal of the Movement Disorder Society.

[177]  William G. Griswold,et al.  Challenge: ubiquitous location-aware computing and the "place lab" initiative , 2003, WMASH '03.

[178]  Mark F. O’Reilly,et al.  A review of interventions to reduce challenging behavior in school settings for students with autism spectrum disorders , 2007 .

[179]  Paul Müller,et al.  Ambient Intelligence in Assisted Living: Enable Elderly People to Handle Future Interfaces , 2007, HCI.

[180]  Thomas Plötz,et al.  Using unlabeled data in a sparse-coding framework for human activity recognition , 2014, Pervasive Mob. Comput..

[181]  Sher ry Folsom-Meek,et al.  Human Performance , 2020, Nature.

[182]  T. Achenbach Manual for the ASEBA preschool forms & profiles : an integrated system of multi-informant assessment , 2000 .

[183]  Yoram Singer,et al.  Leveraging the margin more carefully , 2004, ICML.

[184]  Paul Lukowicz,et al.  Continuous activity recognition in the kitchen using miniaturised sensor button , 2006 .

[185]  A. Mcgregor,et al.  Body-Worn Sensor Design: What Do Patients and Clinicians Want? , 2011, Annals of Biomedical Engineering.

[186]  William C. Mann,et al.  The Gator Tech Smart House: a programmable pervasive space , 2005, Computer.

[187]  Bernt Schiele,et al.  Discovery of activity patterns using topic models , 2008 .

[188]  Didier Stricker,et al.  Introducing a New Benchmarked Dataset for Activity Monitoring , 2012, 2012 16th International Symposium on Wearable Computers.

[189]  Carl Scarrott,et al.  Plasma Cortisol Concentrations and Perceived Anxiety in Response to On-Sight Rock Climbing , 2011, International Journal of Sports Medicine.

[190]  Brian A. Iwata,et al.  Implications of Functional Analysis Methodology for the Design of Intervention Programs , 2005 .

[191]  Paul J. M. Havinga,et al.  Activity Recognition Using Inertial Sensing for Healthcare, Wellbeing and Sports Applications: A Survey , 2010, ARCS Workshops.

[192]  Paul Lukowicz,et al.  Performance Metrics and Evaluation Issues for Continuous Activity Recognition , 2006 .

[193]  B. Bloem,et al.  Quantitative wearable sensors for objective assessment of Parkinson's disease , 2013, Movement disorders : official journal of the Movement Disorder Society.

[194]  M. Hoehn,et al.  Parkinsonism , 1967, Neurology.

[195]  Xi Long,et al.  Single-accelerometer-based daily physical activity classification , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[196]  L. Lecavalier,et al.  The impact of behaviour problems on caregiver stress in young people with autism spectrum disorders. , 2006, Journal of intellectual disability research : JIDR.

[197]  Daniel Povey,et al.  Revisiting semi-continuous hidden Markov models , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[198]  Tapio Seppänen,et al.  Recognizing human motion with multiple acceleration sensors , 2001, 2001 IEEE International Conference on Systems, Man and Cybernetics. e-Systems and e-Man for Cybernetics in Cyberspace (Cat.No.01CH37236).

[199]  Deborah Estrin,et al.  Improving activity classification for health applications on mobile devices using active and semi-supervised learning , 2010, 2010 4th International Conference on Pervasive Computing Technologies for Healthcare.

[200]  Gregory D. Abowd,et al.  The Aware Home: A living laboratory for technologies for successful aging , 2002 .

[201]  G. ÓLaighin,et al.  Direct measurement of human movement by accelerometry. , 2008, Medical engineering & physics.

[202]  Vigneshwaran Subbaraju,et al.  Energy-Efficient Continuous Activity Recognition on Mobile Phones: An Activity-Adaptive Approach , 2012, 2012 16th International Symposium on Wearable Computers.

[203]  Mark Twight,et al.  Extreme Alpinism: Climbing Light, Fast, and High , 1999 .

[204]  Gerhard Tröster,et al.  SwimMaster: a wearable assistant for swimmer , 2009, UbiComp.

[205]  Ricardo Chavarriaga,et al.  The Opportunity challenge: A benchmark database for on-body sensor-based activity recognition , 2013, Pattern Recognit. Lett..

[206]  Nassir Navab,et al.  On-line Recognition of Surgical Activity for Monitoring in the Operating Room , 2008, AAAI.

[207]  Honglak Lee,et al.  Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations , 2009, ICML '09.

[208]  Patrick Olivier,et al.  A Dynamic Time Warping Approach to Real-Time Activity Recognition for Food Preparation , 2010, AmI.

[209]  C. Gielen,et al.  Detection and assessment of the severity of Levodopa‐induced dyskinesia in patients with Parkinson's disease by neural networks , 2000, Movement disorders : official journal of the Movement Disorder Society.

[210]  Mike Y. Chen,et al.  Tracking Free-Weight Exercises , 2007, UbiComp.

[211]  Florian Michahelles,et al.  Sensing and monitoring professional skiers , 2005, IEEE Pervasive Computing.

[212]  Bill N. Schilit,et al.  Place Lab: Device Positioning Using Radio Beacons in the Wild , 2005, Pervasive.

[213]  Tatsuo Nakajima,et al.  Feature Selection and Activity Recognition from Wearable Sensors , 2006, UCS.

[214]  Robert D. Grober An Accelerometer Based Instrumentation of the Golf Club: Measurement and Signal Analysis , 2010 .

[215]  Wojciech Matusik,et al.  Practical motion capture in everyday surroundings , 2007, SIGGRAPH 2007.

[216]  M. Rutter,et al.  Adult outcome for children with autism. , 2004, Journal of child psychology and psychiatry, and allied disciplines.

[217]  D.A. James,et al.  Investigating the translational and rotational motion of the swing using accelerometers for athlete skill assessment , 2006, 2006 5th IEEE Conference on Sensors.

[218]  Kent Larson,et al.  Tools for Studying Behavior and Technology in Natural Settings , 2003, UbiComp.

[219]  Paul Lukowicz,et al.  Where am I: Recognizing On-body Positions of Wearable Sensors , 2005, LoCA.

[220]  P. Kempster,et al.  Automated assessment of bradykinesia and dyskinesia in Parkinson's disease. , 2012, Journal of Parkinson's disease.

[221]  Paul Lukowicz,et al.  Wearable Activity Tracking in Car Manufacturing , 2008, IEEE Pervasive Computing.

[222]  Kirsti Grobel,et al.  Isolated sign language recognition using hidden Markov models , 1996, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[223]  Gernot A. Fink,et al.  Markov Models for Pattern Recognition: From Theory to Applications , 2007 .

[224]  Li Wei,et al.  Experiencing SAX: a novel symbolic representation of time series , 2007, Data Mining and Knowledge Discovery.

[225]  D. Custance,et al.  Is the dog-human relationship an attachment bond? An observational study using Ainsworth's strange situation , 2003 .

[226]  Katherine E Henson,et al.  Risk of Suicide After Cancer Diagnosis in England , 2018, JAMA psychiatry.

[227]  Jesse Hoey,et al.  Sensor-Based Activity Recognition , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[228]  Eric J. Hörst Training for Climbing: The Definitive Guide to Improving Your Performance , 2008 .

[229]  Geoffrey E. Hinton,et al.  To recognize shapes, first learn to generate images. , 2007, Progress in brain research.

[230]  Allen Fyffe,et al.  Handbook of Climbing , 1991 .

[231]  Joseph P. Giuffrida,et al.  Clinically deployable Kinesia™ technology for automated tremor assessment , 2009, Movement disorders : official journal of the Movement Disorder Society.

[232]  Patrick Olivier,et al.  Activity Recognition and Healthier Food Preparation , 2011 .

[233]  Kristof Van Laerhoven,et al.  When Else Did This Happen? Efficient Subsequence Representation and Matching for Wearable Activity Data , 2009, 2009 International Symposium on Wearable Computers.

[234]  Angelo M. Sabatini,et al.  Machine Learning Methods for Classifying Human Physical Activity from On-Body Accelerometers , 2010, Sensors.

[235]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[236]  Mani B. Srivastava,et al.  Movement Analysis in Rock-Climbers , 2007, IPSN.

[237]  Robert Harle,et al.  Modeling the Model Athlete: Automatic Coaching of Rowing Technique , 2008, SSPR/SPR.

[238]  M. Aman,et al.  Psychometric characteristics of the aberrant behavior checklist. , 1985, American journal of mental deficiency.

[239]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[240]  Huosheng Hu,et al.  Human motion tracking for rehabilitation - A survey , 2008, Biomed. Signal Process. Control..

[241]  Jitendra Malik,et al.  Recognizing action at a distance , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[242]  Thomas O. Mera,et al.  Feasibility of home-based automated Parkinson's disease motor assessment , 2012, Journal of Neuroscience Methods.

[243]  Rezaul Begg,et al.  Overview of movement analysis and gait features , 2006 .

[244]  Matthew S. Goodwin,et al.  Automated Detection of Stereotypical Motor Movements , 2011, Journal of autism and developmental disorders.

[245]  Anil K. Jain,et al.  Unsupervised Learning of Finite Mixture Models , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[246]  Tao Liu,et al.  Development of a wearable sensor system for quantitative gait analysis , 2009 .

[247]  Patrick Olivier,et al.  Ambient kitchen: designing situated services using a high fidelity prototyping environment , 2009, PETRA '09.

[248]  Franz Konstantin Fuss,et al.  Instrumented climbing holds and performance analysis in sport climbing , 2008 .

[249]  Eric Campo,et al.  A review of smart homes - Present state and future challenges , 2008, Comput. Methods Programs Biomed..

[250]  Franck Quaine,et al.  Effect of a leg movement on the organisation of the forces at the holds in a climbing position 3-D kinetic analysis , 1997 .

[251]  Francisco Herrera,et al.  Prototype Selection for Nearest Neighbor Classification: Taxonomy and Empirical Study , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.