Automated Detection of Infant Holding Using Wearable Sensing

Physical contact is critical for children's physical and emotional growth and well-being. Previous studies of physical contact are limited to relatively short periods of direct observation and self-report methods. These methods limit researchers' understanding of the natural variation in physical contact across families, and its specific impacts on child development. In this study we develop a mobile sensing platform that can provide objective, unobtrusive, and continuous measurements of physical contact in naturalistic home interactions. Using commercially available motion detectors, our model reaches an accuracy of 0.870 (std: 0.059) for a second-by-second binary classification of holding. In addition, we detail five assessment scenarios applicable to the development of activity recognition models for social science research, where required accuracy may vary as a function of the intended use. Finally, we propose a grand vision for leveraging mobile sensors to access high-density markers of multiple determinants of early parent-child interactions, with implications for basic science and intervention.

[1]  Donald J. Patterson,et al.  Augmenting gesture recognition with erlang-cox models to identify neurological disorders in premature babies , 2012, UbiComp.

[2]  W. Collins,et al.  The Development of the Person: The Minnesota Study of Risk and Adaptation from Birth to Adulthood , 2005 .

[3]  Daniel Jackson,et al.  Rapid specification and automated generation of prompting systems to assist people with dementia , 2011, Pervasive Mob. Comput..

[4]  T. Field,et al.  Vagal activity, gastric motility, and weight gain in massaged preterm neonates. , 2005, The Journal of pediatrics.

[5]  M. Edhborg,et al.  Early contact versus separation: effects on mother-infant interaction one year later. , 2009, Birth.

[6]  Tiffany M Field,et al.  Touch in Early Development , 1995 .

[7]  E Anisfeld,et al.  Does infant carrying promote attachment? An experimental study of the effects of increased physical contact on the development of attachment. , 1990, Child development.

[8]  R. Slatcher,et al.  Asthma-Related Immune Responses in Youth With Asthma: Associations With Maternal Responsiveness and Expressions of Positive and Negative Affect in Daily Life , 2015, Psychosomatic medicine.

[9]  T. Main,et al.  Maternal Responsiveness and Infant Mental Abilities : Specific Predictive Relations , 2001 .

[10]  Kaya de Barbaro,et al.  Automated sensing of daily activity: A new lens into development. , 2019 .

[11]  Gregory D. Abowd,et al.  Automatic Synchronization of Wearable Sensors and Video-Cameras for Ground Truth Annotation -- A Practical Approach , 2012, 2012 16th International Symposium on Wearable Computers.

[12]  C. Legare,et al.  Mother–Infant Physical Contact Predicts Responsive Feeding among U.S. Breastfeeding Mothers , 2018, Nutrients.

[13]  Matthew J. Hertenstein.  Touch: Its Communicative Functions in Infancy , 2002, Human Development.

[14]  Agata Rozga,et al.  Automatic assessment of problem behavior in individuals with developmental disabilities , 2012, UbiComp.

[15]  Patrick Olivier,et al.  Activity Recognition and Healthier Food Preparation , 2011 .

[16]  Howard F. Andrews,et al.  The origins of 12-month attachment: A microanalysis of 4-month mother–infant interaction , 2010, Attachment & human development.

[17]  M. Ainsworth,et al.  Attachment as Related to Mother-Infant Interaction , 1979 .

[18]  J. Kim-Cohen.  The development of the person: The Minnesota Study of Risk and Adaptation from Birth to Adulthood , 2008 .

[19]  Larry Gray,et al.  Skin-to-Skin Contact Is Analgesic in Healthy Newborns , 2000, Pediatrics.

[20]  A. Conde-Agudelo,et al.  Kangaroo mother care to reduce morbidity and mortality in low birthweight infants. , 2011, The Cochrane database of systematic reviews.

[21]  Kagan,et al.  The physiology and psychology of behavioral inhibition in children. , 1987, Child development.

[22]  T. Beauchaine,et al.  Vagal tone, development, and Gray's motivational theory: Toward an integrated model of autonomic nervous system functioning in psychopathology , 2001, Development and Psychopathology.

[23]  R. Feldman,et al.  Mother and infant coordinate heart rhythms through episodes of interaction synchrony. , 2011, Infant behavior & development.

[24]  L. Sroufe,et al.  The Coherence of Individual Development: Early Care, Attachment, and Subsequent Developmental Issues. , 1979 .

[25]  Gillian R. Hayes,et al.  Estrellita , 2014, ACM Trans. Comput. Hum. Interact..

[26]  B. Egeland,et al.  Infant-mother attachment: factors related to its development and changes over time. , 1984, Child development.

[27]  Matthew J. Hertenstein,et al.  The Communicative Functions of Touch in Humans, Nonhuman Primates, and Rats: A Review and Synthesis of the Empirical Research , 2006, Genetic, social, and general psychology monographs.

[28]  Amie K. Senland,et al.  The Neuroscience of Human Relationships: Attachment and the Developing Social Brain , 2015 .

[29]  T. Field,et al.  Preterm infant massage therapy research: a review. , 2010, Infant behavior & development.

[30]  J. L. Roopnarine,et al.  Characteristics of Holding, Patterns of Play, and Social Behaviors between Parents and Infants in New Delhi, India. , 1990 .

[31]  Mark A. Clements,et al.  Formant-based feature extraction for emotion classification from speech , 2015, 2015 38th International Conference on Telecommunications and Signal Processing (TSP).

[32]  S. Feldstein,et al.  Rhythms of dialogue in infancy: coordinated timing in development. , 2001, Monographs of the Society for Research in Child Development.

[33]  Patrick Olivier,et al.  The mobile fitness coach: Towards individualized skill assessment using personalized mobile devices , 2013, Pervasive Mob. Comput..

[34]  Richard Walker,et al.  PD Disease State Assessment in Naturalistic Environments Using Deep Learning , 2015, AAAI.

[35]  M. Klaus,et al.  Maternal attachment. Importance of the first post-partum days. , 1972, The New England journal of medicine.

[36]  R. Barr,et al.  Increased carrying reduces infant crying: a randomized controlled trial. , 1986, Pediatrics.

[37]  Jung Wook Park,et al.  Child Activity Recognition Based on Cooperative Fusion Model of a Triaxial Accelerometer and a Barometric Pressure Sensor , 2013, IEEE Journal of Biomedical and Health Informatics.

[38]  C. Poets,et al.  Skin-to-skin (kangaroo) care, respiratory control, and thermoregulation. , 2001, The Journal of pediatrics.

[39]  Nikki Newhouse,et al.  Quantified Baby , 2017, Proc. ACM Hum. Comput. Interact..

[40]  Paul J. M. Havinga,et al.  Activity Recognition Using Inertial Sensing for Healthcare, Wellbeing and Sports Applications: A Survey , 2010, ARCS Workshops.