An automated approach for measuring infant head orientation in a face-to-face interaction

Head orientation in face-to-face interactions between mothers and infants is an important component of their communicative processes. Manual coding, however, is laborious. Obtaining inter-observer reliability is difficult, with disagreements mostly being related to the on- and offsets of a limited number of orientation categories. We used a motion capture system and developed an automated method for the quantitative measurement of infant head orientation in mother–-infant face-to-face-interactions. Automated motion capture systems have the potential to objectively document not only the on- and offset of behaviors, but also continuous changes. Infants wore a cap with three reflecting markers, and eight infrared cameras captured the positions of the markers. Analytic algorithms generated continuous three-dimensional descriptions of the infants’ head movements. We report here on an initial feasibility study of four infants. To evaluate the effectiveness of the automated approach, we compared it to standard manual categorical coding of six infant head orientations. We found that the central reliability issue was disagreement at the boundaries of the coding categories identified by continuous automated coding versus manual coding. The automated method was both more feasible and more precise in capturing continuous small changes. The study provides evidence for the usefulness of automated measurement of infant head orientation when infants interact in relational space.

[1]  E. Tronick.  Emotions and emotional communication in infants. , 1989, The American psychologist.

[2]  J. Fagard,et al.  Goal‐directed arm movements in children with fetal alcohol syndrome: a kinematic approach , 2011, European journal of neurology.

[3]  James Jaccard,et al.  Non-expert ratings of infant and parent emotion: Concordance with expert coding and relevance to early autism risk , 2010, International journal of behavioral development.

[4]  Marco Costa,et al.  Interpersonal Distances in Group Walking , 2010 .

[5]  A. Fogel,et al.  Developmental changes in the relationship between the infant's attention and emotion during early face-to-face communication: the 2-month transition. , 2005, Developmental psychology.

[6]  E. Tronick,et al.  Infants of depressed mothers. , 2009, Harvard review of psychiatry.

[7]  Hedda Lausberg,et al.  Methods in Gesture Research: , 2009 .

[8]  E Thelen,et al.  Development of reaching during the first year: role of movement speed. , 1996, Journal of experimental psychology. Human perception and performance.

[9]  R. Bakeman,et al.  Sequential analysis and observational methods for the behavioral sciences , 2011 .

[10]  Howard F. Andrews,et al.  The origins of 12-month attachment: A microanalysis of 4-month mother–infant interaction , 2010, Attachment & human development.

[11]  John J. B. Allen,et al.  The handbook of emotion elicitation and assessment , 2007 .

[12]  P J Cooper,et al.  EDITORIAL: Postpartum depression and child development , 1997, Psychological Medicine.

[13]  Ilanit Gordon,et al.  Gaze Behaviors of Preterm and Full-Term Infants in Nonsocial and Social Contexts of Increasing Dynamics: Visual Recognition, Attention Regulation, and Gaze Synchrony. , 2011, Infancy : the official journal of the International Society on Infant Studies.

[14]  C. Hofsten.  Developmental changes in the organization of prereaching movements , 1984 .

[15]  Masayoshi Kubo,et al.  Spontaneous kicking in full-term and preterm infants with and without white matter disorder. , 2010, Developmental psychobiology.

[16]  U. Castiello,et al.  Both your intention and mine are reflected in the kinematics of my reach-to-grasp movement , 2008, Cognition.

[17]  L. A. Egeren,et al.  Mother-infant responsiveness: timing, mutual regulation, and interactional context. , 2001, Developmental psychology.

[18]  T. Brazelton,et al.  The origins of reciprocity : The early mother-infant interaction , 1974 .

[19]  H. Papoušek,et al.  Intuitive parenting: A dialectic counterpart to the infant's integrative competence. , 1987 .

[20]  T. Field,et al.  Infant gaze aversion and heart rate during face-to-face interactions , 1981 .

[21]  T. Brazelton,et al.  Neonatal Behavioral Assessment Scale , 1973 .

[22]  E. Tronick,et al.  Temporal coordination of arm movements in early infancy: do infants move in synchrony with adult speech? , 1986, Child development.

[23]  E. Tronick,et al.  Beyond the face: an empirical study of infant affective configurations of facial, vocal, gestural, and regulatory behaviors. , 1994, Child development.

[24]  B. Everitt,et al.  Large sample standard errors of kappa and weighted kappa. , 1969 .

[25]  Jing Xiao,et al.  Robust full‐motion recovery of head by dynamic templates and re‐registration techniques , 2003 .

[26]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[27]  Christina L Franklin.  Emotional regulation in infants of postpartum depressed mothers , 2009 .

[28]  Leonard A. Rosenblum,et al.  The Effect of the Infant on Its Caregiver. Volume 1 in the Origins of Behavior Series. , 1974 .

[29]  J. Cohn,et al.  Use of Automated Facial Image Analysis for Measurement of Emotion Expression , 2004 .

[30]  J. Richards,et al.  The measurement of human motion: A comparison of commercially available systems , 1999 .

[31]  Roger Bakeman,et al.  Observer agreement for timed-event sequential data: A comparison of time-based and event-based algorithms , 2009, Behavior research methods.

[32]  D. Stern,et al.  Engagement-Disengagement and Early Object Experiences , 1977 .

[33]  N. Sebanz,et al.  Evolving intentions for social interaction: from entrainment to joint action , 2008, Philosophical Transactions of the Royal Society B: Biological Sciences.

[34]  J. Cohn,et al.  Automated Measurement of Facial Expression in Infant-Mother Interaction: A Pilot Study. , 2009, Infancy : the official journal of the International Society on Infant Studies.

[35]  P. Rochat,et al.  Multimodal perception in the control of infant reaching. , 1994, Journal of experimental psychology. Human perception and performance.

[36]  T. Field,et al.  Depressed mothers' infants are less responsive to faces and voices. , 2009, Infant behavior & development.

[37]  Takeo Kanade,et al.  Robust 3D Head Tracking by Online Feature Registration , 2008 .

[38]  C. Hofsten,et al.  Preparation for grasping an object: a developmental study. , 1988, Journal of experimental psychology. Human perception and performance.

[39]  Roger Bakeman,et al.  Analyzing Interaction: Sequential Analysis with SDIS and GSEQ , 1995 .

[40]  J. Cohn,et al.  Spontaneous facial expression in a small group can be automatically measured: An initial demonstration , 2010, Behavior research methods.

[41]  J. Osofsky.  Handbook of infant development , 1979 .

[42]  Daniel S. Messinger,et al.  Head Movement Dynamics during Normal and Perturbed Parent-Infant Interaction , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[43]  N. Freedman,et al.  Communicative Structures and Psychic Structures , 1977, The Downstate Series of Research in Psychiatry and Psychology.

[44]  G. Stechler,et al.  SOME OBSERVATIONS ON ATTENTION AND AROUSAL IN THE HUMAN INFANT , 1966 .

[45]  Paula Fitzpatrick,et al.  Dynamical Patterns in the Development of Clapping. , 1996 .

[46]  Claudia Carello,et al.  DYNAMICAL PATTERNS IN CLAPPING BEHAVIOR , 1996 .

[47]  Fernando De la Torre,et al.  Facing Imbalanced Data--Recommendations for the Use of Performance Metrics , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[48]  A. Fogel,et al.  The temporal structure of face-to-face communication between mothers and infants. , 1980 .

[49]  U. Castiello,et al.  Toward You , 2010 .

[50]  Howard Andrews,et al.  MATERNAL ANXIETY SYMPTOMS AND MOTHER-INFANT SELF- AND INTERACTIVE CONTINGENCY. , 2011, Infant mental health journal.

[51]  Margaret McRorie,et al.  Cross-Cultural Patterns in Dynamic Ratings of Positive and Negative Natural Emotional Behaviour , 2011, PloS one.

[52]  Jeffery F. Cohn,et al.  Infant-mother face-to-face interaction: age and gender differences in coordination and the occurrence of miscoordination , 1989 .