The Body Action and Posture Coding System (BAP): Development and Reliability

Several methods are available for coding body movement in nonverbal behavior research, but there is no consensus on a reliable coding system that can be used for the study of emotion expression. Adopting an integrative approach, we developed a new method, the body action and posture coding system, for the time-aligned micro description of body movement on an anatomical level (different articulations of body parts), a form level (direction and orientation of movement), and a functional level (communicative and self-regulatory functions). We applied the system to a new corpus of acted emotion portrayals, examined its comprehensiveness and demonstrated intercoder reliability at three levels: (a) occurrence, (b) temporal precision, and (c) segmentation. We discuss issues for further validation and propose some research applications.

[1]  MANIC-DEPRESSIVE PSYCHOSIS IN THE NEGRO , 1917 .

[2]  William Thomas James,et al.  A Study of the Expression of Bodily Posture , 1932 .

[3]  S. Arieti.  American Handbook of Psychiatry , 1960 .

[4]  J. Hes.  Manic depressive psychosis: a case report. , 1960, Electroencephalography and clinical neurophysiology.

[5]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[6]  Albert Mehrabian,et al.  Encoding of attitude by a seated communicator via posture and position cues. , 1969 .

[7]  P. Ekman,et al.  The Repertoire of Nonverbal Behavior: Categories, Origins, Usage, and Coding , 1969 .

[8]  P. Ekman,et al.  Facial Affect Scoring Technique: A First Validity Study , 1971 .

[9]  James S. Simkin.  Kinesics and Context: Essays on Body Motion Communication , 1972 .

[10]  B. Everitt,et al.  Statistical methods for rates and proportions , 1973 .

[11]  W. Conover.  Statistical Methods for Rates and Proportions , 1974 .

[12]  Rudolf von Laban,et al.  Laban's principles of dance and movement notation , 1975 .

[13]  R. Passingham.  Social communication and movement : M. Von Cranach and I. Vine (eds.): Academic Press, London, 1973. viii + 489 pp. £8.50 , 1975 .

[14]  P. Ekman,et al.  Measuring facial movement , 1976 .

[15]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[16]  K. Scherer.  Nonlinguistic Vocal Indicators of Emotion and Psychopathology , 1979 .

[17]  J. Osofsky.  Handbook of infant development , 1979 .

[18]  C. Izard.  Emotions in Personality and Psychopathology , 1979 .

[19]  P. Ekman,et al.  Handbook of methods in nonverbal behavior research , 1982 .

[20]  T. V. Dijk.  Handbook of discourse analysis , 1985 .

[21]  Roger Bakeman,et al.  Applying observational methods: A systematic view. , 1987 .

[22]  Great Britain. Hm Factory Inspectorate.  An introductory guide , 1987 .

[23]  M. D. Meijer.  The contribution of general features of body movement to the attribution of emotions , 1989 .

[24]  Carolyn G. Fidelman,et al.  The semiotics of French gestures , 1990 .

[25]  K. Scherer,et al.  Vocal cues in emotion encoding and decoding , 1991 .

[26]  Marina L. McIntire,et al.  Affective Prosody in American Sign Language , 2013 .

[27]  D. McNeill,et al.  How to transcribe the invisible : and what we see , 1995 .

[28]  Sotaro Kita,et al.  Movement Phase in Signs and Co-Speech Gestures, and Their Transcriptions by Human Coders , 1997, Gesture Workshop.

[29]  H. Wallbott.  Bodily expression of emotion , 1998 .

[30]  Jana Bressem,et al.  Notating gestures - Proposal for a form based notation system of coverbal gestures , 1998 .

[31]  Nicole C. Krämer,et al.  Computer Animated Movement and Person Perception: Methodological Advances in Nonverbal Behavior Research , 2001 .

[32]  Armin Bruderlin,et al.  Perceiving affect from arm movement , 2001, Cognition.

[33]  J. Cohn,et al.  A Psychometric Evaluation of the Facial Action Coding System for Assessing Spontaneous Expression , 2001 .

[34]  R. Johansson,et al.  Hand Movements , 2001 .

[35]  Michael Kipp,et al.  ANVIL - a generic annotation tool for multimodal dialogue , 2001, INTERSPEECH.

[36]  Ipke Wachsmuth,et al.  Gesture and Sign Language in Human-Computer Interaction , 1998, Lecture Notes in Computer Science.

[37]  D. Neumann.  Kinesiology of the musculoskeletal system : foundations for physical rehabilitation , 2002 .

[38]  J. Hietanen,et al.  Perception of Emotions in the Hand Movement Quality of Finnish Sign Language , 2004 .

[39]  D. McNeill.  Gesture and Thought , 2005 .

[40]  J. Harrigan,et al.  Proxemics, kinesics, and gaze. , 2005 .

[41]  K. Scherer,et al.  Vocal expression of affect , 2005 .

[42]  Lars Omlor,et al.  Unsupervised Learning of Spatio-temporal Primitives of Emotional Gait , 2006, PIT.

[43]  K. Bard,et al.  A Cross-species Comparison of Facial Morphology and Movement in Humans and Chimpanzees Using the Facial Action Coding System (FACS) , 2007, Journal of nonverbal behavior.

[44]  Michael Neff,et al.  An annotation scheme for conversational gestures: how to economically capture timing and form , 2007, Lang. Resour. Evaluation.

[45]  Jessica L. Tracy,et al.  The prototypical pride expression: development of a nonverbal behavior coding system. , 2007, Emotion.

[46]  K. Scherer,et al.  Multimodal expression of emotion: affect programs or componential appraisal patterns? , 2007, Emotion.

[47]  C. Janelle,et al.  Dissociating Motivational Direction and Affective Valence , 2007, Psychological science.

[48]  K. Scherer,et al.  The New Handbook of Methods in Nonverbal Behavior Research , 2008 .

[49]  K. Scherer,et al.  Introducing the Geneva Multimodal Emotion Portrayal (GEMEP) corpus , 2010 .

[50]  K. Scherer,et al.  A blueprint for affective computing: A sourcebook , 2010 .

[51]  Elizabeth A. Crane,et al.  Methodology for Assessing Bodily Expression of Emotion , 2010 .

[52]  Antonio Camurri,et al.  Toward a Minimal Representation of Affective Gestures , 2011, IEEE Transactions on Affective Computing.

[53]  T. Widiger,et al.  Personality and psychopathology , 2011 .

[54]  K. Scherer,et al.  Introducing the Geneva Multimodal expression corpus for experimental research on emotion perception. , 2012, Emotion.

[55]  K. Scherer,et al.  Emotion expression in body action and posture. , 2012, Emotion.