Learning to Decode Nonverbal Cues in Cross-Cultural Interactions

Abstract : The overall objective of this project is to generate guidelines for the conceptual design of an interactive, computer-based training tool to improve Soldiers' ability to decode nonverbal cues and behavior in multiple channels (i.e., vocal tones, gestures). The tool will assist Soldiers in exhibiting effective cross-cultural communication skills and will prepare them to interpret and predict behavior more accurately in cross-cultural environments. The specific objectives of this Phase I research are as follows: (1) conduct a comprehensive review to identify universal and culture-specific nonverbal cues that are particular to a specific Middle Eastern culture; (2) examine which nonverbal cues are more reliable across American and Arab cultures to determine similarities; (3) investigate which nonverbal cues and behaviors may be misinterpreted across cultures; (4) identify methods for teaching the recognition and interpretation of nonverbal cues cross-culturally; and (5) generate guidelines for the conceptual design of a training approach that is computer-based and interactive to improve Soldiers' ability to decode nonverbal cues and behavior. In Phase II, the development and testing of a prototype system in a realistic environment is to be undertaken.

[1]  Guillaume Thierry,et al.  Dissociating Verbal and Nonverbal Conceptual Processing in the Human Brain , 2006, Journal of Cognitive Neuroscience.

[2]  Effie Maclellan,et al.  Conceptual Learning: The Priority for Higher Education , 2005 .

[3]  Anthony E. Kelly,et al.  Extending a tradition: teacher designed computer-based games , 1994 .

[4]  Richard F. Nyrop,et al.  Area handbook for Saudi Arabia , 1977 .

[5]  B. Mesquita,et al.  Cultural variations in emotions: a review. , 1992, Psychological bulletin.

[6]  Sylvia Stracke,et al.  Virtual Reality and 3 D Visualizations in Heart Surgery Education ( # 2001-03054 ) , 2022 .

[7]  Brian F. Goldiez,et al.  A Paradigm Shift in Interactive Computing: Deriving Multimodal Design Principles from Behavioral and Neurological Foundations , 2004, Int. J. Hum. Comput. Interact..

[8]  Human Factors ( HF ) ; Guidelines on the multimodality of icons , symbols and pictograms , 2022 .

[9]  E. Tulving.  Elements of episodic memory , 1983 .

[10]  Dane Archer,et al.  Unspoken Diversity: Cultural Differences in Gestures , 1997 .

[11]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[12]  Stephen W. Littlejohn.  Theories of Human Communication , 1978 .

[13]  Dennis K. Leedom,et al.  Training Situational Awareness Through Pattern Recognition in a Battlefield Environment , 1991 .

[14]  Larry A. Samovar,et al.  Communication Between Cultures , 1991 .

[15]  W. Brewer.  Patterns of Gesture Among the Levantine Arabs1 , 1951 .

[16]  A. Paivio.  Imagery and verbal processes , 1972 .

[17]  E. Gibson,et al.  Principles of Perceptual Learning and Development , 1973 .

[18]  Nurit Zaidman,et al.  Cultural Codes and Languages Trategies in Business Communication , 2001 .

[19]  J. Flynn.  Massive IQ gains in 14 nations: What IQ tests really measure. , 1987 .

[20]  William D. Wunderle,et al.  Through the Lens of Cultural Awareness: A Primer for US Armed Forces Deploying to Arab and Middle Eastern Countries , 2006 .

[21]  R. Rosenthal,et al.  Encoding and decoding nonverbal cues of emotion. , 1975, Journal of personality and social psychology.

[22]  Dee G. Appley.  Beyond Culture , 1977 .

[23]  Ephraim P. Glinert,et al.  Multimodal Interaction , 1996, IEEE Multim..

[24]  Frank J. Bernieri.  Toward a Taxonomy of Interpersonal Sensitivity , 2001 .

[25]  Thomas Hainey,et al.  Don't Bother Me, Mom - I'm Learning: How Computer and Video Games are Preparing Your Kids for 21st Century Success - and How You Can Help! Marc Prensky. Paragon House (2006) (254pp., $19.95, ISBN: 1-55778-858-8) , 2006, Int. J. Inf. Manag..

[26]  Marc Prensky.  Has "Growing Up Digital" and Extensive Video Game Playing Affected Younger Military Personnel's Skill Sets? A paper presented at I/ITSEC 2003 , 2003 .

[27]  Jennifer E. Fowlkes,et al.  Event-based approach to training (EBAT). , 1998 .

[28]  Steven Poole,et al.  Trigger happy : the inner life of videogames , 2000 .

[29]  Mark Costanzo,et al.  Training students to decode verbal and nonverbal cues: Effects on confidence and performance. , 1992 .

[30]  Derek Cheung,et al.  Some management issues on computer game development for primary education , 2002, Electron. Libr..

[31]  Mary Ritchie Key.  Nonverbal communication: A research guide & bibliography , 1977 .

[32]  Barbara Iannarelli.  Just-in-Time Training , 2005 .

[33]  W. Friesen,et al.  Cultural differences in facial expressions in a social situation: An experimental test on the concept of display rules. , 1973 .

[34]  K. Galotti.  Cognitive psychology in and out of the laboratory , 1993 .

[35]  James R. Flynn,et al.  The mean IQ of Americans: Massive gains 1932 to 1978. , 1984 .

[36]  Jennifer E. Fowlkes,et al.  Performance Measurement in Distributed Environments: Initial Results and Implications for Training , 1999 .

[37]  M. Jones,et al.  Just-in-time Training , 2001 .

[38]  E. Feghali.  Arab cultural communication patterns , 1997 .

[39]  Ann L. Brown,et al.  How people learn: Brain, mind, experience, and school. , 1999 .

[40]  Angela M. O'Donnell,et al.  Educational Psychology: Reflection for Action , 2006 .

[41]  John V. Dempsey,et al.  Forty Simple Computer Games and What They Could Mean to Educators , 2002 .

[42]  D. Matsumoto,et al.  Cultural influences on nonverbal expressions of emotion. , 1999 .

[43]  David Matsumoto,et al.  Development and validation of a measure of display rule knowledge: the display rule assessment inventory. , 2005, Emotion.

[44]  C. Wickens.  Engineering psychology and human performance, 2nd ed. , 1992 .

[45]  Marianne Schmid Mast,et al.  Recall of Nonverbal Cues: Exploring a New Definition of Interpersonal Sensitivity , 2006 .

[46]  E. Salas,et al.  Facilitating Team Adaptation “in the Wild”: A Theoretical Framework, Instructional Strategies, and Research Agenda , 2007 .

[47]  Marc Prensky,et al.  Don't bother me, Mom, I'm learning! , 2006 .

[48]  O. Watson,et al.  Quantitative Research in Proxemic Behavior1 , 1966 .

[49]  N. Adler.  International Dimensions of Organizational Behavior , 1986 .

[50]  Misha Tsodyks,et al.  Perceptual learning in contrast discrimination: the effect of contrast uncertainty. , 2004, Journal of vision.

[51]  John Sweller,et al.  Cognitive Load During Problem Solving: Effects on Learning , 1988, Cogn. Sci..

[52]  P. Ekman,et al.  The Repertoire of Nonverbal Behavior: Categories, Origins, Usage, and Coding , 1969 .

[53]  R. Schank.  Tell Me a Story: A New Look at Real and Artificial Memory , 1991 .

[54]  Marc Prensky,et al.  Digital game-based learning , 2000, CIE.

[55]  Norman E. Lane,et al.  Improving the Measurement of Team Performance: The TARGETs Methodology , 1994 .

[56]  Andrew Molinsky,et al.  Cracking the Nonverbal Code , 2005 .

[57]  Peter Collett.  TRAINING ENGLISHMEN IN THE NON‐VERBAL BEHAVIOUR OF ARABS , 1971 .

[58]  David Matsumoto,et al.  Culture and Psychology: People Around the World , 1999 .

[59]  Robert L. Goldstone,et al.  Definition , 1960, A Philosopher Looks at Sport.

[60]  M. Patterson,et al.  The SAGE Handbook of Nonverbal Communication , 2006 .

[61]  P. Ekman.  Universals and cultural differences in facial expressions of emotion. , 1972 .

[62]  J. Piaget.  Six Psychological Studies , 1967 .

[63]  S. Wilson.  What Video Games Have to Teach Us about Learning and Literacy , 2006 .

[64]  Jonathan P. Doh,et al.  International Management: Culture, Strategy, and Behavior , 1991 .

[65]  E. Hall,et al.  The Hidden Dimension , 1970 .

[66]  Ray L. Birdwhistell.  Nonverbal Communication: A Research Guide and Bibliography:Nonverbal Communication: A Research Guide and Bibliography. , 1978 .

[67]  Simon Egenfeldt-Nielsen,et al.  Beyond Edutainment: Exploring the Educational Potential of Computer Games , 2011 .

[68]  Hillary Anger Elfenbein,et al.  On the universality and cultural specificity of emotion recognition: a meta-analysis. , 2002, Psychological bulletin.

[69]  Frank J. Bernieri,et al.  The Importance of Nonverbal Cues in Judging Rapport , 1999 .

[70]  Ronald E. Riggio,et al.  NONVERBAL SKILLS AND ABILITIES , 2006 .

[71]  Daniel L. Schwartz,et al.  A time for telling , 1998 .

[72]  Eduardo Salas,et al.  Advanced technology in scenario-based training. , 1998 .

[73]  Andrew K. Przybylski,et al.  The Motivational Pull of Video Games: A Self-Determination Theory Approach , 2006 .

[74]  Mark T. Maybury.  HUMAN COMPUTER INTERACTION : STATE OF THE ART AND FURTHER DEVELOPMENT IN THE INTERNATIONAL CONTEXT-NORTH AMERICA , 2001 .

[75]  J. Schooler,et al.  Perceptual and conceptual training mediate the verbal overshadowing effect in an unfamiliar domain , 2004, Memory & cognition.

[76]  Hillary Anger Elfenbein,et al.  Learning in emotion judgments: Training and the cross-cultural understanding of facial expressions , 2006 .

[77]  J. Flynn,et al.  What is intelligence? Beyond the Flynn effect , 2008 .

[78]  S. Papert.  The children's machine: rethinking school in the age of the computer , 1993 .

[79]  Michael C Corballis,et al.  The origins of modernity: was autonomous speech the critical factor? , 2004, Psychological review.

[80]  Oyen,et al.  The Effects of Computer Games and Lesson Contexts on Children's Mnemonic Strategies , 1996, Journal of experimental child psychology.

[81]  J. Mccroskey,et al.  Nonverbal Behavior in Interpersonal Relations , 1987 .

[82]  E. Salas,et al.  Promoting health care safety through training high reliability teams , 2005, Quality and Safety in Health Care.

[83]  L. S. Vygotksy.  Mind in society: the development of higher psychological processes , 1978 .