Nonverbal Behavior Observation: Collaborative Gaming Method for Prediction of Conflicts during Long-Term Missions

This paper presents a method for monitoring mental state of small isolated crews during long-term missions (such as space mission, polar expeditions, submarine crews, meteorological stations, and etc). It combines the records of negotiation game with monitoring of the nonverbal behavior of the players. We analyze the records of negotiation game that has taken place between the crew members who were placed in isolated environment for 105 days during the Mars-500 experiment. The outcomes of the analysis, differently from the previously made conclusions, show that there was not a significant deviation of the rational choice of the players. We propose an extension of the method that includes monitoring of the nonverbal behavior of the players next to recording the game records. The method is focused on those aspects of psychological and sociological states that are crucial for the performance of the crew. In particular, we focus on measuring of emotional stress, initial signs of conflicts, trust, and ability to collaborate.

[1]  Robert J. Harvey,et al.  A "Big Five" Scoring System for the Myers-Briggs Type Indicator , 1995 .

[2]  Mark A. Neerincx,et al.  MICRO-SCALE SOCIAL NETWORK ANALYSIS FOR ULTRA-LONG SPACE FLIGHTS , 2009, IJCAI 2009.

[3]  Zhigang Deng,et al.  Analysis of emotion recognition using facial expressions, speech and multimodal information , 2004, ICMI '04.

[4]  Emilia I. Barakova,et al.  Retrieving Emotion from Motion Analysis: In a Real Time Parallel Framework for Robots , 2009, ICONIP.

[5]  Matthias Rauterberg,et al.  State-coupled replicator dynamics , 2009, AAMAS.

[6]  N Kanas,et al.  Social and cultural issues during Shuttle/Mir space missions. , 2000, Acta astronautica.

[7]  Matthias Rauterberg,et al.  Entertainment Computing in the Orbit , 2008, ECS.

[8]  George Loizou,et al.  Computer vision and pattern recognition , 2007, Int. J. Comput. Math..

[9]  S. Srivastava,et al.  The Big Five Trait taxonomy: History, measurement, and theoretical perspectives. , 1999 .

[10]  Kenji Mase,et al.  Recognition of Facial Expression from Optical Flow , 1991 .

[11]  J. Lindenberg,et al.  The MECA Project - Ontology-Based Data Portability for Space Missions , 2009, 2009 Third IEEE International Conference on Space Mission Challenges for Information Technology.

[12]  T. Grant,et al.  The mission execution crew assistant : Improving human-machine team resilience for long duration missions , 2008 .

[13]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[14]  R. Nelson THE STRENGTH OF STRONG TIES: SOCIAL NETWORKS AND INTERGROUP CONFLICT IN ORGANIZATIONS , 1989 .

[15]  Dietrich Manzey,et al.  Human missions to Mars: new psychological challenges and research issues. , 2004, Acta astronautica.

[16]  Emilia I. Barakova,et al.  Expressing and interpreting emotional movements in social games with robots , 2010, Personal and Ubiquitous Computing.

[17]  Emilia I. Barakova,et al.  My Sparring Partner Is a Humanoid Robot A Parallel Framework for Improving Social Skills by Imitation , 2009 .

[18]  N. Sebe,et al.  Facial Expression Recognition: A Fully Integrated Approach , 2007, 14th International Conference of Image Analysis and Processing - Workshops (ICIAPW 2007).

[19]  B. Grosz,et al.  Colored Trails : A Formalism for Investigating Decision-making in Strategic Environments , 2005 .

[20]  Emilia I. Barakova,et al.  My Sparring Partner Is a Humanoid Robot , 2009, IWINAC.

[21]  Larry S. Davis,et al.  Computing spatio-temporal representations of human faces , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Georgios Kouroupetroglou,et al.  A Methodology for the Extraction of Reader's Emotional State Triggered from Text Typography , 2008 .

[23]  José Manuel Ferrández,et al.  Bioinspired Applications in Artificial and Natural Computation, Third International Work-Conference on the Interplay Between Natural and Artificial Computation, IWINAC 2009, Santiago de Compostela, Spain, June 22-26, 2009, Proceedings, Part II , 2009, IWINAC.

[24]  Matthias Rauterberg,et al.  Formalizing Multi-state Learning Dynamics , 2008, 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology.

[25]  Colin Camerer,et al.  Behavioral Game Theory: Thinking, Learning and Teaching , 2001 .

[26]  Avi Pfeffer,et al.  Modeling how humans reason about others with partial information , 2008, AAMAS.