Automatic mental heath assistant: monitoring and measuring nonverbal behavior of the crew during long-term missions

This paper presents a method for monitoring the mental state of small isolated crews during long-term missions (such as space mission, polar expeditions, submarine crews, meteorological stations, and etc.) The research is done as a part of Automatic Mental Health Assistant (AMHA) project which aims to develop set of techniques for automatic measuring of intra- and inter- personal states in working groups. The method is focused on those aspects of psychological and sociological states that are crucial for the performance of the crew. In particular, we focus on measuring of emotional stress, initial signs of conflicts, trust, and ability to collaborate. The present research is performed in collaboration with MARS-500 experiment in which a small group of people is isolated for a long period of time. The MARS-500 experiment, in this way, provides a unique platform for study of human-human interaction. The confinement study will imitate all key peculiarities expected to be present during future missions to Mars (i.e. ultra long duration flight, need for autonomy, complicated communication with a digital communication center due to signal delay, and limited stock of expendables). The developed method is also currently tested by usage of a web-based platform.

[1]  Matthias Rauterberg,et al.  State-coupled replicator dynamics , 2009, AAMAS.

[2]  Robert J. Harvey,et al.  A "Big Five" Scoring System for the Myers-Briggs Type Indicator , 1995 .

[3]  Paula Fritzsche.  Tools in Artificial Intelligence , 2008 .

[4]  B. Grosz,et al.  Colored Trails : A Formalism for Investigating Decision-making in Strategic Environments , 2005 .

[5]  Kenji Mase,et al.  Recognition of Facial Expression from Optical Flow , 1991 .

[6]  J. Lindenberg,et al.  The MECA Project - Ontology-Based Data Portability for Space Missions , 2009, 2009 Third IEEE International Conference on Space Mission Challenges for Information Technology.

[7]  N. Sebe,et al.  Facial Expression Recognition: A Fully Integrated Approach , 2007, 14th International Conference of Image Analysis and Processing - Workshops (ICIAPW 2007).

[8]  Emilia I. Barakova,et al.  Retrieving Emotion from Motion Analysis: In a Real Time Parallel Framework for Robots , 2009, ICONIP.

[9]  S. Srivastava,et al.  The Big Five Trait taxonomy: History, measurement, and theoretical perspectives. , 1999 .

[10]  Larry S. Davis,et al.  Computing spatio-temporal representations of human faces , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Colin Camerer,et al.  Behavioral Game Theory: Thinking, Learning and Teaching , 2001 .

[12]  Matthias Rauterberg,et al.  Entertainment Computing in the Orbit , 2008, ECS.

[13]  Avi Pfeffer,et al.  Modeling how humans reason about others with partial information , 2008, AAMAS.

[14]  Georgios Kouroupetroglou,et al.  A Methodology for the Extraction of Reader's Emotional State Triggered from Text Typography , 2008 .

[15]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[16]  Emilia I. Barakova,et al.  My Sparring Partner Is a Humanoid Robot , 2009, IWINAC.

[17]  Matthias Rauterberg,et al.  Formalizing Multi-state Learning Dynamics , 2008, 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology.

[18]  T. Grant,et al.  The mission execution crew assistant : Improving human-machine team resilience for long duration missions , 2008 .

[19]  Mark A. Neerincx,et al.  MICRO-SCALE SOCIAL NETWORK ANALYSIS FOR ULTRA-LONG SPACE FLIGHTS , 2009, IJCAI 2009.

[20]  R. Nelson.  THE STRENGTH OF STRONG TIES: SOCIAL NETWORKS AND INTERGROUP CONFLICT IN ORGANIZATIONS , 1989 .

[21]  Dietrich Manzey,et al.  Human missions to Mars: new psychological challenges and research issues. , 2004, Acta astronautica.

[22]  Emilia I. Barakova,et al.  Expressing and interpreting emotional movements in social games with robots , 2010, Personal and Ubiquitous Computing.

[23]  N Kanas,et al.  Social and cultural issues during Shuttle/Mir space missions. , 2000, Acta astronautica.

[24]  Zhigang Deng,et al.  Analysis of emotion recognition using facial expressions, speech and multimodal information , 2004, ICMI '04.