The mission execution crew assistant : Improving human-machine team resilience for long duration missions

Manned long-duration missions to the Moon and Mars set high operational, human factors and technical demands for a distributed support system, which enhances human-machine teams' capabilities to cope autonomously with unexpected, complex and potentially hazardous situations. Based on a situated Cognitive Engineering (sCE) method, we specified a theoretical and empirical founded Requirements Baseline (RB) for such a system (called Mission Execution Crew Assistant; MECA), and its rational consisting of scenarios and use cases, user experience claims, and core support functions. The MECA system comprises distributed personal ePartners that help the team to assess the situation, to determine a suitable course of actions to solve a problem, and to safeguard the astronauts from failures. In addition to standard requirements reviews, we tested and refined the RB via storyboarding and human-in-the-loop evaluations of a simulation-based prototype in a virtual environment with 15 participants. The evaluation results confirmed the claims on effectiveness, efficiency, satisfaction, learnability, situation awareness, trust and emotion. Issues for improvement and further research were identified and prioritized (e.g., acceptance of mental load and emotion sensing). In general, the sCE method provided a reviewed set of 167 high-level requirements that explicitly refers to the tested scenarios, claims and core support functions on health management, diagnosis, prognosis & prediction, collaboration, resource management, planning, and sense-making. A first version of an ontology for this support was implemented in the prototype, which will be used for further ePartner development.

[1]  Matthias Rauterberg,et al.  Entertainment Computing in the Orbit , 2008, ECS.

[2]  Illah R. Nourbakhsh,et al.  A survey of socially interactive robots , 2003, Robotics Auton. Syst..

[3]  L. Futcher,et al.  IFIP – The International Federation for Information Processing , 2004 .

[5]  Donald A. Norman,et al.  User Centered System Design: New Perspectives on Human-Computer Interaction , 1988 .

[6]  Krzysztof Z. Gajos,et al.  End User Empowerment in Human Centered Pervasive Computing , 2002 .

[7]  K. J. Vicente,et al.  Cognitive Work Analysis: Toward Safe, Productive, and Healthy Computer-Based Work , 1999 .

[8]  Anastasis D. Petrou Review of “Persuasive technology: Using computers to change what we think and do by B. J. Fogg” Morgan Kaufmann, 2003 , 2003 .

[9]  M. Scerbo STRESS, WORKLOAD, AND BOREDOM IN VIGILANCE: A PROBLEM AND AN ANSWER. , 2001 .

[10]  Nick Kanas,et al.  Human interactions in space: ISS vs. Shuttle/Mir , 2006 .

[11]  R L Helmreich,et al.  The evolution of Crew Resource Management training in commercial aviation. , 1999, The International journal of aviation psychology.

[12]  A.,et al.  Cognitive Engineering , 2008, Encyclopedia of GIS.

[13]  John Connolly,et al.  Human Exploration of Mars: The Reference Mission of the NASA Mars Exploration Study Team , 1998 .

[14]  Mark A. Neerincx,et al.  Engineering planetary exploration systems : Integrating novel technologies and the human element using work domain analysis , 2008 .

[15]  J. Rassmusen,et al.  Information Processing and Human - Machine Interaction: An Approach to Cognitive Engineering , 1986 .

[16]  Neerincx,et al.  Situated cognitive engineering: Developing adaptive track handling support for naval command and control centers , 2008 .

[17]  Lennon Rodgers,et al.  Self-assembling wireless autonomously reconfigurable module design concept , 2008 .

[18]  Mary Beth Rosson,et al.  Usability Engineering: Scenario-based Development of Human-Computer Interaction , 2001 .

[19]  S. Hoffman,et al.  Human Exploration of Mars , 1997 .

[20]  B. J. Fogg,et al.  Persuasive technology: using computers to change what we think and do , 2002, UBIQ.

[21]  Neerincx,et al.  Game-based evaluation of personalized support for astronauts in long duration missions , 2008 .

[22]  P. Hancock,et al.  Stress, Workload, and Fatigue , 2009 .

[23]  E. Hollnagel Handbook of Cognitive Task Design , 2009 .

[24]  Mark A. Neerincx,et al.  Children's responses and opinion on three bots that motivate, educate and play , 2008 .

[25]  Neerincx,et al.  Situated cognitive engineering for complex task environments , 2005 .

[26]  Erik Hollnagel,et al.  Cognitive Systems Engineering: New Wine in New Bottles , 1983, Int. J. Man Mach. Stud..

[27]  Mark A. Neerincx,et al.  Modelling Cognitive and Affective Load for the Design of Human-Machine Collaboration , 2007, HCI.

[28]  Maarten Sierhuis,et al.  Automating CapCom Using Mobile Agents and Robotic Assistants , 2005 .

[29]  S. Mohammed,et al.  Team mental models in a team knowledge framework: expanding theory and measurement across disciplinary boundaries , 2001 .

[30]  J. Lindenberg,et al.  Cognitive engineering for long duration missions: human-machine collaboration on the Moon and Mars , 2006, 2nd IEEE International Conference on Space Mission Challenges for Information Technology (SMC-IT'06).

[31]  Aaron Powers,et al.  Matching robot appearance and behavior to tasks to improve human-robot cooperation , 2003, The 12th IEEE International Workshop on Robot and Human Interactive Communication, 2003. Proceedings. ROMAN 2003..

[32]  Mahadev Satyanarayanan,et al.  Pervasive computing: vision and challenges , 2001, IEEE Wirel. Commun..

[33]  William J. Clancey Roles for agent assistants in field science: understanding personal projects and collaboration , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[34]  Jean-Michel Hoc,et al.  Towards a cognitive approach to human-machine cooperation in dynamic situations , 2001, Int. J. Hum. Comput. Stud..

[35]  Nick Kanas,et al.  Psychosocial interactions during ISS missions , 2007 .

[36]  Vasant Honavar,et al.  Aurally Informed Performance: Integrating Machine Listening and Auditory Presentation in Robotic Systems, Papers from the 2006 AAAI Fall Symposium, Washington, DC, USA, October 13-15, 2006 , 2006, AAAI Fall Symposium: Aurally Informed Performance.

[37]  Stephen J. Hoffman,et al.  Human Exploration of Mars: The Reference Mission of the NASA Mars Exploration Study Team , 1997 .

[38]  Gary Klein,et al.  Sources of Power: How People Make Decisions , 2017 .

[39]  Maarten Sierhuis,et al.  Are You Talking to Me? Dialogue Systems Supporting Mixed Teams of Humans and Robots , 2006, AAAI Fall Symposium: Aurally Informed Performance.

[40]  D. Scott McCrickard,et al.  Designing Attention-Centric Notification Systems: Five HCI Challenges , 2005 .

[41]  Keith Duncan,et al.  Cognitive Engineering , 2017, Encyclopedia of GIS.

[42]  Mark A. Neerincx,et al.  Integrating Human Factors and Artificial Intelligence in the Development of Human-Machine Cooperation , 2005, IC-AI.

[43]  Daniel J. Garland,et al.  Situation Awareness Analysis and Measurement , 2009 .

[44]  Mark A. Neerincx,et al.  Improving service matching and selection in ubiquitous computing environments: a user study , 2006, Personal and Ubiquitous Computing.

[45]  Penelope M. Sanderson,et al.  Evaluating Design Proposals for Complex Systems with Work Domain Analysis , 2001, Hum. Factors.