Arbitration based framework for design of holisticmultimodal human-machine interaction

Creating dynamic cognitive systems, such as human-machine systems with the appropriate interaction inside, the system engineer is usually facing a high overall complexity. For instance, designing a modern driver assistance system, the developer is dealing with the diversity of drivers’ behavior, the complexity of the traffic and vehicle dynamics and the heterogeneity of already designed assistance systems. To deal with this complexity effectively, the creation of holistic, stable and well-usable cognitive systems implies the usage of a design framework, which could provide benefit and orderliness to the creation process. In this contribution, we propose such a design framework that consists of the theoretically derived generic cognitive system architecture as well as of the arbitration-based methodology and tool-based interface for the interaction design. Besides the theoretical background, we describe the general rules of the framework in a stepwise manner using an automotive example of a newly developed driver assistance system for cooperative lane changes in a highway scenario.

[1]  Stephen Cole Kleene,et al.  On notation for ordinal numbers , 1938, Journal of Symbolic Logic.

[2]  Yoav Shoham,et al.  Multiagent Systems - Algorithmic, Game-Theoretic, and Logical Foundations , 2009 .

[3]  Guy BOY INTERFACE AGENTS FOR HANDLING FUZZY DESCRIPTORS IN INFORMATION RETRIEVAL , 2004 .

[4]  Frank Flemisch,et al.  Automation spectrum, inner / outer compatibility and other potentially useful human factors concepts for assistance and automation , 2008 .

[5]  Jean-Michel Hoc,et al.  Towards a cognitive approach to human-machine cooperation in dynamic situations , 2001, Int. J. Hum. Comput. Stud..

[6]  Reiner Onken,et al.  COSA – A generic cognitive system architecture based on a cognitive model of human behavior , 2003, Cognition, Technology & Work.

[7]  Anand S. Rao,et al.  Modeling Rational Agents within a BDI-Architecture , 1997, KR.

[8]  Erik Hollnagel,et al.  Mapping Cognitive Demands in Complex Problem-Solving Worlds , 1987, Int. J. Man Mach. Stud..

[9]  Guy A. Boy,et al.  Cognitive function analysis for human-centered automation of safety-critical systems , 1998, CHI.

[10]  Jens Rasmussen,et al.  Information Processing and Human-Machine Interaction: An Approach to Cognitive Engineering , 1986 .

[11]  K. J. Vicente,et al.  Cognitive Work Analysis: Toward Safe, Productive, and Healthy Computer-Based Work , 1999 .

[12]  Fraedaeric Holzmann Adaptive cooperation between driver and assistant system , 2008 .

[13]  Cristiano Castelfranchi,et al.  Modeling Social Action for AI Agents , 1997, IJCAI.

[14]  Michael D. Byrne,et al.  ACT-R/PM and menu selection: applying a cognitive architecture to HCI , 2001, Int. J. Hum. Comput. Stud..

[15]  D. Bem,et al.  DIFFUSION OF RESPONSIBILITY AND LEVEL OF RISK TAKING IN GROUPS. , 1963, Journal of abnormal psychology.

[16]  Frank Dannemann,et al.  [(Spacecraft Bus Controller) + (Automotive ECU)] / 2 = UltimateController , 2010, Software Engineering.

[17]  Erik Hollnagel,et al.  Cognitive Systems Engineering: New wine in new bottles , 1999, Int. J. Hum. Comput. Stud..

[18]  Johann Kelsch Arbitration between Driver and Automation:why overriding is just the tip of the iceberg , 2012 .

[19]  F. Schweitzer Brownian Agents and Active Particles , 2003, Springer Series in Synergetics.

[20]  James D. Hollan,et al.  Distributed cognition: toward a new foundation for human-computer interaction research , 2000, TCHI.

[21]  Jens Rasmussen,et al.  Cognitive Systems Engineering , 2022 .

[22]  P. Schilder,et al.  The Conceptual Representation and the Measurement of Psychological Forces , 1940 .

[23]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[24]  Matthias Heesen,et al.  Using human-compatible reference values in design of cooperative dynamic human-machine systems , 2012 .

[25]  Jacob Eisenstein,et al.  XIML: a common representation for interaction data , 2002, IUI '02.

[26]  Mica R. Endsley,et al.  Designing for Situation Awareness : An Approach to User-Centered Design , 2003 .

[27]  Frank Köster,et al.  How to interact with a highly automated vehicle. Generic interaction design schemes and test results of a usability assessment , 2011 .

[28]  John Dixon,et al.  The Design of Future Things , 2010 .

[29]  三嶋 博之 The theory of affordances , 2008 .

[30]  Orlin Vakarelov Cognitive Agent , 2014, Computer Vision, A Reference Guide.

[31]  William C. Elm,et al.  Integrating Cognitive Systems Engineering Throughout the Systems Engineering Process , 2008 .

[32]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[33]  Gavan Lintern,et al.  What Is a Cognitive System , 2007 .

[34]  P. Watzlawick,et al.  Pragmatics of Human Communication: A Study of Interactional Patterns, Pathologies and Paradoxes , 1964 .

[35]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[36]  D. Norman,et al.  User Centered System Design: New Perspectives on Human-Computer Interaction , 1988 .