Safe Handover in Mixed-Initiative Control for Cyber-Physical Systems

For mixed-initiative control between cyber-physical systems (CPS) and its users, it is still an open question how machines can safely hand over control to humans. In this work, we propose a concept to provide technological support that uses formal methods from AI -- description logic (DL) and automated planning -- to predict more reliably when a hand-over is necessary, and to increase the advance notice for handovers by planning ahead of runtime. We combine this with methods from human-computer interaction (HCI) and natural language generation (NLG) to develop solutions for safe and smooth handovers and provide an example autonomous driving scenario. A study design is proposed with the assessment of qualitative feedback, cognitive load and trust in automation.

[1]  Dietrich Klakow,et al.  Neural Data-to-Text Generation via Jointly Learning the Segmentation and Correspondence , 2020, ACL.

[2]  Filip De Turck,et al.  Ontology-Driven Monitoring of Patient's Vital Signs Enabling Personalized Medical Detection and Alert , 2011, MobiHealth.

[3]  Antonio Krüger,et al.  ReflectiveSigns: Digital Signs That Adapt to Audience Attention , 2009, Pervasive.

[4]  Mustapha Mouloua,et al.  Automation and Human Performance : Theory and Applications , 1996 .

[5]  V. Demberg,et al.  Effects of Aging and Dual-Task Demands on the Comprehension of Less Expected Sentence Continuations: Evidence From Pupillometry , 2019, Front. Psychol..

[6]  Moritz Körber,et al.  Theoretical Considerations and Development of a Questionnaire to Measure Trust in Automation , 2018, Advances in Intelligent Systems and Computing.

[7]  Xudong Hong,et al.  Improving Language Generation from Feature-Rich Tree-Structured Data with Relational Graph Convolutional Encoders , 2019, EMNLP.

[8]  Seth Flaxman,et al.  European Union Regulations on Algorithmic Decision-Making and a "Right to Explanation" , 2016, AI Mag..

[9]  Mica R. Endsley,et al.  Measurement of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[10]  Vera Demberg,et al.  Linguistic cognitive load : implications for automotive UIs , 2011 .

[11]  Antonio Krüger,et al.  A User Modeling Markup Language (UserML) for Ubiquitous Computing , 2003, User Modeling.

[12]  Marilyn Jager Adams,et al.  Situation Awareness and the Cognitive Management of Complex Systems , 1995, Hum. Factors.

[13]  Ashish Kapoor,et al.  AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehicles , 2017, FSR.

[14]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[15]  Michael Zakharyaschev,et al.  Ontology-Based Data Access with a Horn Fragment of Metric Temporal Logic , 2017, AAAI.

[16]  Robert Dale,et al.  Building applied natural language generation systems , 1997, Natural Language Engineering.

[17]  Matthew W. Crocker,et al.  Information Density and Linguistic Encoding (IDeaL) , 2015, KI - Künstliche Intelligenz.

[18]  Yannis E. Ioannidis,et al.  BalOnSe: Temporal Aspects of Dance Movement and Its Ontological Representation , 2017, ESWC.

[19]  Wendy Ju,et al.  Why did my car just do that? Explaining semi-autonomous driving actions to improve driver understanding, trust, and performance , 2014, International Journal on Interactive Design and Manufacturing (IJIDeM).

[20]  Xiaoyu Shen,et al.  DART: A Lightweight Quality-Suggestive Data-to-Text Annotation Tool , 2020, COLING.

[21]  Alfred Kobsa,et al.  User Models in Dialog Systems , 1989, Symbolic Computation.

[22]  Philip R. Cohen,et al.  Tangible multimodal interfaces for safety-critical applications , 2004, CACM.

[23]  Andreas Butz,et al.  SupportingTrust in Autonomous Driving , 2017, IUI.

[24]  Boris Brandherm,et al.  Gumo - The General User Model Ontology , 2005, User Modeling.

[25]  Silvia Richter,et al.  The LAMA Planner: Guiding Cost-Based Anytime Planning with Landmarks , 2010, J. Artif. Intell. Res..

[26]  Xiaoyu Shen,et al.  Unsupervised Pidgin Text Generation By Pivoting English Data and Self-Training , 2020, ArXiv.

[27]  Stefan Edelkamp,et al.  Automated Planning: Theory and Practice , 2007, Künstliche Intell..

[28]  Faïez Gargouri,et al.  Ontology-based system for patient monitoring with connected objects , 2017, KES.

[29]  Marco Guerini,et al.  Generating E-Commerce Product Titles and Predicting their Quality , 2018, INLG.

[30]  Antonio Krüger,et al.  Integrating Intra and Extra Gestures into a Mobile and Multimodal Shopping Assistant , 2005, Pervasive.