Human Factors Issues in Maritime Autonomous Surface Ship Systems Development

This paper will stress the importance of Ship Handling Simulation (SHS)-based Maritime Autonomous Surface Ship (MASS) prototype development and aligns it with the IMO Guidelines on Software Quality Assurance and Humancentered Design for e-Navigation. This is demonstrated by means of an implemented semi-autonomous ship concept. This concept envisions a periodically unmanned bridge with an advanced autonomous navigation system taking over in the absence of the officer of the watch. Thus, it is equipped with autonomous monitoring, collision avoidance as well as harsh weather applications embedded within an ECDIS environment, that require sufficient integration and testing. Based on a requirement analyses, the need for SHS-based testing is derived and a technical framework (SMARTframe) enabling connection of MASS prototypes with SHS on the basis of a message-oriented middleware is introduced. Finally, an indication is given how this set-up ensures proper MASS testing and developing for technical as well as Human-centered Design development.

[1]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[2]  Trond Are Øritsland,et al.  Visualizing complex processes on large screen displays: Design principles based on the Information Rich Design concept , 2013, Displays.

[3]  Stig Ole Johnsen,et al.  At least as safe as manned shipping? Autonomous shipping, safety and “human error” , 2018, Safety and Reliability – Safe Societies in a Changing World.

[4]  Anne-Claire Boury-Brisset,et al.  Ship Classification Using Deep Learning Techniques for Maritime Target Tracking , 2018, 2018 21st International Conference on Information Fusion (FUSION).

[5]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[6]  Ørnulf Jan Rødseth,et al.  Developments toward the unmanned ship , 2012 .

[7]  Mary L. Cummings,et al.  Boredom and Distraction in Multiple Unmanned Vehicle Supervisory Control , 2013, Interact. Comput..

[8]  Eija Kaasinen,et al.  Designing User-Oriented Future Ship Bridges: An Approach for Radical Concept Design , 2016 .

[9]  Raja Parasuraman,et al.  Monitoring an Automated System for a Single Failure: Vigilance and Task Complexity Effects , 1996, Hum. Factors.

[10]  Joel S. Warm,et al.  Vigilance Requires Hard Mental Work and Is Stressful , 2008, Hum. Factors.

[11]  Antonio Torralba,et al.  LabelMe: A Database and Web-Based Tool for Image Annotation , 2008, International Journal of Computer Vision.

[12]  伊藤 辰雄.  International regulations for preventing collisions at sea , 1936 .

[13]  Thomas B. Sheridan,et al.  Human and Computer Control of Undersea Teleoperators , 1978 .

[14]  Yang Zhang,et al.  Ship detection for visual maritime surveillance from non-stationary platforms☆ , 2017 .

[15]  Hanna Koskinen,et al.  User experience targets as design drivers: a case study on the development of a remote crane operator station , 2013, ECCE.

[16]  Ø Rødseth,et al.  A risk based approach to the design of unmanned ship control systems , 2014 .

[17]  Hanna Koskinen,et al.  Enhancing the user experience of the crane operator: comparing work demands in two operational settings , 2012, ECCE.

[18]  Christopher D. Wickens,et al.  An introduction to human factors engineering , 1997 .

[19]  Ørnulf Jan Rødseth,et al.  Characterization of Autonomy in Merchant Ships , 2018, 2018 OCEANS - MTS/IEEE Kobe Techno-Oceans (OTO).

[20]  Virpi Roto,et al.  Defining user experience goals to guide the design of industrial systems , 2015, Behav. Inf. Technol..

[21]  R A Brooks,et al.  New Approaches to Robotics , 1991, Science.

[22]  Nelson F. F. Ebecken,et al.  A SURVEY ON VIDEO DETECTION AND TRACKING OF MARITIME VESSELS , 2014 .

[23]  Mica R. Endsley,et al.  The Out-of-the-Loop Performance Problem and Level of Control in Automation , 1995, Hum. Factors.

[24]  Marja Liinasuo,et al.  Assessment of automation awareness , 2015 .

[25]  Paula Savioja,et al.  Conducting multistage HFE validations: Constructing systems usability case , 2014 .

[26]  Aksel Andreas Transeth,et al.  SEATONOMY Design, development and validation of marine autonomous systems and operations , 2015 .

[27]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[28]  David Woods,et al.  The alarm problem and directed attention in dynamic fault management , 1995 .

[29]  Torbjörn Falkmer,et al.  Eye Tracking During High Speed Navigation at Sea , 2012 .

[30]  Norman B Levy.  The Psychology of Sailing , 1980 .

[31]  Adam Weintrit,et al.  Marine Navigation and Safety of Sea Transportation , 2009 .

[32]  Deepu Rajan,et al.  Video Processing From Electro-Optical Sensors for Object Detection and Tracking in a Maritime Environment: A Survey , 2016, IEEE Transactions on Intelligent Transportation Systems.

[33]  Thomas Porathe,et al.  Autonomous Unmanned Merchant Vessel and its Contribution towards the e-Navigation Implementation: The MUNIN Perspective , 2014 .

[34]  Christopher D. Wickens,et al.  A model for types and levels of human interaction with automation , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[35]  Marialena Vagia,et al.  A literature review on the levels of automation during the years. What are the different taxonomies that have been proposed? , 2016, Applied ergonomics.

[36]  Erik Hollnagel,et al.  Joint Cognitive Systems: Foundations of Cognitive Systems Engineering , 2005 .

[37]  F. C. Van Westrenen.  The maritime pilot at work: Evaluation and use of a time-to-boundary model of mental workload in human-machine systems , 1999 .

[38]  Richard E. Fairley,et al.  The concept of operations: The bridge from operational requirements to technical specifications , 1994, Proceedings of IEEE International Conference on Requirements Engineering.

[39]  Tiina Kymäläinen,et al.  Utilizing Experience Goals in Design of Industrial Systems , 2017, CHI.

[40]  M. Gucma,et al.  Using eye tracking data for evaluation and improvement of training process on ship’s navigational bridge simulator , 2013 .

[41]  Dmitry B. Goldgof,et al.  Detection and tracking of ships in open sea with rapidly moving buoy-mounted camera system , 2012 .

[42]  Vittorio Bucci,et al.  Technology and Science for the Ships of the Future , 2022, Progress in Marine Science and Technology.

[43]  Jaakko Hakulinen,et al.  Evaluation of User Experience Goal Fulfillment: Case Remote Operator Station , 2014, HCI.

[44]  Elena R. Messina,et al.  A Framework For Autonomy Levels For Unmanned Systems (ALFUS) , 2005 .

[45]  Kenneth Holmqvist,et al.  Eye tracking: a comprehensive guide to methods and measures , 2011 .

[46]  Jaakko Hakulinen,et al.  Human Factors Challenges in Unmanned Ship Operations – Insights from Other Domains , 2015 .

[47]  Paula Savioja,et al.  Pre-validation of Nuclear Power Plant Control Room Design , 2011, HCI.

[48]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[49]  Mark D. Dunlop,et al.  Towards an understanding of operator focus using eye-tracking in safety-critical maritime settings , 2014 .

[50]  Lisanne Bainbridge,et al.  Ironies of automation , 1982, Autom..

[51]  Steve Vinoski,et al.  Advanced Message Queuing Protocol , 2006, IEEE Internet Computing.

[52]  Jakub Montewka,et al.  Safety Qualification Process for an Autonomous Ship Prototype – a Goal-based Safety Case Approach , 2017 .

[53]  Toshiyuki Matsumoto.  Guidelines for Concept Design of Automated Operation/Autonomous Operation of Ships (Provisional Version) , 2019 .

[54]  Zygmunt L. Szpak,et al.  Maritime surveillance: Tracking ships inside a dynamic background using a fast level-set , 2011, Expert Syst. Appl..

[55]  Thomas B. Sheridan,et al.  Adaptive Automation, Level of Automation, Allocation Authority, Supervisory Control, and Adaptive Control: Distinctions and Modes of Adaptation , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[56]  David B. Kaber,et al.  Issues in Human–Automation Interaction Modeling: Presumptive Aspects of Frameworks of Types and Levels of Automation , 2018 .

[57]  Thomas Porathe,et al.  Human Factor Aspects in Sea Traffic Management , 2015 .

[58]  John D. Lee,et al.  Trust in Automation: Designing for Appropriate Reliance , 2004, Hum. Factors.

[59]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[60]  Paula Savioja,et al.  Core-Task Design: A Practice-Theory Approach to Human Factors , 2015, Core-Task Design.

[61]  Hans-Christoph Burmeister,et al.  Interaction of Harsh Weather Operation and Collision Avoidance in Autonomous Navigation , 2015 .

[62]  Leena Norros,et al.  Radical Innovation by Theoretical Abstraction – A Challenge for The User-centred Designer , 2016 .

[63]  Salman Aleem.  Analysis of Shiphandlers' Eye-Gaze and Simulation Data for Improvements in COVE-ITS System , 2017 .

[64]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[65]  Definitions for Autonomous Merchant Ships , 2017 .

[66]  Fouad Bousetouane,et al.  Fast CNN surveillance pipeline for fine-grained vessel classification and detection in maritime scenarios , 2016, 2016 13th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[67]  Sathiya Kumar Renganayagalu,et al.  Video support tools for training in maritime simulators , 2013 .

[68]  Paula Savioja,et al.  User experience: does it matter in complex systems? , 2013, Cognition, Technology & Work.

[69]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[70]  Tor Arne Johansen,et al.  Automatic detection, classification and tracking of objects in the ocean surface from UAVs using a thermal camera , 2015, 2015 IEEE Aerospace Conference.

[71]  Odd Sveinung Hareide,et al.  Maritime Usability Study by Analysing Eye Tracking Data , 2017, Journal of Navigation.

[72]  Catherine M. Burns,et al.  Ecological Interface Design , 2004 .

[73]  Emilie M. Roth,et al.  Navigating through Large Display Networks in Dynamic Control Applications , 1990 .

[74]  Luca Iocchi,et al.  Background modeling in the maritime domain , 2013, Machine Vision and Applications.

[75]  Eetu Heikkilä.  Safety qualification process for autonomous ship concept demonstration , 2016 .

[76]  Yuanzhi Wang,et al.  The ironies of automation: still going strong at 30? , 2012, ECCE.