A Novel Densely Connected Convolutional Neural Network for Sea-State Estimation Using Ship Motion Data

The sea-state estimation is a fundamental problem in the development of autonomous ships. Traditional methods such as wave buoy, satellites, and wave radars are limited by locations, clouds, and costs, respectively. Model-based methods are prone to incorrect estimations due to their high dependence on mathematical models of ships. As previous data-driven studies for sea-state estimation consider only wave height and use the motion data from dynamic positioning (DP) vessels, this article introduces a new, deep neural network (SSENET) to estimate sea state in light of both wave height and wave direction and extends the generality of sensor data from ship motion with forward speed. SSENET is built on the basis of stacked convolutional neural network (CNN) blocks with dense connections between different blocks, channel attention modules, and a feature attention module. The dense connections build short-cut paths between input and all subsequent convolutional blocks, which can make full use of all the hierarchical features from the original time-series sensor data. The channel attention modules aim to enhance the features extracted by each convolution block. The feature attention module focuses on combining the feature fusion of hierarchical features in an adaptive manner. Benchmark experiments show the competitive performance against the state-of-the-art approaches. Applying the SSENET on two data sets of a zigzag motion for comparative studies shows the effectiveness of the proposed method.

[1]  Enhong Chen,et al.  Exploiting MultiChannels Deep Convolutional Neural Networks for Multivariate Time Series Classification , 2015 .

[2]  Houxiang Zhang,et al.  A Neural-Network-Based Sensitivity Analysis Approach for Data-Driven Modeling of Ship Motion , 2020, IEEE Journal of Oceanic Engineering.

[3]  Shuzhi Sam Ge,et al.  Sea state identification based on vessel motion response learning via multi-layer classifiers , 2018 .

[4]  Tim Oates,et al.  Time series classification from scratch with deep neural networks: A strong baseline , 2016, 2017 International Joint Conference on Neural Networks (IJCNN).

[5]  Astrid H. Brodtkorb,et al.  Ship Motion-Based Wave Estimation Using a Spectral Residual-Calculation , 2018, 2018 OCEANS - MTS/IEEE Kobe Techno-Oceans (OTO).

[6]  Houxiang Zhang,et al.  Analysis and modeling of sensor data for ship motion prediction , 2016, OCEANS 2016 - Shanghai.

[7]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Toshio Iseki,et al.  Bayesian estimation of directional wave spectra based on ship motions , 1998 .

[9]  Asgeir J. Sørensen,et al.  Ocean Wave Spectral Estimation Using Vessel Wave Frequency Motions , 2007 .

[10]  Qingquan Song,et al.  Efficient Neural Architecture Search with Network Morphism , 2018, ArXiv.

[11]  Houxiang Zhang,et al.  Modeling and Analysis of Motion Data from Dynamically Positioned Vessels for Sea State Estimation , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[12]  Ulrik Dam Nielsen,et al.  Estimation of wind sea and swell using shipboard measurements – A refined parametric modelling approach , 2016 .

[13]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[14]  Stephen Lin,et al.  GCNet: Non-Local Networks Meet Squeeze-Excitation Networks and Beyond , 2019, 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW).

[15]  Patrick Schäfer,et al.  Scalable time series classification , 2016, Data Mining and Knowledge Discovery.

[16]  Leigh McCue,et al.  Handbook of Marine Craft Hydrodynamics and Motion Control [Bookshelf] , 2016, IEEE Control Systems.

[17]  Asgeir J. Sørensen,et al.  Sea state estimation using vessel response in dynamic positioning , 2018 .

[18]  K Lindemann,et al.  ON THE APPLICATION OF HULL SURVEILLANCE SYSTEMS FOR INCREASED SAFETY AND IMPROVED STRUCTURAL UTILIZATION IN ROUGH WEATHER , 1977 .

[19]  In-So Kweon,et al.  CBAM: Convolutional Block Attention Module , 2018, ECCV.

[20]  David M. J. Tax,et al.  Multivariate Time-Series Classification Using the Hidden-Unit Logistic Model , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[21]  Pablo A. Estévez,et al.  A review of feature selection methods based on mutual information , 2013, Neural Computing and Applications.

[22]  C. Guedes Soares,et al.  Kalman filtering of vessel motions for ocean wave directional spectrum estimation , 2009 .

[23]  Ulrik Dam Nielsen,et al.  Estimations of on-site directional wave spectra from measured ship responses , 2006 .

[24]  Lokukaluge P. Perera,et al.  Estimation of directional sea spectra from ship motions in sea trials , 2017 .

[25]  Asgeir J. Sørensen,et al.  A brute-force spectral approach for wave estimation using measured vessel motions , 2018 .

[26]  George C. Runger,et al.  A Bag-of-Features Framework to Classify Time Series , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Houshang Darabi,et al.  LSTM Fully Convolutional Networks for Time Series Classification , 2017, IEEE Access.

[28]  Carlo Vercellis,et al.  Combining discrete SVM and fixed cardinality warping distances for multivariate time series classification , 2010, Pattern Recognit..

[29]  Patrick Schäfer The BOSS is concerned with time series classification in the presence of noise , 2014, Data Mining and Knowledge Discovery.

[30]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  Houshang Darabi,et al.  Multivariate LSTM-FCNs for Time Series Classification , 2018, Neural Networks.

[32]  Gert Kootstra,et al.  International Conference on Robotics and Automation (ICRA) , 2008, ICRA 2008.

[33]  Eilif Pedersen,et al.  Virtual prototyping of maritime systems and operations: applications of distributed co-simulations , 2018 .

[34]  Astrid H. Brodtkorb,et al.  Evaluation of shipboard wave estimation techniques through model-scale experiments , 2016, OCEANS 2016 - Shanghai.

[35]  Yi Zheng,et al.  Exploiting multi-channels deep convolutional neural networks for multivariate time series classification , 2015, Frontiers of Computer Science.

[36]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[37]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[38]  Germain Forestier,et al.  Deep learning for time series classification: a review , 2018, Data Mining and Knowledge Discovery.

[39]  Ulrik Dam Nielsen,et al.  A Concise Account of Techniques Available for Shipboard Sea State Estimation , 2017 .

[40]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[41]  Asgeir J. Sørensen,et al.  A survey of dynamic positioning control systems , 2011, Annu. Rev. Control..