Spatio-temporal prediction of soil deformation in bucket excavation using machine learning

This paper proposes a prediction model for three-dimensional spatio-temporal soil deformation in bucket excavation. The prediction model for soil deformation (PMSD) consists of two machine learning processes: the long short-term memory (LSTM) and convolutional autoencoder (Conv-AE). These processes use datasets obtained from an experimental apparatus for bucket excavation developed in this work. The apparatus equips multiple depth cameras that precisely capture time-series data of soil deformation in bucket excavation. The LSTM, an extension of a recurrent neural network, successively predicts three-dimensional soil deformation. The Conv-AE is incorporated to both ends of the LSTM in order to quasi-reversibly compress and reconstruct the datasets so that the computational burden of the LSTM is relaxed. Qualitative and quantitative evaluations of the PMSD confirm the feasibility of time-series prediction of three-dimensional soil deformation. The Conv-AE shows sufficient accuracy equivalent to the measurement accuracy of the depth camera. The prediction accuracy of the PMSD is about 10 mm in most of the cases. GRAPHICAL ABSTRACT

[1]  Jürgen Schmidhuber,et al.  Learning Precise Timing with LSTM Recurrent Networks , 2003, J. Mach. Learn. Res..

[2]  Takayuki Koizumi,et al.  Investigation of Efficiency Improvement in Digging Operation for Hydraulic Excavators , 2013 .

[3]  Koji Fukagata,et al.  Synthetic turbulent inflow generator using machine learning , 2018, Physical Review Fluids.

[4]  Kazutoshi Hirao,et al.  Approximate Prediction of Soil Deformation Under Drained-Repeated Loading , 1983 .

[5]  Shih-Lin Hung,et al.  NEURAL NETWORK FORECAST MODEL IN DEEP EXCAVATION , 2002 .

[6]  Hui Shao,et al.  Automatic Excavation Planning of Hydraulic Excavator , 2008, ICIRA.

[7]  Jürgen Schmidhuber,et al.  Learning to Forget: Continual Prediction with LSTM , 2000, Neural Computation.

[8]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[9]  G. Ishigami,et al.  Vision-based measurement of spatio-temporal deformation of excavated soil for the estimation of bucket resistive force , 2020, Journal of Terramechanics.

[10]  Shin'ichi Yuta,et al.  Development of the autonomous hydraulic excavator prototype using 3-D information for motion planning and control , 2010, 2010 IEEE/SICE International Symposium on System Integration.

[11]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[12]  Kenichi Fujino,et al.  REMOTE CONTROLLED CONSTRUCTION EQUIPMENT BY USING HIGH-RESOLUTION STEREOSCOPIC 3D IMAGES , 2017 .

[13]  C. J. Coetzee,et al.  The numerical modelling of excavator bucket filling using DEM , 2009 .

[14]  Sanjiv Singh,et al.  Learning to predict resistive forces during robotic excavation , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[15]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[16]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[17]  Jürgen Schmidhuber,et al.  Framewise phoneme classification with bidirectional LSTM and other neural network architectures , 2005, Neural Networks.

[18]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.