Trajectory Extraction and Deep Features for Classification of Liquid-gas Flow under the Context of Forced Oscillation

: Computer vision and deep learning techniques are increasingly applied to analyze experimental processes in engineering domains. In this paper, we propose a new dataset of liquid-gas flow videos captured from a mechanical model simulating a cooling gallery of an automobile engine, through forced oscillations. The analysis of this dataset is of interest for fluid-mechanic field to validate the simulation environment. From computer vision point of view, it provides a new dynamic texture dataset with challenging tasks since liquid and gas keep changing constantly and the form of liquid-gas flow is closely related to the external environment. In particular predicting the rotation velocity of the engine corresponding to liquid-gas movements is a first step before precise analysis of flow patterns and of their trajectories. The paper also provides an experimental analysis showing that such rotation velocity can be hard to predict accurately. It could be achieved using deep learning approaches but not with state-of-the-art method dedicated to trajectory analysis. We show also that a preprocessing step with difference of Gaussian (DoG) over multiple scales as input of deep neural networks is mandatory to obtain satisfying results, up to 81.39% on the test set. This study opens an exploratory field for complex tasks on dynamic texture analysis such as trajectory analysis of heterogeneous masses.

[1]  Tao Mei,et al.  Learning Spatio-Temporal Representation with Pseudo-3D Residual Networks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[2]  Cordelia Schmid,et al.  Learning realistic human actions from movies , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Dmitry Chetverikov,et al.  Dynamic Texture Recognition Using Normal Flow and Texture Regularity , 2005, IbPRIA.

[4]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Weixin Xie,et al.  Dynamic Texture Recognition by Spatio-Temporal Multiresolution Histograms , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[6]  Tony Lindeberg,et al.  Dynamic Texture Recognition Using Time-Causal and Time-Recursive Spatio-Temporal Receptive Fields , 2018, Journal of Mathematical Imaging and Vision.

[7]  Cordelia Schmid,et al.  Human Detection Using Oriented Histograms of Flow and Appearance , 2006, ECCV.

[8]  Horst Bischof,et al.  Real-Time Tracking via On-line Boosting , 2006, BMVC.

[9]  Gunnar Farnebäck,et al.  Two-Frame Motion Estimation Based on Polynomial Expansion , 2003, SCIA.

[10]  Matti Pietikäinen,et al.  Dynamic texture and scene classification by transferring deep image features , 2015, Neurocomputing.

[11]  Yann LeCun,et al.  A Closer Look at Spatiotemporal Convolutions for Action Recognition , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[12]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[13]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[14]  Cordelia Schmid,et al.  Dense Trajectories and Motion Boundary Descriptors for Action Recognition , 2013, International Journal of Computer Vision.

[15]  Paul F. Whelan,et al.  Convolutional neural network on three orthogonal planes for dynamic texture classification , 2017, Pattern Recognit..

[16]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[17]  Lorenzo Torresani,et al.  Learning Spatiotemporal Features with 3D Convolutional Networks , 2014, 2015 IEEE International Conference on Computer Vision (ICCV).

[18]  Cordelia Schmid,et al.  Local Features and Kernels for Classification of Texture and Object Categories: A Comprehensive Study , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[19]  Patrick Bouthemy,et al.  Motion Textures: Modeling, Classification, and Segmentation Using Mixed-State Markov Random Fields , 2013, SIAM J. Imaging Sci..

[20]  Randal C. Nelson,et al.  Qualitative recognition of motion using temporal texture , 1992, CVGIP Image Underst..