Dense motion estimation of particle images via a convolutional neural network

In this paper, we propose a supervised learning strategy for the fluid motion estimation problem (i.e., extracting the velocity fields from particle images). The purpose of this work is to design a convolutional neural network (CNN) for estimating dense motion field for particle image velocimetry (PIV), which allows to improve the computational efficiency without reducing the accuracy. First, the network model is developed based on FlowNetS, which is recently proposed for end-to-end optical flow estimation in the computer vision community. The input of the network is a particle image pair and the output is a velocity field with displacement vectors at every pixel. Second, a synthetic dataset of fluid flow images is generated to train the CNN model. To our knowledge, this is the first time a CNN has been used as a global motion estimator for particle image velocimetry. Experimental evaluations indicate that the trained CNN model can provide satisfactory results in both artificial and laboratory PIV images. The proposed estimator is also applied to the experiment of turbulent boundary layer. In addition, the computational efficiency of the CNN estimator is much superior to those of the traditional cross-correction and optical flow methods.Graphical abstract

[1]  J. Weickert,et al.  Lucas/Kanade meets Horn/Schunck: combining local and global optic flow methods , 2005 .

[2]  L. Lourenço Particle Image Velocimetry , 1989 .

[3]  Markus Raffel,et al.  Particle Image Velocimetry: A Practical Guide , 2002 .

[4]  Bertrand Chapron,et al.  Geophysical flows under location uncertainty, Part II Quasi-geostrophy and efficient ensemble spreading , 2016, 1611.03041.

[5]  Patrick Pérez,et al.  Dense Estimation of Fluid Flows , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Michel Stanislas,et al.  Main results of the third international PIV Challenge , 2008 .

[7]  F. Champagnat,et al.  Fast and accurate PIV computation using highly parallel iterative correlation maximization , 2011 .

[8]  F. Scarano,et al.  On the use of helium-filled soap bubbles for large-scale tomographic PIV in wind tunnel experiments , 2015 .

[9]  Michel Stanislas,et al.  Main results of the Second International PIV Challenge , 2005 .

[10]  Min-Soo Kim,et al.  Elliptic relaxation second moment closure for the turbulent heat fluxes , 2008 .

[11]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[12]  F. Scarano Iterative image deformation methods in PIV , 2002 .

[13]  Ning Qian,et al.  On the momentum term in gradient descent learning algorithms , 1999, Neural Networks.

[14]  Miroslav Krstic,et al.  Stabilization of linearized 2D magnetohydrodynamic channel flow by backstepping boundary control , 2008, Syst. Control. Lett..

[15]  Liang Shao,et al.  Optical flow for incompressible turbulence motion estimation , 2015 .

[16]  Hua Yang,et al.  PIV-DCNN: cascaded deep convolutional neural networks for particle image velocimetry , 2017, Experiments in Fluids.

[17]  Tianshu Liu,et al.  Fluid flow and optical flow , 2008, Journal of Fluid Mechanics.

[18]  Christophe Collewet,et al.  Drag reduction of the plane Poiseuille flow by partitioned visual servo control , 2012, 2012 American Control Conference (ACC).

[19]  Xiaogang Wang,et al.  Deep Convolutional Network Cascade for Facial Point Detection , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Daniel Cremers,et al.  What Makes Good Synthetic Training Data for Learning Disparity and Optical Flow Estimation? , 2018, International Journal of Computer Vision.

[21]  Thomas Brox,et al.  FlowNet: Learning Optical Flow with Convolutional Networks , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[22]  Christoph Schnörr,et al.  Variational fluid flow measurements from image sequences: synopsis and perspectives , 2010 .

[23]  Michael J. Black,et al.  Secrets of optical flow estimation and their principles , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[24]  Thomas Brox,et al.  FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Tianshu Liu,et al.  Comparison between optical flow and cross-correlation methods for extraction of velocity fields from particle images , 2015 .

[26]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[27]  Kotagiri Ramamohanarao,et al.  A quantitative measure for retinal blood vessel segmentation evaluation , 2012 .

[28]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[29]  Etienne Mémin,et al.  Motion estimation under location uncertainty for turbulent fluid flows , 2018 .

[30]  Thomas Brox,et al.  High Accuracy Optical Flow Estimation Based on a Theory for Warping , 2004, ECCV.

[31]  Yi Li,et al.  Data exploration of turbulence simulations using a database cluster , 2007, Proceedings of the 2007 ACM/IEEE Conference on Supercomputing (SC '07).

[32]  Yi Li,et al.  A public turbulence database cluster and applications to study Lagrangian evolution of velocity increments in turbulence , 2008, 0804.1703.

[33]  S. Wereley,et al.  Advanced Algorithms for Microscale Particle Image Velocimetry , 2002 .

[34]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  T. Corpetti,et al.  Fluid experimental flow estimation based on an optical-flow scheme , 2006 .