Super-resolution of turbulent passive scalar images using data assimilation

AbstractIn this paper, the problem of improving the quality of low-resolution passive scalar image sequences is addressed. This situation, known as “image super-resolution” in computer vision, aroused to our knowledge very few applications in the field of fluid visualization. Yet, in most image acquisition devices, the spatial resolution of the acquired data is limited by the sensor physical properties, while users often require higher-resolution images for further processing and analysis of the system of interest. The originality of the approach presented in this paper is to link the image super-resolution process together with the large eddy simulation framework in order to derive a complete super-resolution technique. We first start by defining two categories of fine-scale components we aim to reconstruct. Then, using a deconvolution procedure as well as data assimilation tools, we show how to partially recover some of these missing components within the low-resolution images while ensuring the temporal consistency of the solution. This method is evaluated using both synthetic and real image data. Finally, we demonstrate how the produced high-resolution images can improve a posteriori analysis such as motion field estimation.

[1]  J. Weickert,et al.  Lucas/Kanade meets Horn/Schunck: combining local and global optic flow methods , 2005 .

[2]  Patrick Pérez,et al.  Dense Estimation of Fluid Flows , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Kwang In Kim,et al.  Single-Image Super-Resolution Using Sparse Regression and Natural Image Prior , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Michael Elad,et al.  A Statistical Prediction Model Based on Sparse Representations for Single Image Super-Resolution , 2014, IEEE Transactions on Image Processing.

[5]  Pierre Sagaut,et al.  Multiscale And Multiresolution Approaches In Turbulence , 2006 .

[6]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[7]  P. Courtier,et al.  Variational Assimilation of Meteorological Observations With the Adjoint Vorticity Equation. I: Theory , 2007 .

[8]  P. Tabeling,et al.  Intermittency of a passive tracer in the inverse energy cascade. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[9]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[10]  W. Dahm,et al.  Scalar imaging velocimetry measurements of the velocity gradient tensor field in turbulent flows. I. Assessment of errors , 1996 .

[11]  Patrick Pérez,et al.  Extraction of Singular Points from Dense Motion Fields: An Analytic Approach , 2003, Journal of Mathematical Imaging and Vision.

[12]  Étienne Mémin,et al.  Inflow and initial conditions for direct numerical simulation based on adjoint data assimilation , 2011, J. Comput. Phys..

[13]  E. Tadmor,et al.  New High-Resolution Central Schemes for Nonlinear Conservation Laws and Convection—Diffusion Equations , 2000 .

[14]  D. Heitz,et al.  Power laws and inverse motion modelling: application to turbulence measurements from satellite images , 2012 .

[15]  Andrew F. Bennett,et al.  Inverse Methods in Physical Oceanography: Frontmatter , 1992 .

[16]  Bhabatosh Chanda,et al.  Super Resolution Image Reconstruction Through Bregman Iteration Using Morphologic Regularization , 2012, IEEE Transactions on Image Processing.

[17]  F. L. Dimet,et al.  Variational algorithms for analysis and assimilation of meteorological observations: theoretical aspects , 1986 .

[18]  Fei Zhou,et al.  Interpolation-Based Image Super-Resolution Using Multisurface Fitting , 2012, IEEE Transactions on Image Processing.

[19]  W. Dahm,et al.  Scalar imaging velocimetry measurements of the velocity gradient tensor field in turbulent flows. II , 1996 .

[20]  P. Sagaut.  Large Eddy Simulation for Incompressible Flows , 2001 .

[21]  J. Lions.  Optimal Control of Systems Governed by Partial Differential Equations , 1971 .

[22]  Richard D. Keane,et al.  Theory of cross-correlation analysis of PIV images , 1992 .

[23]  Satoshi Naoi,et al.  Text Processing Method for E-learning Videos , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[24]  Thomas B. Moeslund,et al.  Super-resolution: a comprehensive survey , 2014, Machine Vision and Applications.

[25]  F. Scarano,et al.  On the use of helium-filled soap bubbles for large-scale tomographic PIV in wind tunnel experiments , 2015 .

[26]  Nicolas Papadakis,et al.  Dynamically consistent optical flow estimation , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[27]  Robert L. Stevenson,et al.  Super-resolution from image sequences-a review , 1998, 1998 Midwest Symposium on Circuits and Systems (Cat. No. 98CB36268).

[28]  Liang Shao,et al.  Optical flow for incompressible turbulence motion estimation , 2015 .

[29]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[30]  E.,et al.  4D Variational Data Analysis with Imperfect Model , 2000 .

[31]  Christoph Schnörr,et al.  Variational fluid flow measurements from image sequences: synopsis and perspectives , 2010 .

[32]  Xu Chen,et al.  Observation Model Based on Scale Interactions for Optical Flow Estimation , 2014, IEEE Transactions on Image Processing.

[33]  P. Moin,et al.  A dynamic subgrid‐scale model for compressible turbulence and scalar transport , 1991 .

[34]  Takeo Kanade,et al.  Limits on Super-Resolution and How to Break Them , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  L. Shao,et al.  Subgrid scale formulation of optical flow for the study of turbulent flow , 2011 .

[36]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[37]  Michael J. Black,et al.  Secrets of optical flow estimation and their principles , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[38]  Serge J. Belongie,et al.  Big Little Icons , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[39]  Russell C. Hardie,et al.  Joint MAP registration and high-resolution image estimation using a sequence of undersampled images , 1997, IEEE Trans. Image Process..

[40]  Michael Elad,et al.  Fast and robust multiframe super resolution , 2004, IEEE Transactions on Image Processing.

[41]  Feng Wu,et al.  Real-time screen image scaling and its GPU acceleration , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).