Droplet Image Super Resolution Based on Sparse Representation and Kernel Regression

Microgravity and containerless conditions, which are produced via electrostatic levitation combined with a drop tube, are important when studying the intrinsic properties of new metastable materials. Generally, temperature and image sensors can be used to measure the changes of sample temperature, morphology and volume. Then, the specific heat, surface tension, viscosity changes and sample density can be obtained. Considering that the falling speed of the material sample droplet is approximately 31.3 m/s when it reaches the bottom of a 50-meter-high drop tube, a high-speed camera with a collection rate of up to 106 frames/s is required to image the falling droplet. However, at the high-speed mode, very few pixels, approximately 48-120, will be obtained in each exposure time, which results in low image quality. Super-resolution image reconstruction is an algorithm that provides finer details than the sampling grid of a given imaging device by increasing the number of pixels per unit area in the image. In this work, we demonstrate the application of single image-resolution reconstruction in the microgravity and electrostatic levitation for the first time. Here, using the image super-resolution method based on sparse representation, a low-resolution droplet image can be reconstructed. Employed Yang’s related dictionary model, high- and low-resolution image patches were combined with dictionary training, and high- and low-resolution-related dictionaries were obtained. The online double-sparse dictionary training algorithm was used in the study of related dictionaries and overcome the shortcomings of the traditional training algorithm with small image patch. During the stage of image reconstruction, the algorithm of kernel regression is added, which effectively overcomes the shortcomings of the Yang image’s edge blurs.

[1]  Qiusheng Liu,et al.  Droplet Image Feedback Control System in Evaporation Experiment , 2010 .

[2]  Y. C. Pati,et al.  Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[3]  A. Hirsa,et al.  Ring-Sheared Drop (RSD): Microgravity Module for Containerless Flow Studies , 2017 .

[4]  Raúl Herranz,et al.  Evaluation of Simulated Microgravity Environments Induced by Diamagnetic Levitation of Plant Cell Suspension Cultures , 2016 .

[5]  Michael Elad,et al.  Double Sparsity: Learning Sparse Dictionaries for Sparse Signal Approximation , 2010, IEEE Transactions on Signal Processing.

[6]  Ruth Hemmersbach,et al.  Facilities for Simulation of Microgravity in the ESA Ground-Based Facility Programme , 2016 .

[7]  Yi Sun,et al.  Context-aware single image super-resolution using sparse representation and cross-scale similarity , 2015, Signal Process. Image Commun..

[8]  Peyman Milanfar,et al.  Kernel Regression for Image Processing and Reconstruction , 2007, IEEE Transactions on Image Processing.

[9]  Michael Elad,et al.  Trainlets: Dictionary Learning in High Dimensions , 2016, IEEE Transactions on Signal Processing.

[10]  The Image Processing of Droplet for Evaporation Experiment in SJ-10 , 2017 .

[11]  M. Brandenbourger,et al.  Electrically Charged Droplets in Microgravity , 2017 .

[12]  H. Abdi,et al.  Principal component analysis , 2010 .

[13]  Michael Elad,et al.  Sparse and Redundant Representations - From Theory to Applications in Signal and Image Processing , 2010 .

[14]  Roger Y. Tsai,et al.  Multiframe image restoration and registration , 1984 .

[15]  Lei Zhang,et al.  Sparse Representation Based Image Interpolation With Nonlocal Autoregressive Modeling , 2013, IEEE Transactions on Image Processing.

[16]  Liang Chen,et al.  Investigation of microgravity effect on solidification of medium-low-melting-point alloy by drop tube experiment , 2008 .

[17]  Michael Elad,et al.  On Single Image Scale-Up Using Sparse-Representations , 2010, Curves and Surfaces.

[18]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[19]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[20]  D. Herlach,et al.  Phase formation in undercooled NdFeB alloy droplets , 2001 .

[21]  Thomas S. Huang,et al.  Image super-resolution as sparse representation of raw image patches , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.