A wavelet based method for image reconstruction from gradient data with applications

In this paper, an algorithm for image reconstruction from gradient data based on the Haar wavelet decomposition is proposed. The proposed algorithm has two main stages. First, the Haar decomposition of the image to be reconstructed is obtained from the given gradient data set. Then, the Haar wavelet synthesis is employed to produce the image. The proposed algorithm is based on the relationship between the Haar analysis and synthesis filters and the model for the discretized gradient. The approach presented here is based on the one by Hampton et al. (IEEE J Sel Top Signal Process 2(5):781–792, 2008) for wavefront reconstruction in adaptive optics. The main strength of the proposed algorithm lies in its multiresolution nature, which allows efficient processing in the wavelet domain with complexity $${\fancyscript{O}}(N)$$O(N). In addition, obtaining the wavelet decomposition of the image to be reconstructed provides the possibility for further enhancements of the image, such as denoising or smoothing via iterative Poisson solvers at each resolution during Haar synthesis. To evaluate the performance of the proposed algorithm, it is applied to reconstruct ten standard test images. Experiments demonstrate that the algorithm yields results comparable in terms of solution accuracy to those produced by well-known benchmark algorithms. Further, experiments show that the proposed algorithm is suitable to be employed as a final step to reconstruct an image from a gradient data set, in applications such as image stitching or image morphing.

[1]  Dani Lischinski,et al.  Gradient Domain High Dynamic Range Compression , 2023 .

[2]  Rama Chellappa,et al.  A Method for Enforcing Integrability in Shape from Shading Algorithms , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Matthew Harker,et al.  Regularized Reconstruction of a Surface from its Measured Gradient Field , 2013, Journal of Mathematical Imaging and Vision.

[4]  Pan Agathoklis,et al.  Comparison of Haar wavelet-based and Poisson-based numerical integration techniques , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[5]  David L. Fried,et al.  Least-square fitting a wave-front distortion estimate to an array of phase-difference measurements , 1977 .

[6]  Rama Chellappa,et al.  Enforcing integrability by error correction using l1-minimization , 2009, CVPR.

[7]  Peter Kovesi,et al.  Shapelets correlated with surface normals produce surfaces , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[8]  Rama Chellappa,et al.  What Is the Range of Surface Reconstructions from a Gradient Field? , 2006, ECCV.

[9]  Matthew Harker,et al.  Direct regularized surface reconstruction from gradients for Industrial Photometric Stereo , 2013, Comput. Ind..

[10]  Ramesh Raskar,et al.  Why I Want a Gradient Camera , 2022 .

[11]  P. Agathoklis,et al.  A feature based technique for face recognition using Mexican hat wavelets , 2009, 2009 IEEE Pacific Rim Conference on Communications, Computers and Signal Processing.

[12]  C. E. Rash,et al.  Helmet-mounted Displays: Sensation, Perception, and Cognition Issues , 2009 .

[13]  Ramesh Raskar,et al.  Removing photography artifacts using gradient projection and flash-exposure sampling , 2005, SIGGRAPH 2005.

[14]  Edward H. Adelson,et al.  A multiresolution spline with application to image mosaics , 1983, TOGS.

[15]  Colin Bradley,et al.  Wavefront reconstruction over a circular aperture using gradient data extrapolated via the mirror equations. , 2009, Applied optics.

[16]  Jean-Pierre Véran,et al.  Optimal modal fourier-transform wavefront control. , 2005, Journal of the Optical Society of America. A, Optics, image science, and vision.

[17]  C. Vogel,et al.  Multigrid algorithm for least-squares wavefront reconstruction. , 2006, Applied optics.

[18]  R. Hudgin Wave-front reconstruction for compensated imaging , 1977 .

[19]  Alexei A. Efros,et al.  Photo clip art , 2007, SIGGRAPH 2007.

[20]  Steven M. Seitz,et al.  View morphing , 1996, SIGGRAPH.

[21]  Peter J. Hampton,et al.  Seamless stitching of images based on a Haar wavelet 2D integration method , 2011, 2011 17th International Conference on Digital Signal Processing (DSP).

[22]  Jani Boutellier,et al.  Objective Evaluation of Image Mosaics , 2007, VISIGRAPP.

[23]  Curtis R Vogel,et al.  Multigrid preconditioned conjugate-gradient method for large-scale wave-front reconstruction. , 2002, Journal of the Optical Society of America. A, Optics, image science, and vision.

[24]  Edwin R. Hancock,et al.  Face Recognition using 2.5D Shape Information , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[25]  George Wolberg,et al.  Recent advances in image morphing , 1996, Proceedings of CG International '96.

[26]  Qiang Ji,et al.  Digital imaging colposcopy: corrected area measurements using shape-from-shading , 1998, IEEE Transactions on Medical Imaging.

[27]  Jelena Kovacevic,et al.  Wavelets and Subband Coding , 2013, Prentice Hall Signal Processing Series.

[28]  Matthew Harker,et al.  Least squares surface reconstruction from gradients: Direct algebraic methods with spectral, Tikhonov, and constrained regularization , 2011, CVPR 2011.

[29]  David S. Watkins,et al.  Fundamentals of Matrix Computations: Watkins/Fundamentals of Matrix Computations , 2005 .

[30]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[31]  Matthew Harker,et al.  Least squares surface reconstruction from measured gradient fields , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[32]  Shmuel Peleg,et al.  Seamless Image Stitching in the Gradient Domain , 2004, ECCV.

[33]  P. Agathoklis,et al.  A Robust, Feature-based Algorithm for Aerial Image Registration , 2007, 2007 IEEE International Symposium on Industrial Electronics.

[34]  Mark S. Drew,et al.  Removing Shadows from Images , 2002, ECCV.

[35]  Colin Bradley,et al.  A New Wave-Front Reconstruction Method for Adaptive Optics Systems Using Wavelets , 2008, IEEE Journal of Selected Topics in Signal Processing.

[36]  Rama Chellappa,et al.  Direct Analytical Methods for Solving Poisson Equations in Computer Vision Problems , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Steven M. Seitz,et al.  Example-based photometric stereo: shape reconstruction with general, varying BRDFs , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  David S. Watkins,et al.  Fundamentals of matrix computations , 1991 .

[39]  Chiou-Ting Hsu,et al.  Multiresolution mosaic , 1996 .