Discrete shearlet transform on GPU with applications in anomaly detection and denoising

Shearlets have emerged in recent years as one of the most successful methods for the multiscale analysis of multidimensional signals. Unlike wavelets, shearlets form a pyramid of well-localized functions defined not only over a range of scales and locations, but also over a range of orientations and with highly anisotropic supports. As a result, shearlets are much more effective than traditional wavelets in handling the geometry of multidimensional data, and this was exploited in a wide range of applications from image and signal processing. However, despite their desirable properties, the wider applicability of shearlets is limited by the computational complexity of current software implementations. For example, denoising a single 512 × 512 image using a current implementation of the shearlet-based shrinkage algorithm can take between 10 s and 2 min, depending on the number of CPU cores, and much longer processing times are required for video denoising. On the other hand, due to the parallel nature of the shearlet transform, it is possible to use graphics processing units (GPU) to accelerate its implementation. In this paper, we present an open source stand-alone implementation of the 2D discrete shearlet transform using CUDA C++ as well as GPU-accelerated MATLAB implementations of the 2D and 3D shearlet transforms. We have instrumented the code so that we can analyze the running time of each kernel under different GPU hardware. In addition to denoising, we describe a novel application of shearlets for detecting anomalies in textured images. In this application, computation times can be reduced by a factor of 50 or more, compared to multicore CPU implementations.

[1]  G. Easley,et al.  Sparse directional image representations using the discrete shearlet transform , 2008 .

[2]  Mohamed-Jalal Fadili,et al.  Morphological Component Analysis: An Adaptive Thresholding Strategy , 2007, IEEE Transactions on Image Processing.

[3]  Minh N. Do,et al.  The Nonsubsampled Contourlet Transform: Theory, Design, and Applications , 2006, IEEE Transactions on Image Processing.

[4]  Demetrio Labate,et al.  Analysis and detection of surface discontinuities using the 3D continuous shearlet transform , 2011 .

[5]  Glenn R. Easley,et al.  Radon Transform Inversion using the Shearlet Representation , 2010 .

[6]  Wang-Q Lim,et al.  Sparse multidimensional representation using shearlets , 2005, SPIE Optics + Photonics.

[7]  Peggy Subirats,et al.  Automation of Pavement Surface Crack Detection using the Continuous Wavelet Transform , 2006, 2006 International Conference on Image Processing.

[8]  Hamid Krim,et al.  A Shearlet Approach to Edge Analysis and Detection , 2009, IEEE Transactions on Image Processing.

[9]  Michael Elad,et al.  Submitted to Ieee Transactions on Image Processing Image Decomposition via the Combination of Sparse Representations and a Variational Approach , 2022 .

[10]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  M. Murray A review and comparison , 2008 .

[12]  Xiaosheng Zhuang,et al.  ShearLab: A Rational Design of a Digital Parabolic Scaling Algorithm , 2011, SIAM J. Imaging Sci..

[13]  Glenn R. Easley,et al.  3D data denoising using combined sparse dictionaries , 2013 .

[14]  Demetrio Labate,et al.  Characterization and Analysis of Edges Using the Continuous Shearlet Transform , 2009, SIAM J. Imaging Sci..

[15]  Demetrio Labate,et al.  Representation of Fourier Integral Operators Using Shearlets , 2008 .

[16]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[17]  D. Labate,et al.  The Construction of Smooth Parseval Frames of Shearlets , 2013 .

[18]  I. Johnstone,et al.  Adapting to Unknown Smoothness via Wavelet Shrinkage , 1995 .

[19]  Demetrio Labate,et al.  Optimally Sparse Multidimensional Representation Using Shearlets , 2007, SIAM J. Math. Anal..

[20]  Martin Vetterli,et al.  Adaptive wavelet thresholding for image denoising and compression , 2000, IEEE Trans. Image Process..

[21]  Mohamed-Jalal Fadili,et al.  Sparse Image and Signal Processing: Wavelets, Curvelets, Morphological Diversity, by Jean-Luc Starck, Fionn Murtagh, and Jalal M. Fadili , 2010, J. Electronic Imaging.

[22]  John C. Buckhouse,et al.  Review and Comparison , 1983 .

[23]  Pooran Singh Negi,et al.  3-D Discrete Shearlet Transform and Video Processing , 2012, IEEE Transactions on Image Processing.

[24]  E. Candès,et al.  New tight frames of curvelets and optimal representations of objects with piecewise C2 singularities , 2004 .

[25]  Chun-Xia Zhao,et al.  Pavement Distress Detection Based on Nonsubsampled Contourlet Transform , 2008, 2008 International Conference on Computer Science and Software Engineering.

[26]  Laurent Demanet,et al.  Fast Discrete Curvelet Transforms , 2006, Multiscale Model. Simul..

[27]  Dennis M. Healy,et al.  Shearlet-Based Deconvolution , 2009, IEEE Transactions on Image Processing.

[28]  Demetrio Labate,et al.  Optimally Sparse Representations of 3D Data with C2 Surface Singularities Using Parseval Frames of Shearlets , 2012, SIAM J. Math. Anal..

[29]  Koichi Niijima ON THE BEHAVIOR OF SOLUTIONS OF A SINGULARLY PERTURBED BOUNDARY VALUE PROBLEM WITH A TURNING POINT , 1978 .

[30]  Vishal M. Patel,et al.  Directional Multiscale Processing of Images Using Wavelets with Composite Dilations , 2012, Journal of Mathematical Imaging and Vision.

[31]  Gitta Kutyniok,et al.  Shearlets: Multiscale Analysis for Multivariate Data , 2012 .

[32]  Paulo Lobato Correia,et al.  Automatic Road Crack Detection and Characterization , 2013, IEEE Transactions on Intelligent Transportation Systems.

[33]  Aleksandra Pizurica,et al.  Iterative CT Reconstruction Using Shearlet-Based Regularization , 2013, IEEE Transactions on Nuclear Science.

[34]  S. Chambon,et al.  Automatic Road Pavement Assessment with Image Processing: Review and Comparison , 2011 .

[35]  Wang-Q Lim,et al.  Image Separation Using Wavelets and Shearlets , 2010, Curves and Surfaces.

[36]  Fionn Murtagh,et al.  Sparse Image and Signal Processing: Preface , 2010 .