Discrete shearlet transform on GPU with applications in anomaly detection and

Shearlets have emerged in recent years as one of the most successful methods for the multiscale analysis of multidimensional signals. Unlike wavelets, shearlets form a pyramid of well-localized functions defined not only over a range of scales and locations, but also over a range of orientations and with highly anisotropic supports. As a result, shearlets are much more effective than traditional wavelets in handling the geometry of multidimensional data, and this was exploited in a wide range of applications from image and signal processing. However, despite their desirable properties, the wider applicability of shearlets is limited by the computational complexity of current software implementations. For example, denoising a single 512 × 512 image using a current implementation of the shearlet-based shrinkage algorithm can take between 10 s and 2 min, depending on the number of CPU cores, and much longer processing times are required for video denoising. On the other hand, due to the parallel nature of the shearlet transform, it is possible to use graphics processing units (GPU) to accelerate its implementation. In this paper, we present an open source stand-alone implementation of the 2D discrete shearlet transform using CUDA C++ as well as GPU-accelerated MATLAB implementations of the 2D and 3D shearlet transforms. We have instrumented the code so that we can analyze the running time of each kernel under different GPU hardware. In addition to denoising, we describe a novel application of shearlets for detecting anomalies in textured images. In this application, computation times can be reduced by a factor of 50 or more, compared to multicore CPU implementations.

[1]  Paulo Lobato Correia,et al.  Automatic Road Crack Detection and Characterization , 2013, IEEE Transactions on Intelligent Transportation Systems.

[2]  Vishal M. Patel,et al.  Directional Multiscale Processing of Images Using Wavelets with Composite Dilations , 2012, Journal of Mathematical Imaging and Vision.

[3]  Pooran Singh Negi,et al.  3-D Discrete Shearlet Transform and Video Processing , 2012, IEEE Transactions on Image Processing.

[4]  Demetrio Labate,et al.  Optimally Sparse Representations of 3D Data with C2 Surface Singularities Using Parseval Frames of Shearlets , 2012, SIAM J. Math. Anal..

[5]  Gitta Kutyniok,et al.  Shearlets: Multiscale Analysis for Multivariate Data , 2012 .

[6]  Aleksandra Pizurica,et al.  Iterative CT Reconstruction Using Shearlet-Based Regularization , 2012, IEEE Transactions on Nuclear Science.

[7]  S. Chambon,et al.  Automatic Road Pavement Assessment with Image Processing: Review and Comparison , 2011 .

[8]  Xiaosheng Zhuang,et al.  ShearLab: A Rational Design of a Digital Parabolic Scaling Algorithm , 2011, SIAM J. Imaging Sci..

[9]  Demetrio Labate,et al.  Analysis and detection of surface discontinuities using the 3D continuous shearlet transform , 2011 .

[10]  Glenn R. Easley,et al.  Radon Transform Inversion using the Shearlet Representation , 2010 .

[11]  Wang-Q Lim,et al.  Image Separation Using Wavelets and Shearlets , 2010, Curves and Surfaces.

[12]  Dennis M. Healy,et al.  Shearlet-Based Deconvolution , 2009, IEEE Transactions on Image Processing.

[13]  Demetrio Labate,et al.  Characterization and Analysis of Edges Using the Continuous Shearlet Transform , 2009, SIAM J. Imaging Sci..

[14]  Hamid Krim,et al.  A Shearlet Approach to Edge Analysis and Detection , 2009, IEEE Transactions on Image Processing.

[15]  Chun-Xia Zhao,et al.  Pavement Distress Detection Based on Nonsubsampled Contourlet Transform , 2008, 2008 International Conference on Computer Science and Software Engineering.

[16]  G. Easley,et al.  Sparse directional image representations using the discrete shearlet transform , 2008 .

[17]  Demetrio Labate,et al.  Representation of Fourier Integral Operators Using Shearlets , 2008 .

[18]  Mohamed-Jalal Fadili,et al.  Morphological Component Analysis: An Adaptive Thresholding Strategy , 2007, IEEE Transactions on Image Processing.

[19]  Demetrio Labate,et al.  Optimally Sparse Multidimensional Representation Using Shearlets , 2007, SIAM J. Math. Anal..

[20]  Minh N. Do,et al.  The Nonsubsampled Contourlet Transform: Theory, Design, and Applications , 2006, IEEE Transactions on Image Processing.

[21]  Peggy Subirats,et al.  Automation of Pavement Surface Crack Detection using the Continuous Wavelet Transform , 2006, 2006 International Conference on Image Processing.

[22]  Laurent Demanet,et al.  Fast Discrete Curvelet Transforms , 2006, Multiscale Model. Simul..

[23]  Wang-Q Lim,et al.  Sparse multidimensional representation using shearlets , 2005, SPIE Optics + Photonics.

[24]  I. Johnstone,et al.  Adapting to Unknown Smoothness via Wavelet Shrinkage , 1995 .

[25]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[27]  Glenn R. Easley,et al.  3D data denoising using combined sparse dictionaries , 2013 .

[28]  Mrityunjay Kumar Sparse Image and Signal Processing: Wavelets, Curvelets, Morphological Diversity, by Jean-Luc Starck, Fionn Murtagh, and Jalal M. Fadili , 2010, J. Electronic Imaging.

[29]  Michael Elad,et al.  Submitted to Ieee Transactions on Image Processing Image Decomposition via the Combination of Sparse Representations and a Variational Approach , 2022 .

[30]  Martin Vetterli,et al.  Adaptive wavelet thresholding for image denoising and compression , 2000, IEEE Trans. Image Process..