Omnidirectional catadioptric image unwrapping via total variation regularization

A catadioptric sensor is composed of a hyperbolic mirror coupled with a camera. The registered images with such sensor have a field of view of 360 degrees; this property is very useful in robotics since it increases a robot's performance for navigation and localization. However, due to the significant distortions on the omnidirectional image, classical image processing can not be directly applied onto the image. The standard techniques to unwrap catadioptric images involve a projection step follow by an interpolation step. In this paper we propose to unwrap omnidirectional images via Total Variation (TV) regularization by casting the geometric projection as the forward operator. This has two advantages: if the acquired images are noisy (due to dust onto the mirror or wireless transmission errors), the noise can be effectively remove while the unwrapping step is performed; moreover if the mirror or camera's lenses have any type of aberrations they could be included as part of the forward operator and then compare the standard unwrapping method with our proposed (TV based) method and show the superior reconstruction quality of the proposed method when the acquired images are corrupted with salt-and-pepper noise.

[1]  Brendt Wohlberg,et al.  Efficient Minimization Method for a Generalized Total Variation Functional , 2009, IEEE Transactions on Image Processing.

[2]  Jian-Feng Cai,et al.  Two-phase approach for deblurring images corrupted by impulse plus gaussian noise , 2008 .

[3]  José Santos-Victor,et al.  Vision-based navigation and environmental representations with an omnidirectional camera , 2000, IEEE Trans. Robotics Autom..

[4]  F. Comby,et al.  05 - Opérations morphologiques floues à noyaux variables pour images omnidirectionnelles à point de vue unique , 2005 .

[5]  Tony F. Chan,et al.  Total variation blind deconvolution , 1998, IEEE Trans. Image Process..

[6]  Jian Yu,et al.  Restoration of images corrupted by mixed Gaussian-impulse noise via l1-l0 minimization , 2011, Pattern Recognit..

[7]  P. Rodríguez.  Total variation regularization for Poisson vector-valued image restoration with a spatially adaptive regularization parameter selection , 2011, 2011 7th International Symposium on Image and Signal Processing and Analysis (ISPA).

[8]  Andy M. Yip,et al.  Recent Developments in Total Variation Image Restoration , 2004 .

[9]  Isabel C. Rodrigues,et al.  Convex Total Variation Denoising of Poisson Fluorescence Confocal Images With Anisotropic Filtering , 2011, IEEE Transactions on Image Processing.

[10]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[11]  Mila Nikolova,et al.  Minimizers of Cost-Functions Involving Nonsmooth Data-Fidelity Terms. Application to the Processing of Outliers , 2002, SIAM J. Numer. Anal..

[12]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Jian-Feng Cai,et al.  Two-Phase Methods for Deblurring Images Corrupted by Impulse Plus Gaussian Noise ∗ , 2006 .

[14]  Raymond H. Chan,et al.  Salt-and-pepper noise removal by median-type noise detectors and detail-preserving regularization , 2005, IEEE Transactions on Image Processing.

[15]  M. Nikolova.  A Variational Approach to Remove Outliers and Impulse Noise , 2004 .

[16]  Tony F. Chan,et al.  Mathematical Models for Local Nontexture Inpaintings , 2002, SIAM J. Appl. Math..

[17]  D. Ebenezer,et al.  An efficient non-linear cascade filtering algorithm for removal of high density salt and pepper noise in image and video sequence , 2009, 2009 International Conference on Control, Automation, Communication and Energy Conservation.

[18]  Paul Rodríguez.  A non-negative quadratic programming approach to minimize the generalized vector-valued total variation functional , 2010, 2010 18th European Signal Processing Conference.

[19]  Shree K. Nayar,et al.  Catadioptric omnidirectional camera , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.