Online Subspace Learning from Gradient Orientations for Robust Image Alignment

Robust and efficient image alignment remains a challenging task, due to the massiveness of images, great illumination variations between images, partial occlusion, and corruption. To address these challenges, we propose an online image alignment method via subspace learning from image gradient orientations (IGOs). The proposed method integrates the subspace learning, transformed the IGO reconstruction and image alignment into a unified online framework, which is robust for aligning images with severe intensity distortions. Our method is motivated by a principal component analysis (PCA) from gradient orientations that provides more reliable low-dimensional subspace than that from pixel intensities. Instead of processing in the intensity-domain-like conventional methods, we seek alignment in the IGO domain, such that the aligned IGO of the newly arrived image can be decomposed as the sum of a sparse error and a linear composition of the IGO-PCA basis learned from previously well-aligned ones. The optimization problem is tackled by an iterative linearization that minimizes the $\ell _{1}$ -norm of the sparse error. Furthermore, the IGO-PCA basis is adaptively updated based on incremental thin singular value decomposition, which takes the shift of IGO mean into consideration. The efficacy of the proposed method is validated on the extensive challenging datasets through image alignment, medical atlas construction, and face recognition. The experimental results demonstrate that our algorithm provides more illumination- and occlusion-robust image alignment than the state-of-the-art methods.

[1]  Chun Chen,et al.  Image Alignment by Online Robust PCA via Stochastic Gradient Descent , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Hossein Mobahi,et al.  Toward a Practical Face Recognition System: Robust Alignment and Illumination by Sparse Representation , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Ming-Hsuan Yang,et al.  Incremental Learning for Robust Visual Tracking , 2008, International Journal of Computer Vision.

[4]  Stefanos Zafeiriou,et al.  The First Facial Landmark Tracking in-the-Wild Challenge: Benchmark and Results , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).

[5]  Bin Shen,et al.  Online robust image alignment via iterative convex optimization , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Erik G. Learned-Miller,et al.  Data driven image models through continuous joint alignment , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Stefanos Zafeiriou,et al.  Subspace Learning from Image Gradient Orientations , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Pheng-Ann Heng,et al.  Online Robust Image Alignment via Subspace Learning from Gradient Orientations , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[9]  In-So Kweon,et al.  Partial Sum Minimization of Singular Values in RPCA for Low-Level Vision , 2013, 2013 IEEE International Conference on Computer Vision.

[10]  Zhang Li,et al.  Image Registration Based on Autocorrelation of Local Structure , 2016, IEEE Transactions on Medical Imaging.

[11]  Josef Kittler,et al.  Class-Specific Kernel Fusion of Multiple Descriptors for Face Verification Using Multiscale Binarised Statistical Image Features , 2014, IEEE Transactions on Information Forensics and Security.

[12]  Antonio Torralba,et al.  SIFT Flow: Dense Correspondence across Scenes and Its Applications , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[14]  Tao Tao,et al.  Iterative online subspace learning for robust image alignment , 2013, 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[15]  Erik G. Learned-Miller,et al.  Unsupervised Joint Alignment of Complex Images , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[16]  P. Switzer,et al.  A transformation for ordering multispectral data in terms of image quality with implications for noise removal , 1988 .

[17]  Stefanos Zafeiriou,et al.  From Pixels to Response Maps: Discriminative Image Filtering for Face Alignment in the Wild , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  D. Louis Collins,et al.  Multi-Modal Image Registration Based on Gradient Orientations of Minimal Uncertainty , 2012, IEEE Transactions on Medical Imaging.

[19]  Yueting Zhuang,et al.  Online Metric-Weighted Linear Representations for Robust Visual Tracking , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Gang Hua,et al.  Labeled Faces in the Wild: A Survey , 2016 .

[21]  Harry Shum,et al.  Full-frame video stabilization with motion inpainting , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Ming Xu,et al.  Towards Personalized Statistical Deformable Model and Hybrid Point Matching for Robust MR-TRUS Registration , 2016, IEEE Transactions on Medical Imaging.

[23]  Nikos Paragios,et al.  Deformable Medical Image Registration: A Survey , 2013, IEEE Transactions on Medical Imaging.

[24]  David J. Kriegman,et al.  From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Yu Yang,et al.  PIEFA: Personalized Incremental and Ensemble Face Alignment , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[26]  Yan Ke,et al.  PCA-SIFT: a more distinctive representation for local image descriptors , 2004, CVPR 2004.

[27]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Yi Wang,et al.  Online Robust Projective Dictionary Learning: Shape Modeling for MR-TRUS Registration , 2018, IEEE Transactions on Medical Imaging.

[29]  Fei Yang,et al.  Deep sparse representation for robust image registration , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Loong Fah Cheong,et al.  Block-Sparse RPCA for Salient Motion Detection , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Sebastiano Battiato,et al.  A Robust Image Alignment Algorithm for Video Stabilization Purposes , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[32]  Jonathan Eckstein Augmented Lagrangian and Alternating Direction Methods for Convex Optimization: A Tutorial and Some Illustrative Computational Results , 2012 .

[33]  John Wright,et al.  RASL: Robust Alignment by Sparse and Low-Rank Decomposition for Linearly Correlated Images , 2012, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Narendra Ahuja,et al.  Robust Visual Tracking Via Consistent Low-Rank Sparse Learning , 2014, International Journal of Computer Vision.

[35]  Stephen P. Boyd,et al.  Proximal Algorithms , 2013, Found. Trends Optim..