Lighting Alignment for Image Sequences

Lighting is one of the challenges for image processing. Even though some algorithms are proposed to deal with the lighting variation for images, most of them are designed for a single image but not for image sequences. In fact, the correlation between frames can provide useful information to remove the illumination diversity, which is not available for a single image. In this paper, we proposed a 2-step lighting alignment algorithm for image sequences. Based on entropy, a perception-based lighting model is initialized according to the lighting condition of first frame. Then the difference between frames is applied to optimize the parameters of the lighting model and consequently the lighting conditions can be aligned for the sequence. At the same time, the local features of each frame can be enhanced. Experimental results show the effectiveness of the proposed algorithm.

[1]  Gang Hua,et al.  Face Re-Lighting from a Single Image under Harsh Lighting Conditions , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Xiaoyue Jiang,et al.  Perception Based Lighting Balance for Face Detection , 2006, ACCV.

[3]  Fadi Dornaika,et al.  Simultaneous Facial Action Tracking and Expression Recognition in the Presence of Head Motion , 2008, International Journal of Computer Vision.

[4]  Meng Joo Er,et al.  Illumination compensation and normalization for robust face recognition using discrete cosine transform in logarithm domain , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[5]  Xiaoyang Tan,et al.  Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions , 2007, IEEE Transactions on Image Processing.

[6]  Stan Z. Li,et al.  Generalized quotient image , 2004, CVPR 2004.

[7]  Hossein Mobahi,et al.  Toward a Practical Face Recognition System: Robust Alignment and Illumination by Sparse Representation , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Lei Zhang,et al.  Face synthesis and recognition from a single image under arbitrary unknown lighting using a spherical harmonic basis morphable model , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[9]  Zicheng Liu,et al.  Face relighting with radiance environment maps , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[10]  Ioannis A. Kakadiaris,et al.  Minimizing Illumination Differences for 3D to 2D Face Recognition Using Lighting Maps , 2014, IEEE Transactions on Cybernetics.

[11]  Yongsheng Gao,et al.  Face Recognition Using Line Edge Map , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Raghu Machiraju,et al.  A bilinear illumination model for robust face recognition , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[13]  Dorin Comaniciu,et al.  Total variation models for variable lighting face recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Amnon Shashua,et al.  The Quotient Image: Class-Based Re-Rendering and Recognition with Varying Illuminations , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Ioannis A. Kakadiaris,et al.  Illumination Normalization Using Self-lighting Ratios for 3D2D Face Recognition , 2012, ECCV Workshops.

[16]  Allen Y. Yang,et al.  Single-Sample Face Recognition with Image Corruption and Misalignment via Sparse Illumination Transfer , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Jian-Huang Lai,et al.  Normalization of Face Illumination Based on Large-and Small-Scale Features , 2011, IEEE Transactions on Image Processing.

[18]  Lei Zhang,et al.  Face recognition under variable lighting using harmonic image exemplars , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[19]  Terence Sim,et al.  The CMU Pose, Illumination, and Expression (PIE) database , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[20]  Jorge Nocedal,et al.  An interior algorithm for nonlinear optimization that combines line search and trust region steps , 2006, Math. Program..

[21]  Wen Gao,et al.  A comparative study on illumination preprocessing in face recognition , 2013, Pattern Recognit..

[22]  P. Hanrahan,et al.  On the relationship between radiance and irradiance: determining the illumination from images of a convex Lambertian object. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[23]  Ilse Ravyse,et al.  Robust Shape-Based Head Tracking , 2007, ACIVS.

[24]  Erik Reinhard,et al.  Ieee Transactions on Visualization and Computer Graphics 1 Dynamic Range Reduction Inspired by Photoreceptor Physiology , 2022 .

[25]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[26]  Ronen Basri,et al.  Lambertian Reflectance and Linear Subspaces , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Kin-Man Lam,et al.  An efficient illumination normalization method for face recognition , 2006, Pattern Recognit. Lett..