Shadow and Specular Removal by Photometric Linearization based on PCA with Outlier Exclusion

The photometric linearization method converts real images, including various photometric components such as diffuse reflection, specular reflection, attached and cast shadow, into images with diffuse reflection components only, which satisfies the Lambertian law. The conventional method(Mukaigawa et al., 2007) based on a random sampling framework successfully achieves the task; however, it contains two problems. The first is that the three basis images selected from the input images by the user seriously affect the linearization result quality. The other is that it takes a long time to process the enormous number of random samples needed to find the correct answer probabilistically. We therefore propose a novel algorithm using the PCA (principal component analysis) method with outlier exclusion. We used knowledge of photometric phenomena for the outlier detection and the experiments show that the method provides fast and precise linearization results.

[1]  Steven A. Shafer,et al.  Using color to separate reflection components , 1985 .

[2]  Yasuhiro Mukaigawa,et al.  Photometric image-based rendering for image generation in arbitrary illumination , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[3]  Takeshi Shakunaga,et al.  Analysis of photometric factors based on photometric linearization. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[4]  David J. Kriegman,et al.  What is the set of images of an object under all possible lighting conditions? , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Takeo Kanade,et al.  The measurement of highlights in color images , 1988, International Journal of Computer Vision.

[6]  A. Shashua Geometry and Photometry in 3D Visual Recognition , 1992 .

[7]  Kosuke Sato,et al.  Determining Reflectance Properties of an Object Using Range and Brightness Images , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Katsushi Ikeuchi,et al.  Object shape and reflectance modeling from observation , 1997, SIGGRAPH.

[9]  Terrance E. Boult,et al.  Constraining Object Features Using a Polarization Reflectance Model , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Katsushi Ikeuchi,et al.  Temporal-color space analysis of reflection , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Shree K. Nayar,et al.  Removal of specularities using color and polarization , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[13]  David J. Kriegman,et al.  From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose , 2001, IEEE Trans. Pattern Anal. Mach. Intell..