Multispectral Image Intrinsic Decomposition via Low Rank Constraint

Multispectral images contain many clues of surface characteristics of the objects, thus can be widely used in many computer vision tasks, e.g., recolorization and segmentation. However, due to the complex illumination and the geometry structure of natural scenes, the spectra curves of a same surface can look very different. In this paper, a Low Rank Multispectral Image Intrinsic Decomposition model (LRIID) is presented to decompose the shading and reflectance from a single multispectral image. We extend the Retinex model, which is proposed for RGB image intrinsic decomposition, for multispectral domain. Based on this, a low rank constraint is proposed to reduce the ill-posedness of the problem and make the algorithm solvable. A dataset of 12 images is given with the ground truth of shadings and reflectance, so that the objective evaluations can be conducted. The experiments demonstrate the effectiveness of proposed method.

[1]  L. Maloney.  Evaluation of linear models of surface spectral reflectance with small numbers of parameters. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[2]  Yizhou Yu,et al.  Title An L 1 image transform for edge-preserving smoothing andscene-level intrinsic decomposition , 2015 .

[3]  Allen R. Hanson,et al.  Computer Vision Systems , 1978 .

[4]  W. Freeman,et al.  Learning local evidence for shading and reflectance , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[5]  Stephen Lin,et al.  Intrinsic image decomposition with non-local texture cues , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Katsushi Ikeuchi,et al.  Separating Illumination and Surface Spectral from Multiple Color Signals , 2008 .

[7]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[8]  Mark S. Drew,et al.  Recovering Shading from Color Images , 1992, ECCV.

[9]  Mark S. Drew,et al.  Separating a Color Signal into Illumination and Surface Reflectance Components: Theory and Applications , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Shree K. Nayar,et al.  Generalized Assorted Pixel Camera: Postcapture Control of Resolution, Dynamic Range, and Spectrum , 2010, IEEE Transactions on Image Processing.

[11]  Stephen Lin,et al.  A Closed-Form Solution to Retinex with Nonlocal Texture Constraints , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Cong Phuoc Huynh,et al.  A Solution of the Dichromatic Model for Multispectral Photometric Invariance , 2010, International Journal of Computer Vision.

[13]  Andrew W. Fitzgibbon,et al.  KinectFusion: Real-time dense surface mapping and tracking , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[14]  Vladlen Koltun,et al.  A Simple Model for Intrinsic Image Decomposition with Depth Cues , 2013, 2013 IEEE International Conference on Computer Vision.

[15]  Alexei A. Efros,et al.  Learning Data-Driven Reflectance Priors for Intrinsic Image Decomposition , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[16]  Cheng Lu,et al.  Intrinsic Images by Entropy Minimization , 2004, ECCV.

[17]  Jitendra Malik,et al.  Intrinsic Scene Properties from a Single RGB-D Image , 2013, CVPR.

[18]  Edward H. Adelson,et al.  Ground truth dataset and baseline evaluations for intrinsic image algorithms , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[19]  Xiaoyue Jiang,et al.  Correlation-Based Intrinsic Image Extraction from a Single Image , 2010, ECCV.

[20]  Xi Chen,et al.  Intrinsic decomposition from a single spectral image. , 2017, Applied optics.

[21]  Chuohao Yeo,et al.  Intrinsic Image Decomposition Using a Sparse Representation of Reflectance , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Michael Elad,et al.  A Variational Framework for Retinex , 2002, IS&T/SPIE Electronic Imaging.

[23]  Stephen Lin,et al.  Estimation of Intrinsic Image Sequences from Image+Depth Video , 2012, ECCV.

[24]  Ayan Chakrabarti,et al.  Statistics of real-world hyperspectral images , 2011, CVPR 2011.

[25]  Edward H. Adelson,et al.  Recovering intrinsic images from a single image , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Moni Naor,et al.  Computer Vision Systems , 2017, Lecture Notes in Computer Science.

[27]  Yair Weiss,et al.  Deriving intrinsic images from image sequences , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[28]  Keyvan Navi,et al.  Intrinsic Image Decomposition via Structure-Preserving Image Smoothing and Material Recognition , 2016, PloS one.

[29]  Noah Snavely,et al.  Intrinsic images in the wild , 2014, ACM Trans. Graph..

[30]  Henry Arguello,et al.  Compressive Coded Aperture Spectral Imaging: An Introduction , 2014, IEEE Signal Processing Magazine.

[31]  J. Parkkinen,et al.  Characteristic spectra of Munsell colors , 1989 .

[32]  Jon Atli Benediktsson,et al.  Intrinsic Image Decomposition for Feature Extraction of Hyperspectral Images , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Edward H. Adelson,et al.  Estimating Intrinsic Component Images using Non-Linear Regression , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[34]  Jitendra Malik,et al.  Shape, Illumination, and Reflectance from Shading , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Yoichi Sato,et al.  Illumination and reflectance spectra separation of a hyperspectral image meets low-rank matrix factorization , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Adrien Bousseau,et al.  Rich Intrinsic Image Decomposition of Outdoor Scenes from Multiple Views , 2013, IEEE Trans. Vis. Comput. Graph..