Active Recurrence of Lighting Condition for Fine-Grained Change Detection

This paper addresses active lighting recurrence (ALR), a new problem that actively relocalizes a light source to physically reproduce the lighting condition for a same scene from single reference image. ALR is of great importance for fine-grained visual monitoring and change detection, because some phenomena or minute changes can only be clearly observed under particular lighting conditions. Hence, effective ALR should be able to online navigate a light source toward the target pose, which is challenging due to the complexity and diversity of real-world lighting & imaging processes. We propose to use the simple parallel lighting as an analogy model and based on Lambertian law to compose an instant navigation ball for this purpose. We theoretically prove the feasibility of this ALR strategy for realistic near point light sources and its invariance to the ambiguity of normal & lighting decomposition. Extensive quantitative experiments and challenging real-world tasks on fine-grained change monitoring of cultural heritages verify the effectiveness of our approach. We also validate its generality to non-Lambertian scenes.

[1]  Björn Stenger,et al.  Precise deterministic change detection for smooth surfaces , 2016, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[2]  Minh N. Do,et al.  Inverse Rendering and Relighting From Multiple Color Plus Depth Images , 2017, IEEE Transactions on Image Processing.

[3]  Jizhou Sun,et al.  6D Dynamic Camera Relocalization from Single Reference Image , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Wei Feng,et al.  Active Camera Relocalization with RGBD Camera from a Single 2D Image , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[5]  Stephen Lin,et al.  Global illumination with radiance regression functions , 2013, ACM Trans. Graph..

[6]  Stephen Lin,et al.  A Closed-form Solution to Retinex with Non-local Texture Constraints , 2012 .

[7]  Mohammed Bennamoun,et al.  Learning deep structured network for weakly supervised change detection , 2016, IJCAI.

[8]  Ian D. Reid,et al.  Automatic Relocalization and Loop Closing for Real-Time Monocular SLAM , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Aly A. Farag,et al.  Towards accurate and efficient representation of image irradiance of convex-Lambertian objects under unknown near lighting , 2011, 2011 International Conference on Computer Vision.

[10]  Thomas Malzbender,et al.  Polynomial texture maps , 2001, SIGGRAPH.

[11]  Jizhou Sun,et al.  Learning to Detect Fine-Grained Change Under Variant Imaging Conditions , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[12]  Wei Feng,et al.  SPHORB: A Fast and Robust Binary Feature on the Sphere , 2014, International Journal of Computer Vision.

[13]  Jayant Kalagnanam,et al.  Change Detection Using Directional Statistics , 2016, IJCAI.

[14]  Peiran REN,et al.  Image based relighting using neural networks , 2015, ACM Trans. Graph..

[15]  孙济洲 Fine-Grained Change Detection of Misaligned Scenes with Varied Illuminations , 2015 .

[16]  Paolo Favaro,et al.  A closed-form solution to uncalibrated photometric stereo via diffuse maxima , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[18]  Wei Feng,et al.  Fast and Reliable Computational Rephotography on Mobile Device , 2018, 2018 IEEE International Conference on Multimedia and Expo (ICME).

[19]  Ronen Basri,et al.  From Shading to Local Shape , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Paul E. Debevec,et al.  Acquiring the reflectance field of a human face , 2000, SIGGRAPH.

[21]  Zhe Wu,et al.  A Benchmark Dataset and Evaluation for Non-Lambertian and Uncalibrated Photometric Stereo , 2019, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Yoichi Sato,et al.  Uncalibrated photometric stereo based on elevation angle recovery from BRDF symmetry of isotropic materials , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Zhi-Qiang Liu,et al.  Self-Validated Labeling of Markov Random Fields for Image Segmentation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Fabio Pellacini,et al.  LightSlice: matrix slice sampling for the many-lights problem , 2011, ACM Trans. Graph..

[25]  Gregory H. Bearman,et al.  Near light correction for image relighting and 3D shape recovery , 2015, 2015 Digital Heritage.

[26]  Kiyoharu Aizawa,et al.  Uncalibrated Photometric Stereo by Stepwise Optimization Using Principal Components of Isotropic BRDFs , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).