Detecting planar surface using a light-field camera with application to distinguishing real scenes from printed photos

We propose a novel approach for detecting printed photos from natural scenes using a light-field camera. Our approach exploits the extra information captured by a light-field camera and the multiple views of scene in order to infer a compact feature vector from the variance in the distribution of the depth of the scene. We then use this feature for robust detection of printed photos. Our algorithm can be used in person-based authentication applications to avoid intruding the system using a facial photo. Our experiments show that the energy of the gradients of points in the epipolar domain is highly discriminative and can be used to distinguish printed photos from original scenes.

[1]  Kiran B. Raja,et al.  A novel image fusion scheme for robust multiple face recognition with light-field camera , 2013, Proceedings of the 16th International Conference on Information Fusion.

[2]  Jun Zhao,et al.  Detection of non-flat ground surfaces using V-Disparity images , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Yael Pritch,et al.  Scene reconstruction from high spatio-angular resolution light fields , 2013, ACM Trans. Graph..

[4]  Xavier Maldague,et al.  Vesselness Features and the Inverse Compositional AAM for Robust Face Recognition Using Thermal IR , 2013, AAAI.

[5]  Gordon Wetzstein,et al.  Compressive light field photography using overcomplete dictionaries and optimized projections , 2013, ACM Trans. Graph..

[6]  Zhan Yu,et al.  Lytro camera technology: theory, algorithms, performance analysis , 2013, Electronic Imaging.

[7]  Robert C. Bolles,et al.  Epipolar-plane image analysis: An approach to determining structure from motion , 1987, International Journal of Computer Vision.

[8]  Hamid R. Rabiee,et al.  A Bayesian Approach to the Data Description Problem , 2012, AAAI.

[9]  Burcu Akinci,et al.  Characterization of three algorithms for detecting surface flatness defects from dense point clouds , 2009, Electronic Imaging.

[10]  Pier Luigi Dragotti,et al.  Segmentation of Epipolar-Plane Image Volumes with Occlusion and Disocclusion Competition , 2006, 2006 IEEE Workshop on Multimedia Signal Processing.

[11]  Minh N. Do,et al.  Ieee Transactions on Image Processing on the Bandwidth of the Plenoptic Function , 2022 .

[12]  J. Berent,et al.  Plenoptic Manifolds , 2007, IEEE Signal Processing Magazine.

[13]  Tom E. Bishop,et al.  The Light Field Camera: Extended Depth of Field, Aliasing, and Superresolution , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Martin Vetterli,et al.  Scale-invariant representation of light field images for object recognition and tracking , 2013, Electronic Imaging.

[15]  Motaz El-Saban,et al.  Face authentication using graph-based low-rank representation of facial local structures for mobile vision applications , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[16]  Jae-Seung Kim,et al.  Flat-Region Detection and False Contour Removal in the Digital TV Display , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[17]  Shree K. Nayar,et al.  PiCam , 2013, ACM Trans. Graph..

[18]  Edward H. Adelson,et al.  Single Lens Stereo with a Plenoptic Camera , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Ajmal S. Mian,et al.  Using Kinect for face recognition under varying poses, expressions, illumination and disguise , 2013, 2013 IEEE Workshop on Applications of Computer Vision (WACV).

[20]  Sven Wanner,et al.  Globally Consistent Multi-label Assignment on the Ray Space of 4D Light Fields , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Hamid R. Rabiee,et al.  Active Learning from Positive and Unlabeled Data , 2011, 2011 IEEE 11th International Conference on Data Mining Workshops.

[22]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[23]  Ivana Tosic,et al.  Dictionary Learning for Incoherent Sampling with application to plenoptic imaging , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[24]  Ramesh Raskar,et al.  Near-invariant blur for depth and 2D motion via time-varying light field analysis , 2013, TOGS.

[25]  Luke S. Zettlemoyer,et al.  3D Wikipedia , 2013, ACM Trans. Graph..