Watermarking structured light patterns for one-shot, extendable 3D scanning

We present a pattern watermarking framework for system that captures the 3D shape of face, in order to support face dependent applications e.g. face identification. As the face may move during the 3D capture, it is important that the shape is retrieved within as short a time as possible e.g. stereo, one-shot structured light. On the other hand, the face needs to be captured from multiple sides. In order to get a fast, full-face capture without compromised resolution on profile sides. We have devised a method to let multiple projectors and cameras work simultaneously. A projected pattern in combination with a camera allows for a structured light approach. This is beneficial, given the weakly textured surfaces we are dealing with. Yet, where projection patterns overlap, our system automatically changes over to a multi-view approach. In order to let the system automatically detect whether a single projection vs. an overlap is observed, we watermark the different projection patterns while preserving enough textures for correspondence match. In our system, two projectors and two cameras are deployed. Each camera-project pair consists a one-shot structured light set and the two cameras consist a multiview stereo. Our method is fully compatible with now-a-days tensor computation platforms, which provides simplicity for research and development as well as easy-extendability for industrial application and running-time performance optimization. This paper presents watermarking patterns and corresponding detection methods, in tensor computation.

[1]  Xuan-Li Chen,et al.  Fully in Tensor Computation Manner: A One-Shot Dense 3D Acquisition Method using Structured Light , 2019, 2019 2nd China Symposium on Cognitive Computing and Hybrid Intelligence (CCHI).

[2]  Gabriel Taubin,et al.  One-shot scanning using De Bruijn spaced grids , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[3]  Yasushi Yagi,et al.  Dynamic scene shape reconstruction using a single structured light pattern , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Ryo Furukawa,et al.  Learning-based feature extraction for active 3D scan with reducing color crosstalk of multiple pattern projections , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[5]  Maarten Vergauwen,et al.  3D Reconstruction from Multiple Images: Part 1 - Principles , 2009, Found. Trends Comput. Graph. Vis..

[6]  Rainer Stiefelhagen,et al.  Kinect Unleashed: Getting Control over High Resolution Depth Maps , 2013, MVA.

[7]  Joaquim Salvi,et al.  A state of the art in structured light patterns for surface profilometry , 2010, Pattern Recognit..

[8]  Sergio Orts,et al.  HyperDepth: Learning Depth from Structured Light without Matching , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Thierry Pun,et al.  Rotation, scale and translation invariant spread spectrum digital image watermarking , 1998, Signal Process..

[10]  Ahmed H. Tewfik,et al.  Geometric Invariance in image watermarking , 2004, IEEE Transactions on Image Processing.

[11]  Ryo Furukawa,et al.  Dense 3D Reconstruction from High Frame-Rate Video Using a Static Grid Pattern , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Abdulmotaleb El-Saddik,et al.  RST-invariant digital image watermarking based on log-polar mapping and phase correlation , 2003, IEEE Trans. Circuits Syst. Video Technol..

[13]  Nozomu Kasuya,et al.  One-Shot Entire Shape Scanning by Utilizing Multiple Projector-Camera Constraints of Grid Patterns , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[14]  Yasushi Yagi,et al.  One-shot Entire Shape Acquisition Method Using Multiple Projectors and Cameras , 2010, 2010 Fourth Pacific-Rim Symposium on Image and Video Technology.

[15]  Peter F. Sturm,et al.  Efficient Separation Between Projected Patterns for Multiple Projector 3D People Scanning , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[16]  Joan L. Mitchell,et al.  JPEG: Still Image Data Compression Standard , 1992 .

[17]  Benoit M. Macq,et al.  Geometrically invariant watermarking using feature points , 2002, IEEE Trans. Image Process..

[18]  Nicolas Martin,et al.  Unstructured light scanning to overcome interreflections , 2011, 2011 International Conference on Computer Vision.

[19]  Fabien A. P. Petitcolas,et al.  Watermarking schemes evaluation , 2000, IEEE Signal Process. Mag..

[20]  Yaser Sheikh,et al.  Texture Illumination Separation for Single-Shot Structured Light Reconstruction , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[22]  Ingemar J. Cox,et al.  Secure spread spectrum watermarking for multimedia , 1997, IEEE Trans. Image Process..

[23]  Jason Geng,et al.  Structured-light 3D surface imaging: a tutorial , 2011 .

[24]  Ramesh Raskar,et al.  Fast separation of direct and global components of a scene using high frequency illumination , 2006, ACM Trans. Graph..

[25]  Shree K. Nayar,et al.  Micro Phase Shifting , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.