Improving High-Speed Scanning Systems by Photometric Stereo

High-speed scanning systems can be extremely valuable for Cultural Heritage applications, especially when large collections of small objects have to be acquired. However, fine details may not be acquired using this technology. Nevertheless, it is possible to try to recover them by taking advantage of the additional data provided by these systems: the calibrated video sequence of the acquisition, and the position of the projector light for each frame. In this paper, we propose a workflow that processes the video sequence with a photometric stereo approach, in order to refine the coarse geometry provided by the scanner. A normal map is first extracted by a method that accounts for the unevenly distributed sampling that generally results from the particular trajectory followed by this kind of scanners during the acquisition. This normal map is then integrated in order to recover missing geometric features. Good performances are achieved, since the whole workflow is particularly suited to GPU programming.

[1]  Szymon Rusinkiewicz,et al.  Stripe boundary codes for real-time structured-light range scanning of moving objects , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[2]  Marc Levoy,et al.  Real-time 3D model acquisition , 2002, ACM Trans. Graph..

[3]  Luc Van Gool,et al.  Fast 3D Scanning with Automatic Motion Compensation , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Diego F. Nehab,et al.  Efficiently combining positions and normals for precise 3D geometry , 2005, SIGGRAPH 2005.

[5]  Luc Van Gool,et al.  In-hand scanning with online loop closure , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[6]  Gabriel Taubin,et al.  Appying Shape from Lighting Variation to Bump Map Capture , 1997, Rendering Techniques.

[7]  Szymon Rusinkiewicz,et al.  Efficiently combining positions and normals for precise 3D geometry , 2005, ACM Trans. Graph..

[8]  Roberto Scopigno,et al.  Automatic Texturing without Illumination Artifacts from In-Hand Scanning Data Flow , 2011, MM4CH.

[9]  David J. Kriegman,et al.  Passive photometric stereo from motion , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[10]  Li Zhang,et al.  Spacetime stereo: shape recovery for dynamic scenes , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[11]  Vincent Nozick,et al.  Pyramidal Normal Map Integration for Real-time Photometric Stereo , 2010 .

[12]  Yasuyuki Matsushita,et al.  A hand-held photometric stereo camera for 3-D modeling , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[13]  Thomas Malzbender,et al.  Surface enhancement using real-time photometric stereo and reflectance transformation , 2006, EGSR '06.