Shadows and highlights detection in 4-source colour photometric stereo

The photometric stereo technique (PS) has been used for shape recovery for quite some time now. Using a modification of the method, we can recover local surface normals and surface colour from multiple images for surfaces with unspecified reflectance function. However, for adequate recovery one should be able to detect and appropriately deal with shadows and highlights in the input images. We propose here a methodology that allows us to do that.

[1]  Rui J. P. de Figueiredo,et al.  A Theory of Photometric Stereo for a Class of Diffuse Non-Lambertian Surfaces , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Terry Caelli,et al.  Estimating the Parameters of an Illumination Model Using Photometric Stereo , 1995, CVGIP Graph. Model. Image Process..

[3]  M. Chantler Why illuminant direction is fundamental to texture analysis , 2022 .

[4]  Maria Petrou,et al.  Colour photometric stereo: simultaneous reconstruction of local gradient and colour of rough textured surfaces , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[5]  Karsten Schlüns,et al.  Photometric Stereo for Non-Lambertian Surfaces Using Color Information , 1993, CAIP.

[6]  Katsushi Ikeuchi,et al.  Extracting the Shape and Roughness of Specular Lobe Objects Using Four Light Photometric Stereo , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  E. North Coleman,et al.  Obtaining 3-dimensional shape of textured and specular surfaces using four-source photometry , 1982, Comput. Graph. Image Process..

[8]  R. Woodham Gradient and curvature from the photometric-stereo method, including local confidence estimation , 1994 .

[9]  Takeo Kanade,et al.  Determining shape and reflectance of hybrid surfaces by photometric sampling , 1989, IEEE Trans. Robotics Autom..

[10]  Katsushi Ikeuchi,et al.  Determining Surface Orientations of Specular Surfaces by Using the Photometric Stereo Method , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  M. Chantler,et al.  Rotation invariant classification of rough surfaces , 1999 .

[12]  Melvyn L. Smith,et al.  Surface texture analysis based upon the visually acquired perturbation of surface normals , 1997, Image Vis. Comput..