Shape from Fluorescence

Beyond day glow highlighters and psychedelic black light posters, it has been estimated that fluorescence is a property exhibited by 20% of objects. When a fluorescent material is illuminated with a short wavelength light, it re-emits light at a longer wavelength isotropically in a similar manner as a Lambertian surface reflects light. This hitherto neglected property opens the doors to using fluorescence to reconstruct 3D shape with some of the same techniques as for Lambertian surfaces – even when the surface's reflectance is highly non-Lambertian. Thus, performing reconstruction using fluorescence has advantages over purely Lambertian surfaces. Single image shape-from-shading and calibrated Lambertian photometric stereo can be applied to fluorescence images to reveal 3D shape. When performing uncalibrated photometric stereo, both fluorescence and reflectance can be used to recover Euclidean shape and resolve the generalized bas relief ambiguity. Finally for objects that fluoresce in wavelengths distinct from their reflectance (such as plants and vegetables), reconstructions do not suffer from problems due to inter-reflections. We validate these claims through experiments.

[1]  David J. Kriegman,et al.  Resolving the Generalized Bas-Relief Ambiguity by Entropy Minimization , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Imari Sato,et al.  Separating reflective and fluorescent components of an image , 2011, CVPR 2011.

[3]  Steven M. Seitz,et al.  Shape and Spatially-Varying BRDFs from Photometric Stereo , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Richard Szeliski,et al.  Computer Vision - Algorithms and Applications , 2011, Texts in Computer Science.

[5]  M P Lee,et al.  Angular distribution of fluorescence from small particles. , 1978, Applied optics.

[6]  Katsushi Ikeuchi,et al.  Temporal-color space analysis of reflection , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Berthold K. P. Horn,et al.  Determining Shape and Reflectance Using Multiple Images , 1978 .

[8]  David J. Kriegman,et al.  Isotropy, Reciprocity and the Generalized Bas-Relief Ambiguity , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Kobus Barnard Color Constancy with Fluorescent Surfaces , 1999, Color Imaging Conference.

[10]  Rama Chellappa,et al.  A Method for Enforcing Integrability in Shape from Shading Algorithms , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Shree K. Nayar,et al.  Separation of Reflection Components Using Color and Polarization , 1997, International Journal of Computer Vision.

[12]  Takeo Kanade,et al.  Shape from interreflections , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[13]  Rui J. P. de Figueiredo,et al.  A Theory of Photometric Stereo for a Class of Diffuse Non-Lambertian Surfaces , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Ramesh Raskar,et al.  Fast separation of direct and global components of a scene using high frequency illumination , 2006, ACM Trans. Graph..

[15]  Mike J. Chantler,et al.  Can two specular pixels calibrate photometric stereo? , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[16]  Takahiro Okabe,et al.  Bispectral photometric stereo based on fluorescence , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Mubarak Shah,et al.  Shape from shading using linear approximation , 1994, Image Vis. Comput..

[18]  Jean-Denis Durou,et al.  Numerical methods for shape-from-shading: A new survey with benchmarks , 2008, Comput. Vis. Image Underst..

[19]  Werner Purgathofer,et al.  A reflectance model for diffuse fluorescent surfaces , 2006, GRAPHITE '06.

[20]  Berthold K. P. Horn Robot vision , 1986, MIT electrical engineering and computer science series.

[21]  Shree K. Nayar,et al.  Generalization of the Lambertian model and implications for machine vision , 1995, International Journal of Computer Vision.

[22]  D. Collins,et al.  The role of reabsorption in the spectral distribution of phytoplankton fluorescence emission , 1985 .

[23]  Robert L. Cook,et al.  A Reflectance Model for Computer Graphics , 1987, TOGS.

[24]  Andrew S. Glassner,et al.  Principles of Digital Image Synthesis , 1995 .

[25]  Peter Shirley,et al.  An Anisotropic Phong BRDF Model , 2000, J. Graphics, GPU, & Game Tools.

[26]  Kenneth J. Voss,et al.  Angular distribution of fluorescence from phytoplankton , 1993 .

[27]  Marcus A. Magnor,et al.  Reconstructing the geometry of flowing water , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[28]  Bui Tuong Phong Illumination for computer generated pictures , 1975, Commun. ACM.

[29]  Hideki Hayakawa Photometric stereo under a light source with arbitrary motion , 1994 .

[30]  H. Seidel,et al.  Fluorescent immersion range scanning , 2008, ACM Trans. Graph..

[31]  Yoav Y. Schechner,et al.  Multiplexed fluorescence unmixing , 2010, 2010 IEEE International Conference on Computational Photography (ICCP).

[32]  Aly A. Farag,et al.  Shape from Shading for Hybrid Surfaces , 2007, 2007 IEEE International Conference on Image Processing.

[33]  David J. Kriegman,et al.  The Bas-Relief Ambiguity , 2004, International Journal of Computer Vision.

[34]  Ping-Sing Tsai,et al.  Shape from Shading: A Survey , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Aly A. Farag,et al.  A New Formulation for Shape from Shading for Non-Lambertian Surfaces , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[36]  David A. Forsyth,et al.  Mutual illumination , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[37]  David J. Kriegman,et al.  Reflections on the generalized bas-relief ambiguity , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[38]  Hans-Peter Seidel,et al.  Acquisition and analysis of bispectral bidirectional reflectance and reradiation distribution functions , 2010, SIGGRAPH 2010.

[39]  David J. Kriegman,et al.  Color Subspaces as Photometric Invariants , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[40]  Robert J. Woodham,et al.  Photometric method for determining surface orientation from multiple images , 1980 .

[41]  Daniel Snow,et al.  Shape and albedo from multiple images using integrability , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.