Generalized mosaicing: polarization panorama

We present an approach to image the polarization state of object points in a wide field of view, while enhancing the radiometric dynamic range of imaging systems by generalizing image mosaicing. The approach is biologically inspired, as it emulates spatially varying polarization sensitivity of some animals. In our method, a spatially varying polarization and attenuation filter is rigidly attached to a camera. As the system moves, it senses each scene point multiple times, each time filtering it through a different filter polarizing angle, polarizance, and transmittance. Polarization is an additional dimension of the generalized mosaicing paradigm, which has recently yielded high dynamic range images and multispectral images in a wide field of view using other kinds of filters. The image acquisition is as easy as in traditional image mosaics. The computational algorithm can easily handle nonideal polarization filters (partial polarizers), variable exposures, and saturation in a single framework. The resulting mosaic represents the polarization state at each scene point. Using data acquired by this method, we demonstrate attenuation and enhancement of specular reflections and semi reflection separation in an image mosaic.

[1]  Frank M. Candocia.  Simultaneous homographic and comparametric alignment of multiple exposure-adjusted pictures of the same scene , 2003, IEEE Trans. Image Process..

[2]  D. Stork,et al.  Polarized light in nature , 1985 .

[3]  Shree K. Nayar,et al.  Separation of Reflection Components Using Color and Polarization , 1997, International Journal of Computer Vision.

[4]  P. Anandan,et al.  Robust multi-sensor image alignment , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[5]  Seth J. Teller,et al.  Spherical Mosaics with Quaternions and Dense Correlation , 2000, International Journal of Computer Vision.

[6]  Andrew Zisserman,et al.  Automated mosaicing with super-resolution zoom , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[7]  Henri Nicolas.  New methods for dynamic mosaicking , 2001, IEEE Trans. Image Process..

[8]  Allan Kardec Barros,et al.  Separating virtual and real objects using Independent Component Analysis , 2000 .

[9]  Shree K. Nayar,et al.  Instant dehazing of images using polarization , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[10]  J. S. Taylor,et al.  Partial polarization signature results from the field testing of the SHallow water Real-time IMaging polarimeter (SHRIMP) , 2001, MTS/IEEE Oceans 2001. An Ocean Odyssey. Conference Proceedings (IEEE Cat. No.01CH37295).

[11]  Yael Pritch,et al.  Omnistereo: Panoramic Stereo Imaging , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Sleve Mann,et al.  'Pencigraphy' with AGC: joint parameter estimation in both domain and range of functions in same orbit of the projective-Wyckoff group , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[13]  Harpreet S. Sawhney,et al.  VideoBrush/sup TM/: experiences with consumer video mosaicing , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[14]  Shree K. Nayar,et al.  Generalized Mosaicing: Wide Field of View Multispectral Imaging , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[16]  J S Tyo,et al.  Target detection in optically scattering media by polarization-difference imaging. , 1996, Applied optics.

[17]  S. Negahdaripour,et al.  3-D motion and depth estimation from sea-floor images for mosaic-based station-keeping and navigation of ROVs/AUVs and high-resolution sea-floor mapping , 1998, Proceedings of the 1998 Workshop on Autonomous Underwater Vehicles (Cat. No.98CH36290).

[18]  T W Cronin,et al.  Parallel Processing and Image Analysis in the Eyes of Mantis Shrimps , 2001, The Biological Bulletin.

[19]  J Shamir,et al.  Polarization and statistical analysis of scenes containing a semireflector. , 2000, Journal of the Optical Society of America. A, Optics, image science, and vision.

[20]  Lawrence B. Wolff,et al.  Polarization vision: a new sensory approach to image understanding , 1997, Image Vis. Comput..

[21]  J. Usón,et al.  The Central Galaxy in Abell 2029: An Old Supergiant , 1990, Science.

[22]  Aljoscha Smolic,et al.  High-resolution video mosaicing , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[23]  P. Anandan,et al.  Efficient representations of video sequences and their applications , 1996, Signal Process. Image Commun..

[24]  Narendra Ahuja,et al.  High Dynamic Range Panoramic Imaging , 2001, ICCV.

[25]  Richard Szeliski,et al.  Image mosaicing for tele-reality applications , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[26]  A. Vasavada,et al.  Galileo Imaging of Jupiter's Atmosphere: The Great Red Spot, Equatorial Region, and White Ovals , 1998 .

[27]  Frank M. Candocia.  Jointly registering images in domain and range by piecewise linear comparametric analysis , 2003, IEEE Trans. Image Process..

[28]  R. Alfano,et al.  Optical polarization imaging. , 1997, Applied optics.

[29]  Stefan Rahmann,et al.  Reconstruction of specular surfaces using polarization imaging , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[30]  K. Ikeuchi,et al.  Measurement of surface orientations of transparent objects by use of polarization in highlight , 1999 .

[31]  H. Singh,et al.  UWIT: underwater image toolbox for optical image processing and mosaicking in MATLAB , 2002, Proceedings of the 2002 Interntional Symposium on Underwater Technology (Cat. No.02EX556).

[32]  Harpreet S. Sawhney,et al.  Automated Mosaics via Topology Inference , 2002, IEEE Computer Graphics and Applications.

[33]  Lawrence B. Wolff,et al.  Portable imaging polarimeters , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[34]  Shree K. Nayar,et al.  Generalized Mosaicing : High Dynamic Range in a Wide Field of View 247 , 2001 .

[35]  L. B. Wolff.  Polarization camera for computer vision with a beam splitter , 1994 .

[36]  Boris Kaminsky,et al.  AOTF polarization difference imaging , 1999, Other Conferences.

[37]  Andrew M. Wallace,et al.  Improving Depth Image Acquisition Using Polarized Light , 1999, International Journal of Computer Vision.

[38]  Yoav Y. Schechner,et al.  Separation of Transparent Layers by Polarization Analysis , 1999 .

[39]  Rainer Reuter,et al.  Contrast-enhanced optical imaging of submersible targets , 1999, Industrial Lasers and Inspection.

[40]  Richard Szeliski,et al.  Systems and Experiment Paper: Construction of Panoramic Image Mosaics with Global and Local Alignment , 2000, International Journal of Computer Vision.

[41]  Alexander G. Cheroske,et al.  Polarization Vision and Its Role in Biological Signaling1 , 2003, Integrative and comparative biology.

[42]  Andrew S. Glassner,et al.  Principles of Digital Image Synthesis , 1995 .

[43]  Sang Wook Lee,et al.  Detection of Specularity Using Stereo in Color and Polarization Space , 1997, Comput. Vis. Image Underst..

[44]  H. Craighead,et al.  Liquid-crystal micropolarizer array for polarization-difference imaging. , 2002, Applied optics.

[45]  H Farid,et al.  Separating reflections from images by use of independent component analysis. , 1999, Journal of the Optical Society of America. A, Optics, image science, and vision.

[46]  Joan Batlle,et al.  Positioning an underwater vehicle through image mosaicking , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[47]  Yoav Y. Schechner,et al.  Clear underwater vision , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..