Contrast Restoration of Weather Degraded Images

Images of outdoor scenes captured in bad weather suffer from poor contrast. Under bad weather conditions, the light reaching a camera is severely scattered by the atmosphere. The resulting decay in contrast varies across the scene and is exponential in the depths of scene points. Therefore, traditional space invariant image processing techniques are not sufficient to remove weather effects from images. We present a physics-based model that describes the appearances of scenes in uniform bad weather conditions. Changes in intensities of scene points under different weather conditions provide simple constraints to detect depth discontinuities in the scene and also to compute scene structure. Then, a fast algorithm to restore scene contrast is presented. In contrast to previous techniques, our weather removal algorithm does not require any a priori scene structure, distributions of scene reflectances, or detailed knowledge about the particular weather condition. All the methods described in this paper are effective under a wide range of weather conditions including haze, mist, fog, and conditions arising due to other aerosols. Further, our methods can be applied to gray scale, RGB color, multispectral and even IR images. We also extend our techniques to restore contrast of scenes with moving objects, captured using a video camera.

[1]  Peter Daszak,et al.  Extinction of a Species of Land Snail Due to Infection with a Microsporidian Parasite , 1998 .

[2]  John P. Oakley,et al.  Improving image quality in poor visibility conditions using a physical model for contrast degradation , 1998, IEEE Trans. Image Process..

[3]  Shree K. Nayar,et al.  Chromatic framework for vision in bad weather , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[4]  R. Henry,et al.  Color perception through atmospheric haze. , 2000, Journal of the Optical Society of America. A, Optics, image science, and vision.

[5]  Kinsell L. Coulson,et al.  Polarization Of Light In The Natural Environment , 1990, Optics & Photonics.

[6]  J G Walker,et al.  Visibility depth improvement in active polarization imaging in scattering media. , 2000, Applied optics.

[7]  W. Wolfe,et al.  The Infrared Handbook , 1985 .

[8]  Andrew A. Lacis,et al.  Analysis of ground-based polarimetric sky radiance measurements , 1997, Optics & Photonics.

[9]  C. Tropea,et al.  Light Scattering from Small Particles , 2003 .

[10]  G. Rybicki.  Radiative transfer , 2019, Climate Change and Terrestrial Ecosystem Modeling.

[11]  G. Goodfriend,et al.  Variation in Land-snail Shell form and Size and its Causes: a Review , 1986 .

[12]  W. Middleton,et al.  Vision Through the Atmosphere , 1952 .

[13]  John E. Tyler,et al.  The nature of light and colour in the open air , 1954 .

[14]  H. V. Hulst.  Light Scattering by Small Particles , 1957 .

[15]  M. Lazaridou-Dimitriadou,et al.  GROWTH, MORTALITY AND FECUNDITY IN SUCCESSIVE GENERATIONS OF HELIX ASPERSA MULLER CULTURED INDOORS AND CROWDING EFFECTS ON FAST-, MEDIUM- AND SLOW-GROWING SNAILS OF THE SAME CLUTCH , 1998 .

[16]  N S Kopeika,et al.  General wavelength dependence of imaging through the atmosphere. , 1981, Applied optics.

[17]  Shree K. Nayar,et al.  Vision in bad weather , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[18]  C. C. Christensen,et al.  Camaenid Land Snail Reproductive Cycle and Growth Patterns in Semiarid Areas of North-Western Australia , 1984 .

[19]  Raymond L. Lee,et al.  Horizon brightness revisited: measurements and a model of clear-sky radiances. , 1994, Applied optics.

[20]  Terrance E. Boult,et al.  Physically-based edge labeling , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  P. V. Church,et al.  Overcast sky luminances and directional luminous reflectances of objects and backgrounds under overcast skies. , 1966, Applied optics.

[22]  N. Engheta,et al.  Polarization-difference imaging: a biologically inspired technique for observation through scattering media. , 1995, Optics letters.

[23]  Jenifer M. Plummer,et al.  OBSERVATIONS ON THE REPRODUCTION, GROWTH AND LONGEVITY OF A LABORATORY COLONY OF ARCHACHATINA (CALACHATINA)MARGINATA (SWAINSON) SUBSPECIES OVUM , 1975 .

[24]  L. Chardonnet,et al.  Activity and food intake of captive Placostylus fibratus (Gastropoda: Bulimulidae) in New Caledonia , 1997 .

[25]  David R. Schiel,et al.  Population structure of Placostylus hongii (Gastropoda: Paryphantidae) on the Poor Knights Islands , 1980 .

[26]  Robert Black,et al.  GROWTH, SURVIVORSHIP, AND POPULATION SIZE IN THE LAND SNAIL RHAGADA CONVICTA COX, 1870 (PULMONATA: CAMAENIDAE) FROM A SEMIARID ENVIRONMENT IN WESTERN AUSTRALIA , 1991 .

[27]  Shree K. Nayar,et al.  Vision and the Atmosphere , 2002, International Journal of Computer Vision.

[28]  KokKeong Tan,et al.  Enhancement of color images in poor visibility conditions , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[29]  A. Vaufleury,et al.  Regulation of growth and reproduction. , 2001 .

[30]  L. J. Elmslie.  Strain differences in Helix pomatia L. (Gastropoda: Pulmonata): diapause, digging, growth rate and shell fill. , 2001 .

[31]  M. Lazaridou-Dimitriadou,et al.  Aspects of the life cycle, population dynamics, growth and secondary production of the snail Monacha cartusiana (Müller, 1774) (Gastropoda Pulmonata) in Greece. , 1990 .

[32]  Greg Sherley,et al.  Demography of two landsnail populations (Placostylus ambagiosus, Pulmonata: Bulimulidae) in relation to predator control in the far north of New Zealand , 1998 .

[33]  Steven A. Shafer,et al.  Using color to separate reflection components , 1985 .

[34]  N. Farmakis,et al.  Aspects of the life cycle, population dynamics, growth and secondary production of the edible snail Helix lucorum Linnaeus,1758 (Gastropoda, Pulmonata) in Greece , 1988 .

[35]  I. Dror,et al.  RESTORATION OF ATMOSPHERICALLY BLURRED IMAGES ACCORDING TO WEATHER-PREDICTED ATMOSPHERIC MODULATION TRANSFER FUNCTIONS , 1997 .

[36]  Shree K. Nayar,et al.  Polarization-based vision through haze , 2003 .

[37]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[38]  G. Barker,et al.  Behavioural ecology: on doing the right thing, in the right place at the right time. , 2001 .

[39]  S. Gedzelman,et al.  Atmospheric optics in art. , 1991, Applied optics.

[40]  R. Cameron,et al.  Intra- and Interspecific Effects of Population Density on Growth and Activity in Some Helicid Land Snails (Gastropoda: Pulmonata) , 1979 .

[41]  James Murray,et al.  Experimental Release of Endemic Partula Species, Extinct in the Wild, into a Protected Area of Natural Habitat on Moorea , 2004 .

[42]  Rosemary I. Egonmwan,et al.  THE EFFECTS OF POPULATION DENSITY ON GROWTH RATE IN LIMICOLARIA FLAMMEA MÜLLER (PULMONATA: ACHATINIDAE) , 1992 .

[43]  M. Lazaridou-Dimitriadou,et al.  The life cycle, population dynamics, growth and secondary production of the snail Bradybaena fruticum (Muller, 1774) (Gastropoda Pulmonata) in northern Greece , 1990 .

[44]  Alan E. Stiven,et al.  EXPERIMENTAL EFFECTS OF DENSITY AND FOOD ON GROWTH AND MORTALITY OF THE SOUTHERN APPALACHIAN LAND GASTROPOD, MESODON NORMALIS (PILSBRY) , 1996 .

[45]  A. South,et al.  A COMPARISON OF THE LIFE CYCLES OF DEROCERAS RETICULATUM (MÜLLER) AND ARION INTERMEDIUS NORMAND (PULMONATA: STYLOMMATOPHORA) AT DIFFERENT TEMPERATURES UNDER LABORATORY CONDITIONS , 1982 .

[46]  Jonathan Majer,et al.  Population structure, growth and longevity of Placostylus hongii (Pulmonata: Bulimulidae) on Tawhiti Rahi Island, Poor Knights Islands, New Zealand , 2003 .

[47]  A. Cantor.  Optics of the atmosphere--Scattering by molecules and particles , 1978, IEEE Journal of Quantum Electronics.

[48]  Phillip Williamson,et al.  Size-Weight Relationships and Field Growth Rates of the Landsnail Cepaea nemoralis L. , 1976 .

[49]  Shree K. Nayar,et al.  Removing weather effects from monochrome images , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[50]  K K Tan,et al.  Physics-based approach to color image enhancement in poor visibility conditions. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[51]  Norman S. Kopeika,et al.  A System Engineering Approach to Imaging , 1998 .

[52]  Shree K. Nayar,et al.  Instant dehazing of images using polarization , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[53]  Shree K. Nayar,et al.  Radiometric self calibration , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[54]  D. Lynch,et al.  Step brightness changes of distant mountain ridges and their perception. , 1991, Applied optics.

[55]  S. Ullman.  On visual detection of light sources , 1976, Biological Cybernetics.

[56]  J. L. Pezzaniti,et al.  Polarization imaging through scattering media , 2000, SPIE Optics + Photonics.

[57]  Richard R. Brooks,et al.  Atmospheric attenuation reduction through multisensor fusion , 1998, Defense, Security, and Sensing.

[58]  A. South.  Terrestrial Slugs: Biology, ecology and control , 1991 .

[59]  Bruno Baur,et al.  GROWTH AND REPRODUCTION OF THE MINUTE LAND SNAIL PUNCTUM PYGMAEUM (DRAPARNAUD) , 1989 .

[60]  Boris Kaminsky,et al.  AOTF polarization difference imaging , 1999, Other Conferences.

[61]  L V Wang,et al.  Light backscattering polarization patterns from turbid media: theory and experiment. , 1999, Applied optics.