Method for applying daytime colors to nighttime imagery in realtime

We present a fast and efficient method to derive and apply natural colors to nighttime imagery from multiband sensors. The color mapping is derived from the combination of a multiband image and a corresponding natural color reference image. The mapping optimizes the match between the multiband image and the reference image, and yields a nightvision image with colors similar to that of the daytime image. The mapping procedure is simple and fast. Once it has been derived the color mapping can be deployed in realtime. Different color schemes can be used tailored to the environment and the application. The expectation is that by displaying nighttime imagery in natural colors human observers will be able to interpret the imagery better and faster, thereby improving situational awareness and reducing reaction times.

[1]  Weiqi Jin,et al.  Real-time color transfer system for low-light level visible and infrared images in YUV color space , 2007, SPIE Defense + Commercial Sensing.

[2]  Vassilis Tsagaris,et al.  Fusion of visible and infrared imagery for night color vision , 2005, Displays.

[3]  Alexander Toet,et al.  Portable real-time color night vision , 2008, SPIE Defense + Commercial Sensing.

[4]  Bernd Korn.  Enhanced and Synthetic Vision , 2006 .

[5]  A. Oliva,et al.  Diagnostic colours contribute to the early stages of scene categorization: Behavioural and neurophysiological evidence , 2005 .

[6]  Ke Wang,et al.  Applying daytime colors to night-time imagery with an efficient color transfer method , 2007, SPIE Defense + Commercial Sensing.

[7]  Gang Liu,et al.  Color fusion of SAR and FLIR images using a natural color transfer technique , 2005 .

[8]  W. K. Krebs,et al.  Scene Recognition with Infrared, Low-Light, and Sensor-Fused Imagery , 1999 .

[9]  Joseph P. Racamato,et al.  Solid-State Color Night Vision: Fusion of Low-Light Visible and Thermal Infrared Imagery , 1998 .

[10]  Junsheng Shi,et al.  Objective evaluation of color fusion of visual and IR imagery by measuring image contrast , 2005, SPIE/COS Photonics Asia.

[11]  Alexander Toet,et al.  Natural colour mapping for multiband nightvision imagery , 2003, Inf. Fusion.

[12]  Allen M. Waxman,et al.  Fusion of multi-sensor imagery for night vision: color visualization, target learning and search , 2000, Proceedings of the Third International Conference on Information Fusion.

[13]  Melvin R. Kruer,et al.  Real-time color fusion of E/O sensors with PC-based COTS hardware , 2000, Defense, Security, and Sensing.

[14]  Olivier R. Joubert,et al.  How long to get to the “gist” of real-world natural scenes? , 2005 .

[15]  Weiqi Jin,et al.  Color fusion schemes for low-light CCD and infrared images of different properties , 2002, SPIE/COS Photonics Asia.

[16]  Vassilis Tsagaris,et al.  Multispectral image fusion for improved RGB representation based on perceptual attributes , 2005 .

[17]  D. Ruderman,et al.  Statistics of cone responses to natural images: implications for visual coding , 1998 .

[18]  Zhanfeng Yue,et al.  Real-time EO/IR sensor fusion on a portable computer and head-mounted display , 2007, SPIE Defense + Commercial Sensing.

[19]  A. Oliva,et al.  Diagnostic Colors Mediate Scene Recognition , 2000, Cognitive Psychology.

[20]  Yufeng Zheng,et al.  Coloring night-vision imagery with statistical properties of natural colors by using image segmentation and histogram matching , 2005, IS&T/SPIE Electronic Imaging.