Concealed weapon detection and visualization in a synthesized image

Images acquired by heterogeneous image sensors may provide complementary information about the scene, for instance, the visual image can provide personal identification information like the facial pattern while the infrared (IR) or millimeter wave image can detect the suspicious regions of concealed weapons. Usually, a technique, namely multiresolution pixel-level image fusion is applied to integrate the information from multi-sensor images. However, when the images are significantly different, the performance of the multiresolution fusion algorithms is not always satisfactory. In this study, a new strategy consisting of two steps is proposed. The first step is to use an unsupervised fuzzy k-means clustering to detect the concealed weapon from the IR image. The detected region is embedded in the visual image in the second step and this process is implemented with a multiresolution mosaic technique. Therefore, the synthesized image retains the quality comparable to the visual image while the region of the concealed weapon is highlighted and enhanced. The experimental results indicate the efficiency of the proposed approach.

[1]  R.S. Blum,et al.  Image fusion for a digital camera application , 1998, Conference Record of Thirty-Second Asilomar Conference on Signals, Systems and Computers (Cat. No.98CH36284).

[2]  Vladimir Petrovic,et al.  Cross-band pixel selection in multiresolution image fusion , 1999, Defense, Security, and Sensing.

[3]  Alexander Toet,et al.  Multiscale contrast enhancement with applications to image fusion , 1992 .

[4]  Thomas Fechner,et al.  Pixel-level image fusion: the case of image sequences , 1998, Defense, Security, and Sensing.

[5]  S. Marshall,et al.  Multiresolution morphological fusion of MR and CT images of the human brain , 1995 .

[6]  Gerardo Beni,et al.  A Validity Measure for Fuzzy Clustering , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Gian Luca Foresti,et al.  A Distributed Sensor Network for Video Surveillance of Outdoors , 2003 .

[8]  Pramod K. Varshney,et al.  Multisensor Surveillance Systems , 2003, Springer US.

[9]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[10]  Ujjwal Maulik,et al.  Performance Evaluation of Some Clustering Algorithms and Validity Indices , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Zheng Liu,et al.  Experimenting with pixel-level NDT data fusion techniques , 2000, IEEE Trans. Instrum. Meas..

[12]  Steven K. Rogers,et al.  Perceptual-based image fusion for hyperspectral data , 1997, IEEE Trans. Geosci. Remote. Sens..

[13]  Pramod K. Varshney,et al.  Registration and fusion of infrared and millimeter wave images for concealed weapon detection , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[14]  Rick S. Blum,et al.  Investigations of image fusion , 1999 .

[15]  Edward H. Adelson,et al.  Shiftable multiscale transforms , 1992, IEEE Trans. Inf. Theory.

[16]  Pramod K. Varshney,et al.  Concealed weapon detection: an image fusion approach , 1997, Defense + Security.

[17]  Alexander Toet,et al.  Image fusion by a ration of low-pass pyramid , 1989, Pattern Recognit. Lett..

[18]  Zheng Liu,et al.  Image fusion by using steerable pyramid , 2001, Pattern Recognit. Lett..

[19]  Hai-Hui Wang,et al.  Fusion algorithm for multisensor images based on discrete multiwavelet transform , 2002 .

[20]  Pramod K. Varshney,et al.  Enhancement and fusion of data for concealed weapon detection , 1997, Defense, Security, and Sensing.

[21]  R.W. McMillan,et al.  Detection of concealed weapons using far-infrared bolometer arrays , 2000, 25th International Conference on Infrared and Millimeter Waves (Cat. No.00EX442).

[22]  P.K. Varshney,et al.  Imaging for concealed weapon detection: a tutorial overview of development in imaging sensors and processing , 2005, IEEE Signal Processing Magazine.

[23]  N. Canagarajah,et al.  Wavelets for Image Fusion , 2001 .

[24]  William T. Freeman,et al.  Presented at: 2nd Annual IEEE International Conference on Image , 1995 .

[25]  Fred J. Taylor,et al.  Image fusion using steerable dyadic wavelet transform , 1995, Proceedings., International Conference on Image Processing.

[26]  Pramod K. Varshney,et al.  Image processing tools for the enhancement of concealed weapon detection , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[27]  Stewart Marshall,et al.  Multires-olution morphological fusion of mr and ct images of the human brain , 1994 .

[28]  Gemma Piella,et al.  A general framework for multiresolution image fusion: from pixels to regions , 2003, Inf. Fusion.

[29]  Edward H. Adelson,et al.  PYRAMID METHODS IN IMAGE PROCESSING. , 1984 .

[30]  Oliver Rockinger,et al.  Image sequence fusion using a shift-invariant wavelet transform , 1997, Proceedings of International Conference on Image Processing.

[31]  B. A. Klock Interface and usability assessment of imaging systems , 2003 .

[32]  Rick S. Blum,et al.  A statistical signal processing approach to image fusion for concealed weapon detection , 2002, Proceedings. International Conference on Image Processing.

[33]  Fred J. Taylor,et al.  Enhancement via fusion of mammographic features , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[34]  Rick S. Blum,et al.  Fusion of visual and IR images for concealed weapon detection , 2002, Proceedings of the Fifth International Conference on Information Fusion. FUSION 2002. (IEEE Cat.No.02EX5997).

[35]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[36]  Peter J. Burt,et al.  Enhanced image capture through fusion , 1993, 1993 (4th) International Conference on Computer Vision.

[37]  Tian Pu,et al.  Contrast-based image fusion using the discrete wavelet transform , 2000 .

[38]  Oliver Rockinger Pixel - Level Fusion of Image Sequences using Wavelet Frames , 1996 .

[39]  Chiou-Ting Hsu,et al.  Multiresolution mosaic , 1996 .

[40]  Christine Pohl,et al.  Multisensor image fusion in remote sensing: concepts, methods and applications , 1998 .

[41]  Laure J. Chipman,et al.  Wavelets and image fusion , 1995, Proceedings., International Conference on Image Processing.

[42]  Steven K. Rogers,et al.  Perceptual-based hyperspectral image fusion using multiresolution analysis , 1995 .

[43]  Jake K. Aggarwal,et al.  Multisensor Fusion for Computer Vision , 1993, NATO ASI Series.

[44]  Takeshi Naemura,et al.  Thermo-key: human region segmentation from video , 2004, IEEE Computer Graphics and Applications.

[45]  James C. Bezdek,et al.  Validity-guided (re)clustering with applications to image segmentation , 1996, IEEE Trans. Fuzzy Syst..

[46]  Rick S. Blum,et al.  Concealed weapon detection using color image fusion , 2003, Sixth International Conference of Information Fusion, 2003. Proceedings of the.

[47]  Kentaro Toyama,et al.  Wallflower: principles and practice of background maintenance , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[48]  Jagdishkumar K. Aggarwal Multisensor for Computer Vision , 1993 .