On improving IED object detection by exploiting scene geometry using stereo processing

Detecting changes in the environment with respect to an earlier data acquisition is important for several applications, such as finding Improvised Explosive Devices (IEDs). We explore and evaluate the benefit of depth sensing in the context of automatic change detection, where an existing monocular system is extended with a second camera in a fixed stereo setup. We then propose an alternative frame registration that exploits scene geometry, in particular the ground plane. Furthermore, change characterization is applied to localized depth maps to distinguish between 3D physical changes and shadows, which solves one of the main challenges of a monocular system. The proposed system is evaluated on real-world acquisitions, containing geo-tagged test objects of 18 18 9 cm up to a distance of 60 meters. The proposed extensions lead to a significant reduction of the false-alarm rate by a factor of 3, while simultaneously improving the detection score with 5%.

[1]  Heinz Hügli,et al.  Pedestrian detection by range imaging , 2007, VISAPP.

[2]  Jordan M. Malof,et al.  Change-based threat detection in urban environments with a forward-looking camera , 2012, Other Conferences.

[3]  Richard Szeliski,et al.  Multi-image matching using multi-scale oriented patches , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[4]  Kresimir Kusevic,et al.  Real-time 3D change detection of IEDs , 2012, Other Conferences.

[5]  Kenichi Kanatani,et al.  Stabilizing Image Mosaicing by Model Selection , 2000, SMILE.

[6]  Yuwei Chen,et al.  Map updating and change detection using vehicle-based laser scanning , 2009, 2009 Joint Urban Remote Sensing Event.

[7]  Shishir K. Shah,et al.  Disparity Map Refinement for Video Based Scene Change Detection Using a Mobile Stereo Camera Platform , 2010, 2010 20th International Conference on Pattern Recognition.

[8]  Damien Garcia,et al.  Robust smoothing of gridded data in one and higher dimensions with missing values , 2010, Comput. Stat. Data Anal..

[9]  K. Venkateswaran,et al.  A survey on unsupervised change detection algorithms , 2013, 2013 International Conference on Circuits, Power and Computing Technologies (ICCPCT).

[10]  Peter H. N. de With,et al.  Real-time change detection for countering improvised explosive devices , 2014, Electronic Imaging.

[11]  Gong Jianyaa,et al.  Of Multi-temporal Remote Sensing Data Change Detection Algorithms , 2008 .

[12]  S. Thrun,et al.  Change Detection From Multiple Camera Images Extended to Non-Stationary Cameras , 2005 .

[13]  Francesca Bovolo,et al.  A conceptual framework for change detection in very high resolution remote sensing images , 2010, 2010 IEEE International Geoscience and Remote Sensing Symposium.