Leveraging Object Proposals for Object-Level Change Detection

Feature-based image differencing is an efficient approach to image change detection, which performs fast enough for self-driving car and robotic applications. Extant approaches typically take local keypoint features as input to the differencing stage. In this study, we aim to extend the differencing stage to consider object-level features. Our object level approach is inspired by recent advances in two independent object-region proposal techniques: supervised object proposal (e.g., YOLO) and unsupervised object proposal (e.g., BING). A difficulty arises from the fact that even state-of-the-art object proposal techniques suffer from misdetections and false alarms. Our key concept is combining the supervised and unsupervised techniques into a common framework that evaluates the likelihood of change at the semantic object level. We address a challenging urban scenario using the publicly available Malaga dataset and experimentally verify that improved change detection performance can be obtained with our approach.

[1]  Jana Kosecka,et al.  Detecting Changes in Images of Street Scenes , 2012, ACCV.

[2]  Yoshihiko Kimuro,et al.  Global localization with detection of changes in non-stationary environments , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[3]  Tanaka Kanji,et al.  Change Detection with Global Viewpoint Localization , 2017 .

[4]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[5]  Mario Fernando Montenegro Campos,et al.  Novelty detection and 3D shape retrieval using superquadrics and multi-scale sampling for autonomous mobile robots , 2010, 2010 IEEE International Conference on Robotics and Automation.

[6]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[8]  Achim J. Lilienthal,et al.  Has somethong changed here? Autonomous difference detection for security patrol robots , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[10]  Winston H. Hsu,et al.  Drone-Based Object Counting by Spatially Regularized Regional Proposal Network , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[11]  David Ball,et al.  Novelty-based visual obstacle detection in agriculture , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[12]  Zhanyi Hu,et al.  A Novel Framework for Urban Change Detection Using VHR Satellite Images , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[13]  Marc Pollefeys,et al.  Geometric Change Detection in Urban Environments Using Images , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Koen E. A. van de Sande,et al.  Empowering Visual Categorization With the GPU , 2011, IEEE Transactions on Multimedia.

[15]  Raffay Hamid,et al.  Large-scale damage detection using satellite imagery , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Badrinath Roysam,et al.  Image change detection algorithms: a systematic survey , 2005, IEEE Transactions on Image Processing.

[17]  Noel E. O'Connor,et al.  Bags of Local Convolutional Features for Scalable Instance Search , 2016, ICMR.

[18]  Philip H. S. Torr,et al.  BING: Binarized normed gradients for objectness estimation at 300fps , 2014, Computational Visual Media.