Use of Generative Adversarial Network for Cross-Domain Change Detection

This paper addresses the problem of cross-domain change detection from a novel perspective of image-to-image translation. In general, change detection aims to identify interesting changes between a given query image and a reference image of the same scene taken at a different time. This problem becomes a challenging one when query and reference images involve different domains (e.g., time of the day, weather, and season) due to variations in object appearance and a limited amount of training examples. In this study, we address the above issue by leveraging a generative adversarial network (GAN). Our key concept is to use a limited amount of training data to train a GAN-based image translator that maps a reference image to a virtual image that cannot be discriminated from query domain images. This enables us to treat the cross-domain change detection task as an in-domain image comparison. This allows us to leverage the large body of literature on in-domain generic change detectors. In addition, we also consider the use of visual place recognition as a method for mining more appropriate reference images over the space of virtual images. Experiments validate efficacy of the proposed approach.

[1]  Rama Chellappa,et al.  Visual Domain Adaptation: A survey of recent advances , 2015, IEEE Signal Processing Magazine.

[2]  Mario Fernando Montenegro Campos,et al.  Novelty detection and 3D shape retrieval using superquadrics and multi-scale sampling for autonomous mobile robots , 2010, 2010 IEEE International Conference on Robotics and Automation.

[3]  Ryan M. Eustice,et al.  University of Michigan North Campus long-term vision and lidar dataset , 2016, Int. J. Robotics Res..

[4]  Tanaka Kanji,et al.  Change Detection with Global Viewpoint Localization , 2017 .

[5]  Tanaka Kanji Cross-season place recognition using NBNN scene descriptor , 2015, IROS 2015.

[6]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[7]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Koen E. A. van de Sande,et al.  Empowering Visual Categorization With the GPU , 2011, IEEE Transactions on Multimedia.

[9]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[10]  Jana Kosecka,et al.  Detecting Changes in Images of Street Scenes , 2012, ACCV.

[11]  Dennis W. J. M. van de Wouw,et al.  Hierarchical 2.5-D Scene Alignment for Change Detection With Large Viewpoint Differences , 2016, IEEE Robotics and Automation Letters.

[12]  Kanji Tanaka Cross-season place recognition using NBNN scene descriptor , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[13]  Badrinath Roysam,et al.  Image change detection algorithms: a systematic survey , 2005, IEEE Transactions on Image Processing.

[14]  Marc Pollefeys,et al.  City-Scale Change Detection in Cadastral 3D Models Using Images , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[16]  Zhanyi Hu,et al.  A Novel Framework for Urban Change Detection Using VHR Satellite Images , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[17]  Germán Ros,et al.  Street-view change detection with deconvolutional networks , 2016, Robotics: Science and Systems.