Automatic Labeling of Industrial Images by using Generative Adversarial Networks

This paper presents the combination of the adversarial nets framework with a kernel-based statistical dependency measurement for learning interpretable representations without any labeled data and with an autoencoder. Thus, the loss function consists of three terms and, based on the loss function, a new architecture emerges. Experiments show the functionality and potential of the architecture and the proposed kernel-based statistical dependency criterion quantitatively and qualitatively. Furthermore, the improvements are presented on a dataset consisting of industrial images.

[1]  A. Atiya,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2005, IEEE Transactions on Neural Networks.

[2]  Pieter Abbeel,et al.  InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets , 2016, NIPS.

[3]  Soumith Chintala,et al.  Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks , 2015, ICLR.

[4]  Alexei A. Efros,et al.  Context Encoders: Feature Learning by Inpainting , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Richard S. Zemel,et al.  Generative Moment Matching Networks , 2015, ICML.

[6]  Yiming Yang,et al.  MMD GAN: Towards Deeper Understanding of Moment Matching Network , 2017, NIPS.

[7]  Navdeep Jaitly,et al.  Adversarial Autoencoders , 2015, ArXiv.

[8]  Léon Bottou,et al.  Wasserstein Generative Adversarial Networks , 2017, ICML.

[9]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Le Song,et al.  A dependence maximization view of clustering , 2007, ICML '07.

[11]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[12]  Bernhard Schölkopf,et al.  Measuring Statistical Dependence with Hilbert-Schmidt Norms , 2005, ALT.

[13]  Michael I. Jordan,et al.  Dimensionality Reduction for Supervised Learning with Reproducing Kernel Hilbert Spaces , 2004, J. Mach. Learn. Res..

[14]  Yann LeCun,et al.  Energy-based Generative Adversarial Network , 2016, ICLR.

[15]  David Barber,et al.  The IM algorithm: a variational approach to Information Maximization , 2003, NIPS 2003.

[16]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.