Open-World Learning Without Labels

Open-world learning is a problem where an autonomous agent detects things that it does not know and learns them over time from a non-stationary and never-ending stream of data; in an open-world environment, the training data and objective criteria are never available at once. The agent should grasp new knowledge from learning without forgetting acquired prior knowledge. Researchers proposed a few open-world learning agents for image classification tasks that operate in complex scenarios. However, all prior work on open-world learning has all labeled data to learn the new classes from the stream of images. In scenarios where autonomous agents should respond in near real-time or work in areas with limited communication infrastructure, human labeling of data is not possible. Therefore, supervised open-world learning agents are not scalable solutions for such applications. Herein, we propose a new framework that enables agents to learn new classes from a stream of unlabeled data in an unsupervised manner. Also, we study the robustness and learning speed of such agents with supervised and unsupervised feature representation. We also introduce a new metric for open-world learning without labels. We anticipate our theories and method to be a starting point for developing autonomous true open-world never-ending learning agents.

[1]  Julio Gonzalo,et al.  A comparison of extrinsic clustering evaluation metrics based on formal constraints , 2009, Information Retrieval.

[2]  Alberto Del Bimbo,et al.  Unsupervised incremental learning of deep descriptors from video streams , 2017, 2017 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[3]  Kaushik Roy,et al.  Unsupervised incremental STDP learning using forced firing of dormant or idle neurons , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[4]  Diane J. Cook,et al.  A Survey of Unsupervised Deep Domain Adaptation , 2018, ACM Trans. Intell. Syst. Technol..

[5]  Vishal M. Patel,et al.  C2AE: Class Conditioned Auto-Encoder for Open-Set Recognition , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Nicole A. Lazar,et al.  Statistics of Extremes: Theory and Applications , 2005, Technometrics.

[7]  Michal Valko,et al.  Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning , 2020, NeurIPS.

[8]  Terrance E. Boult,et al.  Learning and the Unknown: Surveying Steps toward Open World Recognition , 2019, AAAI.

[9]  Songcan Chen,et al.  Guided CNN for generalized zero-shot and open-set recognition using visual and semantic prototypes , 2020, Pattern Recognit..

[10]  Ruchir Gupta,et al.  A parameter-free affinity based clustering , 2015, Applied Intelligence.

[11]  Hendrik Purwins,et al.  Unsupervised Incremental Online Learning and Prediction of Musical Audio Signals , 2015, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[12]  Kaiming He,et al.  Improved Baselines with Momentum Contrastive Learning , 2020, ArXiv.

[13]  Bogdan Raducanu,et al.  Generative Feature Replay For Class-Incremental Learning , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[14]  Minglu Li,et al.  An Unsupervised Incremental Virtual Learning Method for Financial Fraud Detection , 2019, 2019 IEEE/ACS 16th International Conference on Computer Systems and Applications (AICCSA).

[15]  Songcan Chen,et al.  Collective Decision for Open Set Recognition , 2018, IEEE Transactions on Knowledge and Data Engineering.

[16]  Terrance E. Boult,et al.  Towards Open World Recognition , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Terrance E. Boult,et al.  The Extreme Value Machine , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Daswin De Silva,et al.  Trajectory clustering of road traffic in urban environments using incremental machine learning in combination with hyperdimensional computing , 2019, 2019 IEEE Intelligent Transportation Systems Conference (ITSC).

[19]  Edoardo Vignotto,et al.  Extreme value theory for anomaly detection – the GPD classifier , 2020, Extremes.

[20]  Breck Baldwin,et al.  Description of the UPENN CAMP System as Used for Coreference , 1998, MUC.

[21]  Yingli Tian,et al.  Self-Supervised Visual Feature Learning With Deep Neural Networks: A Survey , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Can Yang,et al.  Unsupervised Cross-Dataset Person Re-identification by Transfer Learning of Spatial-Temporal Patterns , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[23]  Yee Whye Teh,et al.  Continual Unsupervised Representation Learning , 2019, NeurIPS.

[24]  Stella X. Yu,et al.  Large-Scale Long-Tailed Recognition in an Open World , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Julien Mairal,et al.  Unsupervised Learning of Visual Features by Contrasting Cluster Assignments , 2020, NeurIPS.

[26]  Shutao Xia,et al.  Maintaining Discrimination and Fairness in Class Incremental Learning , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Takeshi Naemura,et al.  Classification-Reconstruction Learning for Open-Set Recognition , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Yandong Guo,et al.  Large Scale Incremental Learning , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Hailin Jin,et al.  Steering Self-Supervised Feature Learning Beyond Local Pixel Statistics , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Mung Chiang,et al.  Analyzing the Robustness of Open-World Machine Learning , 2019, AISec@CCS.

[31]  Liang Zhao,et al.  Multi-stage Deep Classifier Cascades for Open World Recognition , 2019, CIKM.

[32]  Songcan Chen,et al.  Recent Advances in Open Set Recognition: A Survey , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Bernt Schiele,et al.  Mnemonics Training: Multi-Class Incremental Learning Without Forgetting , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  James M. Rehg,et al.  Incremental Object Learning From Contiguous Views , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Terrance E. Boult,et al.  Incremental Open Set Intrusion Recognition Using Extreme Value Machine , 2017, 2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA).

[36]  Eric P. Smith,et al.  An Introduction to Statistical Modeling of Extreme Values , 2002, Technometrics.

[37]  Parag Chaudhuri,et al.  Unsupervised incremental learning for hand shape and pose estimation , 2019, SIGGRAPH Posters.

[38]  Quoc V. Le,et al.  EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks , 2019, ICML.

[39]  J. Angus Extreme Value Theory in Engineering , 1990 .

[40]  Xose Manuel Pardo,et al.  Incremental Learning Techniques Within a Self-updating Approach for Face Verification in Video-Surveillance , 2019, IbPRIA.

[41]  Fengqing Zhu,et al.  Incremental Learning in Online Scenario , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[42]  Geoffrey E. Hinton,et al.  Big Self-Supervised Models are Strong Semi-Supervised Learners , 2020, NeurIPS.

[43]  M. Saquib Sarfraz,et al.  Efficient Parameter-Free Clustering Using First Neighbor Relations , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[44]  Philip S. Yu,et al.  Open-world Learning and Application to Product Classification , 2018, WWW.