Novelty Detection and Learning from Extremely Weak Supervision

In this paper we offer a method and algorithm, which make possible fully autonomous (unsupervised) detection of new classes, and learning following a very parsimonious training priming (few labeled data samples only). Moreover, new unknown classes may appear at a later stage and the proposed xClass method and algorithm are able to successfully discover this and learn from the data autonomously. Furthermore, the features (inputs to the classifier) are automatically sub-selected by the algorithm based on the accumulated data density per feature per class. As a result, a highly efficient, lean, human-understandable, autonomously self-learning model (which only needs an extremely parsimonious priming) emerges from the data. To validate our proposal we tested it on two challenging problems, including imbalanced Caltech-101 data set and iRoads dataset. Not only we achieved higher precision, but, more significantly, we only used a single class beforehand, while other methods used all the available classes) and we generated interpretable models with smaller number of feat ures used, through extremely weak and weak supervision.

[1]  Ke Xu,et al.  Toward software defined smart home , 2016, IEEE Communications Magazine.

[2]  Sajjad Hussain Shah,et al.  A survey: Internet of Things (IOT) technologies, applications and challenges , 2016, 2016 IEEE Smart Energy Grid Engineering (SEGE).

[3]  Atsuyuki Okabe,et al.  Spatial Tessellations: Concepts and Applications of Voronoi Diagrams , 1992, Wiley Series in Probability and Mathematical Statistics.

[4]  Dimitris Kanellopoulos,et al.  Data Preprocessing for Supervised Leaning , 2007 .

[5]  Plamen Angelov,et al.  Evolving Intelligent Systems: Methodology and Applications , 2010 .

[6]  Daniel S. Hoadley,et al.  Artificial Intelligence and National Security , 1986 .

[7]  Plamen P. Angelov,et al.  A Generalized Methodology for Data Analysis , 2018, IEEE Transactions on Cybernetics.

[8]  H. Chad Lane,et al.  Building Explainable Artificial Intelligence Systems , 2006, AAAI.

[9]  Cynthia Rudin,et al.  Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead , 2018, Nature Machine Intelligence.

[10]  Geoffrey M. Hodgson,et al.  The great crash of 2008 and the reform of economics , 2009, The Handbook of Globalisation, Third Edition.

[11]  Pietro Perona,et al.  Learning Generative Visual Models from Few Training Examples: An Incremental Bayesian Approach Tested on 101 Object Categories , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[12]  Tai-hoon Kim,et al.  Applications, Systems and Methods in Smart Home Technology: A Review , 2010 .

[13]  Igor Skrjanc,et al.  Evolving fuzzy and neuro-fuzzy approaches in clustering, regression, identification, and classification: A Survey , 2019, Inf. Sci..

[14]  Plamen Angelov,et al.  Actively Semi-Supervised Deep Rule-based Classifier Applied to Adverse Driving Scenarios , 2019, 2019 International Joint Conference on Neural Networks (IJCNN).

[15]  Plamen P. Angelov,et al.  Toward Anthropomorphic Machine Learning , 2018, Computer.

[16]  Mia Hubert,et al.  Robust statistics for outlier detection , 2011, WIREs Data Mining Knowl. Discov..

[17]  Plamen Angelov,et al.  Autonomous Learning Systems: From Data Streams to Knowledge in Real-time , 2013 .

[18]  John C. Russ,et al.  The Image Processing Handbook , 2016, Microscopy and Microanalysis.

[19]  P. Angelov,et al.  Empirical Approach to Machine Learning , 2018, Studies in Computational Intelligence.

[20]  M. Mitchell Waldrop,et al.  Autonomous vehicles: No drivers required , 2015, Nature.

[21]  Jianxiong Xiao,et al.  DeepDriving: Learning Affordance for Direct Perception in Autonomous Driving , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[22]  Mahdi Rezaei,et al.  Vehicle Detection Based on Multi-feature Clues and Dempster-Shafer Fusion Theory , 2013, PSIVT.

[23]  S. Cimbala.  Artificial Intelligence and National Security , 1986 .

[24]  Enn Tyugu,et al.  Artificial intelligence in cyber defense , 2011, 2011 3rd International Conference on Cyber Conflict.