Vision-Based Novelty Detection Using Deep Features and Evolved Novelty Filters for Specific Robotic Exploration and Inspection Tasks

One of the essential abilities in animals is to detect novelties within their environment. From the computational point of view, novelty detection consists of finding data that are different in some aspect to the known data. In robotics, researchers have incorporated novelty modules in robots to develop automatic exploration and inspection tasks. The visual sensor is one of the preferred sensors to perform this task. However, there exist problems as illumination changes, occlusion, and scale, among others. Besides, novelty detectors vary their performance depending on the specific application scenario. In this work, we propose a visual novelty detection framework for specific exploration and inspection tasks based on evolved novelty detectors. The system uses deep features to represent the visual information captured by the robots and applies a global optimization technique to design novelty detectors for specific robotics applications. We verified the performance of the proposed system against well-established state-of-the-art methods in a challenging scenario. This scenario was an outdoor environment covering typical problems in computer vision such as illumination changes, occlusion, and geometric transformations. The proposed framework presented high-novelty detection accuracy with competitive or even better results than the baseline methods.

[1]  Anuja Arora,et al.  Fraud detection and frequent pattern matching in insurance claims using data mining techniques , 2017, 2017 Tenth International Conference on Contemporary Computing (IC3).

[2]  Hugo Vieira Neto,et al.  Visual novelty detection with automatic scale selection , 2007, Robotics Auton. Syst..

[3]  Dervis Karaboga,et al.  A comprehensive survey: artificial bee colony (ABC) algorithm and applications , 2012, Artificial Intelligence Review.

[4]  Emre Özbilge Detecting static and dynamic novelties using dynamic neural network , 2017 .

[5]  Cesare Furlanello,et al.  Novelty Detection using Deep Normative Modeling for IMU-Based Abnormal Movement Monitoring in Parkinson’s Disease and Autism Spectrum Disorders , 2018, Sensors.

[6]  Michael J. Watts,et al.  A Decade of Kasabov's Evolving Connectionist Systems: A Review , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[7]  Simone Bianco,et al.  Combination of Video Change Detection Algorithms by Genetic Programming , 2017, IEEE Transactions on Evolutionary Computation.

[8]  Emre Özbilge,et al.  On-line expectation-based novelty detection for mobile robots , 2016, Robotics Auton. Syst..

[9]  Xia Li Wang,et al.  An automated vision based on-line novel percept detection method for a mobile robot , 2012, Robotics Auton. Syst..

[10]  Yasuo Kuniyoshi,et al.  Visual anomaly detection from small samples for mobile robots , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Michael J. Watts,et al.  Simple evolving connectionist systems and experiments on isolated phoneme recognition , 2000, 2000 IEEE Symposium on Combinations of Evolutionary Computation and Neural Networks. Proceedings of the First IEEE Symposium on Combinations of Evolutionary Computation and Neural Networks (Cat. No.00.

[12]  I-Jeng Wang,et al.  Deep embeddings for novelty detection in myopathy , 2019, Comput. Biol. Medicine.

[13]  Ulrich Nehmzow,et al.  Detecting Novel Features of an Environment Using Habituation , 2000 .

[14]  Mohan S. Kankanhalli,et al.  As-similar-as-possible saliency fusion , 2016, Multimedia Tools and Applications.

[15]  T. Martin McGinnity,et al.  Intrinsically motivated learning systems based on biologically-inspired novelty detection , 2015, Robotics Auton. Syst..

[16]  Almudena Sanz,et al.  Using novelty detection in HRI: Enabling robots to detect new poses and actively ask for their labels , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[17]  Brian C. Lovell,et al.  Novelty detection in human tracking based on spatiotemporal oriented energies , 2015, Pattern Recognit..

[18]  Hugo Vieira Neto On-line Visual Novelty Detection in Autonomous Mobile Robots , 2011 .

[19]  Dervis Karaboga,et al.  On clarifying misconceptions when comparing variants of the Artificial Bee Colony Algorithm by offering a new implementation , 2015, Inf. Sci..

[20]  Hugo Vieira Neto,et al.  Real-time Automated Visual Inspection using Mobile Robots , 2007, J. Intell. Robotic Syst..

[21]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[22]  David Ball,et al.  Online novelty-based visual obstacle detection for field robotics , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[23]  Keith Worden,et al.  Fault detection in rolling element bearings using wavelet-based variance analysis and novelty detection , 2016 .

[24]  Stephen R. Marsland,et al.  A tale of two filters-on-line novelty detection , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[25]  Paul A. Crook,et al.  A Robot Implementation of a Biologically Inspired Method for Novelty Detection , 2002 .

[26]  Stephen R. Marsland,et al.  A self-organising network that grows when required , 2002, Neural Networks.

[27]  Stephen R. Marsland,et al.  On-line novelty detection for autonomous mobile robots , 2005, Robotics Auton. Syst..

[28]  Sanjay Chawla,et al.  Anomaly Detection using One-Class Neural Networks , 2018, ArXiv.

[29]  Nikola K. Kasabov,et al.  ECOS: Evolving Connectionist Systems and the ECO Learning Paradigm , 1998, ICONIP.

[30]  Heitor Silvério Lopes,et al.  A study of deep convolutional auto-encoders for anomaly detection in videos , 2018, Pattern Recognit. Lett..

[31]  Bart Baesens,et al.  Isolation-based conditional anomaly detection on mixed-attribute data to uncover workers' compensation fraud , 2018, Decis. Support Syst..

[32]  David A. Clifton,et al.  A review of novelty detection , 2014, Signal Process..

[33]  Danny M. W. Hilkman,et al.  Improved epileptic seizure detection combining dynamic feature normalization with EEG novelty detection , 2016, Medical & Biological Engineering & Computing.

[34]  Charles Richter,et al.  Safe Visual Navigation via Deep Learning and Novelty Detection , 2017, Robotics: Science and Systems.