EEG-Based Maritime Object Detection for IoT-Driven Surveillance Systems in Smart Ocean

Automated maritime object detection is a significant research challenge in intelligent marine surveillance systems for the Internet of Things (IoT) and smart ocean applications. In particular, ship detection is recognized as one of the core research issues of these IoT-driven intelligent marine surveillance systems. Traditional methods based on machine learning have made some achievements in detection tasks for specific objects. However, the ship objects are relatively small, and they are usually not accurately detected. In this article, we propose an electroencephalography (EEG)-based maritime object detection algorithm for IoT-driven surveillance systems in the smart ocean. For this purpose, we conduct experiments to record the EEG signals of subjects when they are watching the maritime image scenes. With the feature analysis of EEG signals, the event-related potential (ERP) components associated with detecting objects are induced, such as the $P3$ and $N2$ components. Employing classification based on linear discriminant analysis (LDA), the area under curve (AUC) of the receiver operating characteristic (ROC) is used to evaluate the detection accuracy. We use this novel method to determine and identify essential objects and areas from IoT devices, such as digital camera imaging sensors. Our proposed method can not only help to detect small objects accurately using fewer samples but can also be used to reduce the data volume needed to be stored and transmitted in IoT-driven marine surveillance systems.

[1]  Lina Yao,et al.  A Graph-Based Hierarchical Attention Model for Movement Intention Detection from EEG Signals , 2019, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[2]  Sadasivan Puthusserypady,et al.  Spatial filter feature extraction methods for P300 BCI speller: A comparison , 2016, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[3]  A. Mognon,et al.  ADJUST: An automatic EEG artifact detector based on the joint use of spatial and temporal features. , 2011, Psychophysiology.

[4]  Robert Oostenveld,et al.  Identifying Object Categories from Event-Related EEG: Toward Decoding of Conceptual Representations , 2010, PloS one.

[5]  A. Worster,et al.  Understanding receiver operating characteristic (ROC) curves. , 2006, CJEM.

[6]  Qiang Ni,et al.  IoT-Driven Automated Object Detection Algorithm for Urban Surveillance Systems in Smart Cities , 2018, IEEE Internet of Things Journal.

[7]  Wenyong Wang,et al.  Research on Multiple Sensors Vehicle Detection With EMD-Based Denoising , 2019, IEEE Internet of Things Journal.

[8]  Josiane Zerubia,et al.  Detection of Object Motion Regions in Aerial Image Pairs With a Multilayer Markovian Model , 2009, IEEE Transactions on Image Processing.

[9]  Li Yao,et al.  Classifying four-category visual objects using multiple ERP components in single-trial ERP , 2016, Cognitive Neurodynamics.

[10]  N. Bigdely-Shamlo,et al.  Brain Activity-Based Image Classification From Rapid Serial Visual Presentation , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[11]  Miguel P. Eckstein,et al.  Single-Trial Classification of Event-Related Potentials in Rapid Serial Visual Presentation Tasks Using Supervised Spatial Filtering , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[12]  Luc Van Gool,et al.  Coupled Object Detection and Tracking from Static Cameras and Moving Vehicles , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Miguel P. Eckstein,et al.  Impact of target probability on single-trial EEG target detection in a difficult rapid serial visual presentation task , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[14]  Xiaojiang Du,et al.  Context-Aware Object Detection for Vehicular Networks Based on Edge-Cloud Cooperation , 2020, IEEE Internet of Things Journal.

[15]  Marina Schmid,et al.  An Introduction To The Event Related Potential Technique , 2016 .

[16]  April R. Levin,et al.  The Harvard Automated Processing Pipeline for Electroencephalography (HAPPE): Standardized Processing Software for Developmental and High-Artifact Data , 2018, Front. Neurosci..

[17]  Yafeng Zhan,et al.  An EEG-Based Study on Perception of Video Distortion Under Various Content Motion Conditions , 2020, IEEE Transactions on Multimedia.

[18]  Riccardo Poli,et al.  Collaborative brain-computer interfaces for target localisation in rapid serial visual presentation , 2014, 2014 6th Computer Science and Electronic Engineering Conference (CEEC).

[19]  Khan Muhammad,et al.  Cost-Effective Video Summarization Using Deep CNN With Hierarchical Weighted Fusion for IoT Surveillance Networks , 2020, IEEE Internet of Things Journal.

[20]  Misha Pavel,et al.  A framework for rapid visual image search using single-trial brain evoked responses , 2011, Neurocomputing.

[21]  Sadia Din,et al.  Exploring Deep Learning Models for Overhead View Multiple Object Detection , 2020, IEEE Internet of Things Journal.

[22]  Seong-Eun Moon,et al.  Perceptual Experience Analysis for Tone-mapped HDR Videos Based on EEG and Peripheral Physiological Signals , 2015, IEEE Transactions on Autonomous Mental Development.

[23]  Beatriz Blanco-Filgueira,et al.  Deep Learning-Based Multiple Object Visual Tracking on Embedded System for IoT and Mobile Edge Computing Applications , 2018, IEEE Internet of Things Journal.

[24]  Caifeng Shan,et al.  Deep Salient Object Detection With Contextual Information Guidance , 2020, IEEE Transactions on Image Processing.

[25]  Tzyy-Ping Jung,et al.  Real-time neuroimaging and cognitive monitoring using wearable dry EEG , 2015, IEEE Transactions on Biomedical Engineering.

[26]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[27]  Weisong Shi,et al.  VU: Edge Computing-Enabled Video Usefulness Detection and its Application in Large-Scale Video Surveillance Systems , 2020, IEEE Internet of Things Journal.

[28]  Riccardo Poli,et al.  Brain–Computer Interfaces for Detection and Localization of Targets in Aerial Images , 2017, IEEE Transactions on Biomedical Engineering.

[29]  Salil H. Patel,et al.  Characterization of N200 and P300: Selected Studies of the Event-Related Potential , 2005, International journal of medical sciences.

[30]  Dong Xu,et al.  Advanced Deep-Learning Techniques for Salient and Category-Specific Object Detection: A Survey , 2018, IEEE Signal Processing Magazine.

[31]  Abdulhamit Subasi,et al.  EEG signal classification using PCA, ICA, LDA and support vector machines , 2010, Expert Syst. Appl..

[32]  Frank Kirchner,et al.  An Adaptive Spatial Filter for User-Independent Single Trial Detection of Event-Related Potentials , 2015, IEEE Transactions on Biomedical Engineering.

[33]  R Bruyer,et al.  Human gender differences in an emotional visual oddball task: an event-related potentials study , 2004, Neuroscience Letters.

[34]  Tzyy-Ping Jung,et al.  Evaluation of Artifact Subspace Reconstruction for Automatic EEG Artifact Removal , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[35]  Pierre Jallon,et al.  A comparison of ERP spatial filtering methods for optimal mental workload estimation , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[36]  Jianhua Lu,et al.  Hierarchical objectness network for region proposal generation and object detection , 2018, Pattern Recognit..