Efficient mining of IoT based data streams for advanced computer vision systems

With emergence of Internet of Things (IoT) and subsequent technologies, smart devices are being increasingly used in various domains such as smart homes, smart parking, intelligent transportation etc. Vast amount of image and video data has been produced by IoT based systems in the form of continuous and possibly infinite image and video streams. This demands the development of advanced predictive vision systems which exploits stream mining concepts for intelligent processing of visual data streams. Among other challenges faced by visual data streams, a major challenge is concept drift, which is caused by overtime change in data distribution. In the presence of skewed data, the detection of concept drift becomes more challenging. When analyzing the data generated from smart devices and other performance critical wireless sensors, concept drift affects data integrity and accuracy of prediction results. EWMA for Concept Drift Detection (ECDD) has been proposed in the literature for detecting data streams. However, ECDD has a high prediction error rate which makes it less useful for performance critical data streams generated by imaging and video data streams. In this paper, Vision based Drift Detection Method (VisDDM) is proposed, which systematically handles abrupt and gradual concept drift in data streams. Experiments have been performed using synthetic and real world datasets from different application domains. Our proposed VisDDM algorithm is able to handle abrupt and gradual drift types and outperformed the existing drift detection methods in terms of accuracy and mean evaluation time.

[1]  Roberto Souto Maior de Barros,et al.  RDDM: Reactive drift detection method , 2017, Expert Syst. Appl..

[2]  Zoran Bosni,et al.  Detecting concept drift in data streams using model explanation , 2018 .

[3]  Dimitris K. Tasoulis,et al.  Exponentially weighted moving average charts for detecting concept drift , 2012, Pattern Recognit. Lett..

[4]  Mehmed M. Kantardzic,et al.  On the reliable detection of concept drift from streaming unlabeled data , 2017, Expert Syst. Appl..

[5]  Guangjie Han,et al.  Concept drift detection for data stream learning based on angle optimized global embedding and principal component analysis in sensor networks , 2017, Comput. Electr. Eng..

[6]  José del Campo-Ávila,et al.  Online and Non-Parametric Drift Detection Methods Based on Hoeffding’s Bounds , 2015, IEEE Transactions on Knowledge and Data Engineering.

[7]  Xin Yao,et al.  Online Ensemble Learning of Data Streams with Gradually Evolved Classes , 2016, IEEE Transactions on Knowledge and Data Engineering.

[8]  Zoran Bosnic,et al.  Detecting concept drift in data streams using model explanation , 2018, Expert Syst. Appl..

[9]  Daniel Pizarro-Perez,et al.  Computer-Aided Classification of Gastrointestinal Lesions in Regular Colonoscopy , 2016, IEEE Transactions on Medical Imaging.

[10]  Koichiro Yamauchi,et al.  Detecting Concept Drift Using Statistical Testing , 2007, Discovery Science.

[11]  G. D. Magoulas,et al.  Image recognition and neuronal networks: Intelligent systems for the improvement of imaging information , 2000, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[12]  Cheong Hee Park,et al.  An Efficient Concept Drift Detection Method for Streaming Data under Limited Labeling , 2017, IEICE Trans. Inf. Syst..

[13]  Piotr Duda,et al.  On ensemble components selection in data streams scenario with reoccurring concept-drift , 2017, 2017 IEEE Symposium Series on Computational Intelligence (SSCI).

[14]  L MinkuLeandro,et al.  Online Ensemble Learning of Data Streams with Gradually Evolved Classes , 2016 .

[15]  Russel Pears,et al.  Staged Online Learning: A new approach to classification in high speed data streams , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[16]  Yun Sing Koh,et al.  Detecting concept change in dynamic data streams , 2013, Machine Learning.

[17]  Yun Sing Koh,et al.  One Pass Concept Change Detection for Data Streams , 2013, PAKDD.

[18]  Edwin Lughofer,et al.  Recognizing input space and target concept drifts in data streams with scarcely labeled and unlabelled instances , 2016, Inf. Sci..

[19]  Roberto Souto Maior de Barros,et al.  A Lightweight Concept Drift Detection Ensemble , 2015, 2015 IEEE 27th International Conference on Tools with Artificial Intelligence (ICTAI).

[20]  Gillian Dobbie,et al.  Detecting Volatility Shift in Data Streams , 2014, 2014 IEEE International Conference on Data Mining.

[21]  Marley M. B. R. Vellasco,et al.  DetectA: abrupt concept drift detection in non-stationary environments , 2018, Appl. Soft Comput..

[22]  A. Bifet,et al.  Early Drift Detection Method , 2005 .

[23]  Russel Pears,et al.  Use of ensembles of Fourier spectra in capturing recurrent concepts in data streams , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[24]  Jie Lu,et al.  Accumulating regional density dissimilarity for concept drift detection in data streams , 2018, Pattern Recognit..

[25]  Russel Pears,et al.  The incremental Fourier classifier: Leveraging the discrete Fourier transform for classifying high speed data streams , 2018, Expert Syst. Appl..