A novel GPU-aware Histogram-based algorithm for supporting moving object segmentation in big-data-based IoT application scenarios

Abstract Multimedia data are a popular case of Big Data that expose the classical 3V characteristics (i.e., volume, velocity and variety). Such kind of data are likely to be processed within the core layer of Internet of Things (IoT) platforms, where a multiple, typically high, number of “things” (e.g., sensors, devices, actuators, and so forth) collaborate to massively process big data for supporting intelligent algorithms running over them. In such platforms, the computational bottleneck is very often represented by the component running the main algorithm, while communication and cooperation costs still remain relevant. Inspired by this emerging trend of big-data-based IoT applications, in this paper we focus on the specific application context represented by the problem of supporting moving object segmentation over images originated in the context of big multimedia data, and we propose an innovative background maintenance approach to this end. In particular, we provide a novel GPU-aware Histogram-based Moving Object Segmentation algorithm that adopts a pixel-oriented approach and it is based on Graphic Processing Units (GPU), called pixHMOS_gpu . pixHMOS_gpu allows us to achieve higher performance, hence making the computational gap of big-data-based IoT applications decisively smaller. Experimental results clearly confirm our arguments.

[1]  Marko Heikkilä,et al.  A texture-based method for modeling the background and detecting moving objects , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Qi Tian,et al.  Statistical modeling of complex backgrounds for foreground object detection , 2004, IEEE Transactions on Image Processing.

[3]  Thierry Bouwmans,et al.  Background Modeling and Foreground Detection for Video Surveillance , 2014 .

[4]  Armin Haller,et al.  A note on exploration of IoT generated big data using semantics , 2017, Future Gener. Comput. Syst..

[5]  Paul Zikopoulos,et al.  Understanding Big Data: Analytics for Enterprise Class Hadoop and Streaming Data , 2011 .

[6]  Brian C. Lovell,et al.  Shadow detection: A survey and comparative evaluation of recent methods , 2012, Pattern Recognit..

[7]  Michael A. Pusateri,et al.  Kalman filter based video background estimation , 2009, 2009 IEEE Applied Imagery Pattern Recognition Workshop (AIPR 2009).

[8]  H. Niemann,et al.  Adaptive change detection for real-time surveillance applications , 2000, Proceedings Third IEEE International Workshop on Visual Surveillance.

[9]  Dan Lin,et al.  Privacy Policy Inference of User-Uploaded Images on Content Sharing Sites , 2015, IEEE Transactions on Knowledge and Data Engineering.

[10]  Alfredo Cuzzocrea,et al.  Balancing accuracy and privacy of OLAP aggregations on data cubes , 2010, DOLAP '10.

[11]  Nicholas J. Redding,et al.  GPU-Accelerated Background Generation Algorithm with Low Latency , 2007, 9th Biennial Conference of the Australian Pattern Recognition Society on Digital Image Computing Techniques and Applications (DICTA 2007).

[12]  Walter Stechele,et al.  Egomotion compensation and moving objects detection algorithm on GPU , 2011, PARCO.

[13]  Gérard G. Medioni,et al.  A GPU-based implementation of motion detection from a moving platform , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[14]  Andrea Fusiello,et al.  Tracking Human Motion with Multiple Cameras Using an Articulated Model , 2009, MIRAGE.

[15]  Rita Cucchiara,et al.  Detecting Moving Objects, Ghosts, and Shadows in Video Streams , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Alfredo Cuzzocrea,et al.  A Robust Sampling-Based Framework for Privacy Preserving OLAP , 2008, DaWaK.

[17]  Ching-Hsien Hsu,et al.  On improvement of cloud virtual machine availability with virtualization fault tolerance mechanism , 2011, 2011 IEEE Third International Conference on Cloud Computing Technology and Science.

[18]  Hoai Bac Le,et al.  GPU Implementation of Extended Gaussian Mixture Model for Background Subtraction , 2010, 2010 IEEE RIVF International Conference on Computing & Communication Technologies, Research, Innovation, and Vision for the Future (RIVF).

[19]  S. R. Balaji,et al.  A survey on moving object tracking using image processing , 2017, 2017 11th International Conference on Intelligent Systems and Control (ISCO).

[20]  Alfredo Cuzzocrea,et al.  Effectively and Efficiently Mining Frequent Patterns from Dense Graph Streams on Disk , 2014, KES.

[21]  Laurence T. Yang,et al.  Big Data - Algorithms, Analytics, and Applications , 2015 .

[22]  Chung-Ming Kuo,et al.  An Efficient Histogram-Based Method for Background Modeling , 2009, 2009 Fourth International Conference on Innovative Computing, Information and Control (ICICIC).

[23]  P. KaewTrakulPong,et al.  An Improved Adaptive Background Mixture Model for Real-time Tracking with Shadow Detection , 2002 .

[24]  L. Davis,et al.  Background and foreground modeling using nonparametric kernel density estimation for visual surveillance , 2002, Proc. IEEE.

[25]  Carlos Hitoshi Morimoto,et al.  Multiple camera people detection and tracking using support integration , 2011, Pattern Recognit. Lett..

[26]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Mario Cannataro,et al.  Modeling Adaptive Hypermedia with an Object-Oriented Approach and XML , 2002, WebDyn@WWW.

[28]  Alfredo Cuzzocrea,et al.  On Managing Very Large Sensor-Network Data Using Bigtable , 2012, 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012).

[29]  William K. Pratt,et al.  Digital Image Processing: PIKS Inside , 2001 .

[30]  Matthew Poremba,et al.  Accelerating adaptive background subtraction with GPU and CBEA architecture , 2010, 2010 IEEE Workshop On Signal Processing Systems.

[31]  Ian Gorton,et al.  Data-Intensive Computing: Architectures, Algorithms, and Applications , 2012 .

[32]  Midhula Vijayan,et al.  Moving Object Detection Using Local Binary Pattern and Gaussian Background Model , 2018 .

[33]  Yuji Iwahori,et al.  GPU based extraction of moving objects without shadows under intensity changes , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[34]  J. Manyika Big data: The next frontier for innovation, competition, and productivity , 2011 .

[35]  Leonel Sousa,et al.  Parallel Advanced Video Coding: Motion Estimation on Multi-cores , 2008, Scalable Comput. Pract. Exp..

[36]  Narciso García,et al.  GPU-based implementation of an optimized nonparametric background modeling for real-time moving object detection , 2013, IEEE Transactions on Consumer Electronics.

[37]  Lu Wang,et al.  Extraction of Moving Objects From Their Background Based on Multiple Adaptive Thresholds and Boundary Evaluation , 2010, IEEE Transactions on Intelligent Transportation Systems.

[38]  King-Sun Fu,et al.  A survey on image segmentation , 1981, Pattern Recognit..

[39]  Ankush Mittal,et al.  Real-time moving object detection algorithm on high-resolution videos using GPUs , 2012, Journal of Real-Time Image Processing.

[40]  Gueesang Lee,et al.  Robust background extraction scheme using histogram-wise for real-time tracking in urban traffic video , 2008, 2008 8th IEEE International Conference on Computer and Information Technology.

[41]  Montse Pardàs,et al.  Bayesian foreground segmentation and tracking using pixel-wise background model and region based foreground model , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[42]  Badrinath Roysam,et al.  Image change detection algorithms: a systematic survey , 2005, IEEE Transactions on Image Processing.

[43]  Minglun Gong,et al.  Real-time foreground segmentation on GPUs using local online learning and global graph cut optimization , 2008, 2008 19th International Conference on Pattern Recognition.

[44]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[45]  Laurence T. Yang,et al.  High-order possibilistic c-means algorithms based on tensor decompositions for big data in IoT , 2018, Inf. Fusion.

[46]  Guandong Xu,et al.  Community Detection in Multi-relational Social Networks , 2013, WISE.

[47]  Nilanjan Dey,et al.  A survey of image classification methods and techniques , 2014, 2014 International Conference on Control, Instrumentation, Communication and Computational Technologies (ICCICCT).