Reliable Multi-Object Tracking Model Using Deep Learning and Energy Efficient Wireless Multimedia Sensor Networks

Presently, sensor-cloud based environment becomes highly beneficial due to its applicability in several domains. Wireless multimedia sensor network (WMSN) is one among them, which involves a set of multimedia sensors to collect data about the deployed region. Compared to traditional object tracking models, animal tracking in WMSN is a tedious process owing to the harsh, dynamic, and energy limited sensors. This article introduces a new Reliable Multi-Object Tracking Model using Deep Learning (DL) and Energy Efficient WMSN. Initially, the fuzzy logic technique is employed to determine the cluster heads (CHs) to attain energy efficiency. Next, in the second stage, a novel tracking algorithm by the use of Recurrent Neural Network (RNN) with a tumbling effect called RNN-T is developed. The proposed RNN-T model gets executed by every sensor node and the CHs execute the tracking algorithm to track the animals. Finally, the tracking results are transmitted to the cloud server for investigation purposes. In order to assess the performance of the presented model, an extensive experimental analysis is carried out by the use of a real-time wildlife video. The obtained results ensured that the RNN-T model has achieved better performance over the compared methods in different aspects.

[1]  Leonidas J. Guibas,et al.  A Distributed Algorithm for Managing Multi-target Identities in Wireless Ad-hoc Sensor Networks , 2003, IPSN.

[2]  Rui Caseiro,et al.  High-Speed Tracking with Kernelized Correlation Filters , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Rui Caseiro,et al.  Exploiting the Circulant Structure of Tracking-by-Detection with Kernels , 2012, ECCV.

[4]  Gaurav S. Sukhatme,et al.  Connecting the Physical World with Pervasive Networks , 2002, IEEE Pervasive Comput..

[5]  Mamoru Minami,et al.  Fish catching by visual servoing and observed intelligence of the fish , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Steven Mills,et al.  Harmony filter: A robust visual tracking system using the improved harmony search algorithm , 2010, Image Vis. Comput..

[7]  Adnan Yazici,et al.  Data fusion and processing in Wireless Multimedia Sensor Networks: An analysis for surveillance applications , 2014, 2014 22nd Signal Processing and Communications Applications Conference (SIU).

[8]  Ian F. Akyildiz,et al.  A survey on wireless multimedia sensor networks , 2007, Comput. Networks.

[9]  John Anderson,et al.  Wireless sensor networks for habitat monitoring , 2002, WSNA '02.

[10]  Nuno Vasconcelos,et al.  Biologically Inspired Object Tracking Using Center-Surround Saliency Mechanisms , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Horst Bischof,et al.  On-line Boosting and Vision , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[12]  Joel J. P. C. Rodrigues,et al.  Ranking Analysis for Online Customer Reviews of Products Using Opinion Mining with Clustering , 2018, Complex..

[13]  Asifullah Khan,et al.  Particle swarm optimization based object tracking using HOG features , 2013, 2013 IEEE 9th International Conference on Emerging Technologies (ICET).

[14]  Kumar S. Ray,et al.  Object Tracking based on Quantum Particle Swarm Optimization , 2017, 2017 Ninth International Conference on Advances in Pattern Recognition (ICAPR).

[15]  Mohamed Elhoseny,et al.  Deep learning with LSTM based distributed data mining model for energy efficient wireless sensor networks , 2020, Phys. Commun..

[17]  Bogdan Kwolek,et al.  Multi-object Tracking Using Particle Swarm Optimization on Target Interactions , 2013, Advances in Heuristic Signal Processing and Applications.

[18]  Deborah Estrin,et al.  Networking issues in wireless sensor networks , 2003, J. Parallel Distributed Comput..

[19]  Wei Liu,et al.  A novel visual tracking method using bat algorithm , 2016, Neurocomputing.

[20]  Junseok Kwon,et al.  Highly Nonrigid Object Tracking via Patch-Based Dynamic Appearance Modeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Chang-Su Kim,et al.  Visual Tracking Using Pertinent Patch Selection and Masking , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Ales Leonardis,et al.  Robust Visual Tracking Using an Adaptive Coupled-Layer Visual Model , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Ming Tang,et al.  Robust Tracking With Discriminative Ranking Lists , 2010, IEEE Transactions on Image Processing.

[24]  Xiaoqin Zhang,et al.  Sequential particle swarm optimization for visual tracking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Deborah Estrin,et al.  Sensor networks: a bridge to the physical world , 2004 .

[26]  Yanning Zhang,et al.  Part-Based Visual Tracking with Online Latent Structural Learning , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Xiaohai He,et al.  Object tracking using firefly algorithm , 2013, IET Comput. Vis..

[28]  Stan Z. Li,et al.  Structured Visual Tracking with Dynamic Graph , 2012, ACCV.

[29]  Bogdan Kwolek,et al.  Particle Swarm Optimization Based Object Tracking , 2009, Fundam. Informaticae.

[30]  Ashutosh Kumar Singh,et al.  Effective features to classify ovarian cancer data in internet of medical things , 2018, Comput. Networks.

[31]  Feng Zhao,et al.  Distributed Group Management for Track Initiation and Maintenance in Target Localization Applications , 2003, IPSN.

[32]  Robert LIN,et al.  NOTE ON FUZZY SETS , 2014 .

[33]  Joel J. P. C. Rodrigues,et al.  Efficient artificial fish swarm based clustering approach on mobility aware energy‐efficient for MANET , 2018, Trans. Emerg. Telecommun. Technol..

[34]  Yi Wu,et al.  Online Object Tracking: A Benchmark , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[35]  Adnan Yazici,et al.  A Fusion-Based Framework for Wireless Multimedia Sensor Networks in Surveillance Applications , 2019, IEEE Access.

[36]  Leonidas J. Guibas,et al.  Collaborative signal and information processing: an information-directed approach , 2003 .

[37]  Yong Wang,et al.  Energy-efficient computing for wildlife tracking: design tradeoffs and early experiences with ZebraNet , 2002, ASPLOS X.