Communication and computation inter-effects in people counting using intelligence partitioning

The rapid development of the Internet of Things is affecting the requirements towards wireless vision sensor networks (WVSN). Future smart camera architectures require battery-operated devices to facilitate deployment for scenarios such as industrial monitoring, environmental monitoring and smart city, consequently imposing constraints on the node energy consumption. This paper provides an analysis of the inter-effects between computation and communication energy for a smart camera node. Based on a people counting scenario, we evaluate the trade-off for the node energy consumption with different processing configurations of the image processing tasks, and several communication technologies. The results indicate that the optimal partition between the smart camera node and remote processing is with background modelling, segmentation, morphology and binary compression implemented in the smart camera, supported by Bluetooth Low Energy (BLE) version 5 technologies. The comparative assessment of these results with other implementation scenarios underlines the energy efficiency of this approach. This work changes pre-conceptions regarding design space exploration in WVSN, motivating further investigation regarding the inclusion of intermediate processing layers between the node and the cloud to interlace low-power configurations of communication and processing architectures.

[1]  Hao Xu,et al.  An overview of 3GPP enhancements on machine to machine communications , 2016, IEEE Communications Magazine.

[2]  Jin Sun,et al.  An Efficient and Scalable Framework for Processing Remotely Sensed Big Data in Cloud Computing Environments , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Xavier Vilajosana,et al.  Early Scavenger Dimensioning in Wireless Industrial Monitoring Applications , 2016, IEEE Internet of Things Journal.

[4]  Najeem Lawal,et al.  Implementation of Wireless Vision Sensor Node With a Lightweight Bi-Level Video Coding , 2013, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[5]  Sufen Fong,et al.  MeshEye: A Hybrid-Resolution Smart Camera Mote for Applications in Distributed Intelligent Surveillance , 2007, 2007 6th International Symposium on Information Processing in Sensor Networks.

[6]  Hefeng Wu,et al.  Multipoint infrared laser-based detection and tracking for people counting , 2017, Neural Computing and Applications.

[7]  Michele Magno,et al.  Multimodal Video Analysis on Self-Powered Resource-Limited Wireless Smart Camera , 2013, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[8]  Jocelyn Sérot,et al.  Bio-inspired heterogeneous architecture for real-time pedestrian detection applications , 2018, Journal of Real-Time Image Processing.

[9]  Ángel Rodríguez-Vázquez,et al.  Wi-FLIP: A wireless smart camera based on a focal-plane low-power image processor , 2011, 2011 Fifth ACM/IEEE International Conference on Distributed Smart Cameras.

[10]  Farzad Samie,et al.  IoT technologies for embedded computing: A survey , 2016, 2016 International Conference on Hardware/Software Codesign and System Synthesis (CODES+ISSS).

[11]  Mattias O'Nils,et al.  Architectural evaluation of node: server partitioning for people counting , 2018, ICDSC.

[12]  Thomas B. Moeslund,et al.  Pedestrian Counting with Occlusion Handling Using Stereo Thermal Cameras , 2016, Sensors.

[13]  Athanasios V. Vasilakos,et al.  A review of industrial wireless networks in the context of Industry 4.0 , 2015, Wireless Networks.

[14]  Silvia Krug,et al.  Modeling and Comparison of Delay and Energy Cost of IoT Data Transfers , 2019, IEEE Access.

[15]  Jong Yih Kuo,et al.  People counting base on head and shoulder information , 2016, 2016 IEEE International Conference on Knowledge Engineering and Applications (ICKEA).

[16]  Antonio Sánchez-Esguevillas,et al.  An Intelligent Surveillance Platform for Large Metropolitan Areas with Dense Sensor Deployment , 2013, Sensors.

[17]  Alberto Del Bimbo,et al.  Real-time people counting from depth imagery of crowded environments , 2014, 2014 11th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[18]  Katia Obraczka,et al.  Wireless Smart Camera Networks for the Surveillance of Public Spaces , 2014, Computer.

[19]  Joan Daniel Prades,et al.  The Power of Models: Modeling Power Consumption for IoT Devices , 2015, IEEE Sensors Journal.

[20]  Shreyas Sen,et al.  Self-Optimizing IoT Wireless Video Sensor Node With In-Situ Data Analytics and Context-Driven Energy-Aware Real-Time Adaptation , 2017, IEEE Transactions on Circuits and Systems I: Regular Papers.

[21]  Arijit Raychowdhury,et al.  In-sensor analytics and energy-aware self-optimization in a wireless sensor node , 2017, 2017 IEEE MTT-S International Microwave Symposium (IMS).

[22]  Andrea Cavallaro,et al.  Energy Consumption Models for Smart Camera Networks , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  Najeem Lawal,et al.  Energy-Efficient SRAM FPGA-Based Wireless Vision Sensor Node: SENTIOF-CAM , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[24]  Najeem Lawal,et al.  Architecture of wireless Visual Sensor Node with Region of Interest coding , 2012, 2012 IEEE 3rd International Conference on Networked Embedded Systems for Every Application (NESEA).

[25]  Ying Zhang,et al.  Collaborative In-Network Processing for Internet of Battery-Less Things , 2019, IEEE Internet of Things Journal.

[26]  Andrzej Duda,et al.  Comparison of the Device Lifetime in Wireless Networks for the Internet of Things , 2017, IEEE Access.

[27]  Katia Obraczka,et al.  Solar-powered, wireless smart camera network: An IoT solution for outdoor video monitoring , 2018, Comput. Commun..

[28]  Imen Charfi,et al.  Fast prototyping of a SoC-based smart-camera: a real-time fall detection case study , 2016, Journal of Real-Time Image Processing.

[29]  Senem Velipasalar,et al.  Cooperative Object Tracking and Composite Event Detection With Wireless Embedded Smart Cameras , 2010, IEEE Transactions on Image Processing.

[30]  Mattias O'Nils,et al.  Background modelling, analysis and implementation for thermographic images , 2017, 2017 Seventh International Conference on Image Processing Theory, Tools and Applications (IPTA).

[31]  Ronald Y. Chang,et al.  Device-Free Indoor People Counting Using Wi-Fi Channel State Information for Internet of Things , 2017, GLOBECOM 2017 - 2017 IEEE Global Communications Conference.

[32]  Olga Galinina,et al.  Understanding the IoT connectivity landscape: a contemporary M2M radio technology roadmap , 2015, IEEE Communications Magazine.

[33]  François Berry,et al.  DreamCam: A modular FPGA-based smart camera architecture , 2014, J. Syst. Archit..

[34]  Najeem Lawal,et al.  Design Exploration of a Multi-camera Dome for Sky Monitoring , 2016, ICDSC.

[35]  Vincenzo Paciello,et al.  A low cost smart power meter for IoT , 2019, Measurement.

[36]  Peter Van Roy,et al.  Achlys: Towards a Framework for Distributed Storage and Generic Computing Applications for Wireless IoT Edge Networks with Lasp on GRiSP , 2019, 2019 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops).

[37]  Yu Qiao,et al.  Depth driven people counting using deep region proposal network , 2017, 2017 IEEE International Conference on Information and Automation (ICIA).