An IoT-Platform-Based Deep Learning System for Human Behavior Recognition in Smart City Monitoring Using the Berkeley MHAD Datasets

Internet of Things (IoT) technology has been rapidly developing and has been well utilized in the field of smart city monitoring. The IoT offers new opportunities for cities to use data remotely for the monitoring, smart management, and control of device mechanisms that enable the processing of large volumes of data in real time. The IoT supports the connection of instruments with intelligible features in smart cities. However, there are some challenges due to the ongoing development of these applications. Therefore, there is an urgent need for more research from academia and industry to obtain citizen satisfaction, and efficient architecture, protocols, security, and services are required to fulfill these needs. In this paper, the key aspects of an IoT infrastructure for smart cities were analyzed. We focused on citizen behavior recognition using convolution neural networks (CNNs). A new model was built on understanding human behavior by using the berkeley multimodal human action (MHAD) Datasets. A video surveillance system using CNNs was implemented. The proposed model’s simulation results achieved 98% accuracy for the citizen behavior recognition system.

[1]  Xiwei Liu.  Sports Deep Learning Method Based on Cognitive Human Behavior Recognition , 2022, Computational intelligence and neuroscience.

[2]  Palash Yuvraj Ingle,et al.  Real-Time Abnormal Object Detection for Video Surveillance in Smart Cities , 2022, Sensors.

[3]  K. Kant,et al.  Conflict Detection and Resolution in IoT Systems: A Survey , 2022, IoT.

[4]  A. Virdis,et al.  An Edge-Based LWM2M Proxy for Device Management to Efficiently Support QoS-Aware IoT Services , 2022, IoT.

[5]  A. Bagula,et al.  Trajectory Planing for Cooperating Unmanned Aerial Vehicles in the IoT , 2022, IoT.

[6]  Hesham Alhumyani,et al.  Performance Evaluation of Downlink Coordinated Multipoint Joint Transmission under Heavy IoT Traffic Load , 2022, Wirel. Commun. Mob. Comput..

[7]  Md. Sarwar Hosain,et al.  Internet of vehicle's resource management in 5G networks using AI technologies: Current status and trends , 2021, IET Commun..

[8]  Hardik A. Gohel,et al.  A review on security threats, vulnerabilities, and counter measures of 5G enabled Internet‐of‐Medical‐Things , 2021, IET Communications.

[9]  Rashid A. Saeed,et al.  Machine learning techniques in internet of UAVs for smart cities applications , 2021, J. Intell. Fuzzy Syst..

[10]  Manisha Vashisht,et al.  Effective implementation of machine learning algorithms using 3D colour texture feature for traffic sign detection for smart cities , 2021, Expert Syst. J. Knowl. Eng..

[11]  Seunghwan Myeong,et al.  Use of Artificial Intelligence in Smart Cities for Smart Decision-Making: A Social Innovation Perspective , 2022, Sustainability.

[12]  Luminita Hurbean,et al.  Open Data Based Machine Learning Applications in Smart Cities: A Systematic Literature Review , 2021, Electronics.

[13]  R. Mokhtar,et al.  Quality of Services Based on Intelligent IoT WLAN MAC Protocol Dynamic Real-Time Applications in Smart Cities , 2021, Comput. Intell. Neurosci..

[14]  Rashid A. Saeed,et al.  IoE Design Principles and Architecture , 2021, Internet of Energy for Smart Cities.

[15]  Rashid A. Saeed,et al.  Machine Learning Technologies in Internet of Vehicles , 2021 .

[16]  Andrew John Poulter,et al.  Enabling Secure Guest Access for Command-and-Control of Internet of Things Devices , 2021, IoT.

[17]  Rashid A. Saeed,et al.  Artificial intelligence in IoT and its applications , 2021 .

[18]  Nirmalya Thakur,et al.  An Ambient Intelligence-Based Human Behavior Monitoring Framework for Ubiquitous Environments , 2021, Inf..

[19]  Eklas Hossain,et al.  A Systematic Review on Cognitive Radio in Low Power Wide Area Network for Industrial IoT Applications , 2021, Sustainability.

[20]  M. Zennaro,et al.  A Novel Enhanced Quantum PSO for Optimal Network Configuration in Heterogeneous Industrial IoT , 2021, IEEE Access.

[21]  Rashid A. Saeed,et al.  Algorithms Optimization for Intelligent IoV Applications , 2021, Handbook of Research on Innovations and Applications of AI, IoT, and Cognitive Technologies.

[22]  Rashid A. Saeed,et al.  Machine Learning for Industrial IoT Systems , 2021, Handbook of Research on Innovations and Applications of AI, IoT, and Cognitive Technologies.

[23]  Carlo Cattani,et al.  Introduction to the Special Issue on Recent Advances on Deep Learning for Medical Signal Analysis , 2021, Computer Modeling in Engineering & Sciences.

[24]  Rashid A. Saeed,et al.  Deep Learning Approaches for IoV Applications and Services , 2021 .

[25]  Sheetal N. Ghorpade,et al.  Enhanced Differential Crossover and Quantum Particle Swarm Optimization for IoT Applications , 2021, IEEE Access.

[26]  Intelligent Technologies for Internet of Vehicles , 2021 .

[27]  Shayla Islam,et al.  Machine Learning Technologies for Secure Vehicular Communication in Internet of Vehicles: Recent Advances and Applications , 2021, Secur. Commun. Networks.

[28]  Ana de las Heras,et al.  Machine Learning Technologies for Sustainability in Smart Cities in the Post-COVID Era , 2020, Sustainability.

[29]  Rashid A. Saeed,et al.  Optimizing Energy Consumption for Cloud Internet of Things , 2020, Frontiers in Physics.

[30]  Nasser Kehtarnavaz,et al.  C-MHAD: Continuous Multimodal Human Action Dataset of Simultaneous Video and Inertial Sensing , 2020, Sensors.

[31]  Ram Mohana Reddy Guddeti,et al.  Skeleton based Human Action Recognition for Smart City Application using Deep Learning , 2020, 2020 International Conference on COMmunication Systems & NETworkS (COMSNETS).

[32]  LPWAN Technologies for IoT and M2M Applications , 2020 .

[33]  Rashid A. Saeed,et al.  NB-IoT: concepts, applications, and deployment challenges , 2020 .

[34]  Han-Chieh Chao,et al.  Human Behavior Deep Recognition Architecture for Smart City Applications in the 5G Environment , 2019, IEEE Network.

[35]  Yinong Zhang,et al.  Research on Human Behavior Recognition based on Deep Neural Network , 2019, Proceedings of the 3rd International Conference on Mechatronics Engineering and Information Technology (ICMEIT 2019).

[36]  Sherali Zeadally,et al.  Sensor Technologies for Intelligent Transportation Systems , 2018, Sensors.

[37]  Kamal Aldein Mohammed Zeinab,et al.  Internet of Things Applications, Challenges and Related Future Technologies , 2017 .

[38]  Nasser Kehtarnavaz,et al.  UTD-MHAD: A multimodal dataset for human action recognition utilizing a depth camera and a wearable inertial sensor , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[39]  Ruzena Bajcsy,et al.  Berkeley MHAD: A comprehensive Multimodal Human Action Database , 2013, 2013 IEEE Workshop on Applications of Computer Vision (WACV).

[40]  Francisco Falcone,et al.  WiMAX, LTE, and WiFi Interworking , 2010, J. Comput. Networks Commun..

[41]  Ioannis Anagnostopoulos,et al.  License Plate Recognition From Still Images and Video Sequences: A Survey , 2008, IEEE Transactions on Intelligent Transportation Systems.