Intelligent Security Monitoring System Based on RISC-V SoC

With the development of the economy and society, the demand for social security and stability increases. However, traditional security systems rely too much on human resources and are affected by uncontrollable community security factors. An intelligent security monitoring system can overcome the limitations of traditional systems and save human resources, contributing to public security. To build this system, a RISC-V SoC is first designed in this paper and implemented on the Nexys-Video Artix-7 FPGA. Then, the Linux operating system is transplanted and successfully run. Meanwhile, the driver of related hardware devices is designed independently. After that, three OpenCV-based object detection models including YOLO (You Only Look Once), Haar (Haar-like features), and LBP (Local Binary Pattern) are compared, and the LBP model is chosen to design applications. Finally, the processing speed of 1.25 s per frame is realized to detect and track moving objects. To sum up, we build an intelligent security monitoring system with real-time detection, tracking, and identification functions through hardware and software collaborative design. This paper also proposes a video downsampling technique. Based on this technique, the BRAM resource usage on the hardware side is reduced by 50% and the amount of pixel data that needs to be processed on the software side is reduced by 75%. A video downsampling technology is also proposed in this paper to achieve better video display effects under limited hardware resources. It provides conditions for future function expansion and improves the models’ processing speed. Additionally, it reduces the run time of the application and improves the system performance.

[1]  Heechul Yun,et al.  Integrating NVIDIA Deep Learning Accelerator (NVDLA) with RISC-V SoC on FireSim , 2019, 2019 2nd Workshop on Energy Efficient Machine Learning and Cognitive Computing for Embedded Applications (EMC2).

[2]  Nashwan Adnan Othman,et al.  A new IoT combined face detection of people by using computer vision for security application , 2017, 2017 International Artificial Intelligence and Data Processing Symposium (IDAP).

[3]  Chi-Man Pun,et al.  Personal Privacy Protection via Irrelevant Faces Tracking and Pixelation in Video Live Streaming , 2021, IEEE Transactions on Information Forensics and Security.

[4]  Kiam Heong Ang,et al.  PID control system analysis and design , 2006, IEEE Control Systems.

[5]  Jesús Alastruey-Benedé,et al.  Developing an AI IoT application with open software on a RISC-V SoC , 2020, 2020 XXXV Conference on Design of Circuits and Integrated Systems (DCIS).

[6]  Kamalakar Pallela,et al.  Intelligent security system for residential and industrial automation , 2016, 2016 IEEE Uttar Pradesh Section International Conference on Electrical, Computer and Electronics Engineering (UPCON).

[7]  Chhabi Rani Panigrahi,et al.  ISS: Intelligent Security System Using Facial Recognition , 2021 .

[8]  Khattab M. Ali Alheeti,et al.  An intelligent security system for autonomous cars based on infrared sensors , 2017, 2017 23rd International Conference on Automation and Computing (ICAC).

[9]  Zhao Xu,et al.  Canny edge detection based on Open CV , 2017, 2017 13th IEEE International Conference on Electronic Measurement & Instruments (ICEMI).

[10]  Mehmet Umut Salur,et al.  An Embedded Real-Time Object Detection and Measurement of its Size , 2018, 2018 International Conference on Artificial Intelligence and Data Processing (IDAP).

[11]  Kari Pulli,et al.  Realtime Computer Vision with OpenCV , 2012, ACM Queue.

[12]  Rainer Lienhart,et al.  An extended set of Haar-like features for rapid object detection , 2002, Proceedings. International Conference on Image Processing.

[13]  Virginia Menezes,et al.  Surveillance and monitoring system using Raspberry Pi and SimpleCV , 2015, 2015 International Conference on Green Computing and Internet of Things (ICGCIoT).

[14]  Alex Zelinsky,et al.  Learning OpenCV---Computer Vision with the OpenCV Library (Bradski, G.R. et al.; 2008)[On the Shelf] , 2009, IEEE Robotics & Automation Magazine.

[15]  Xihong Wu,et al.  Boosting Local Binary Pattern (LBP)-Based Face Recognition , 2004, SINOBIOMETRICS.

[16]  Asim Kadav,et al.  Understanding modern device drivers , 2012, ASPLOS XVII.

[17]  Andrew Waterman,et al.  The RISC-V Reader: An Open Architecture Atlas , 2017 .

[18]  Nashwan Adnan Othman,et al.  A new IoT combined body detection of people by using computer vision for security application , 2017, 2017 9th International Conference on Computational Intelligence and Communication Networks (CICN).

[19]  Xinchao Zhong,et al.  A RISC-V SoC for Mobile Payment Based on Visible Light Communication , 2020, 2020 IEEE Asia Pacific Conference on Circuits and Systems (APCCAS).

[20]  Adam M. Izraelevitz,et al.  The Rocket Chip Generator , 2016 .

[21]  Elad Alon,et al.  A Mixed-Signal RISC-V Signal Analysis SoC Generator With a 16-nm FinFET Instance , 2019, IEEE Journal of Solid-State Circuits.

[22]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Chester Rebeiro,et al.  Shakti-T: A RISC-V Processor with Light Weight Security Extensions , 2017, HASP@ISCA.

[24]  Jonathan Balkind,et al.  OpenPiton + Ariane : The First Open-Source , SMP Linux-booting RISC-V System Scaling From One to Many Cores , 2019 .

[25]  Lesley Shannon,et al.  TAIGA: A new RISC-V soft-processor framework enabling high performance CPU architectural features , 2017, 2017 27th International Conference on Field Programmable Logic and Applications (FPL).

[26]  Andrew Waterman,et al.  Design of the RISC-V Instruction Set Architecture , 2016 .

[27]  Luca Benini,et al.  GAP-8: A RISC-V SoC for AI at the Edge of the IoT , 2018, 2018 IEEE 29th International Conference on Application-specific Systems, Architectures and Processors (ASAP).

[28]  Peter Rössler,et al.  Open-Source RISC-V Processor IP Cores for FPGAs — Overview and Evaluation , 2019, 2019 8th Mediterranean Conference on Embedded Computing (MECO).

[29]  Ning Liu,et al.  Collaborative use of RGB and thermal imaging for remote breathing rate measurement under realistic conditions , 2020 .

[30]  Sheng Liu,et al.  Comparative analysis and application of LBP face image recognition algorithms , 2019, Int. J. Commun. Syst..