Remote Insects Trap Monitoring System Using Deep Learning Framework and IoT

Insect detection and control at an early stage are essential to the built environment (human-made physical spaces such as homes, hotels, camps, hospitals, parks, pavement, food industries, etc.) and agriculture fields. Currently, such insect control measures are manual, tedious, unsafe, and time-consuming labor dependent tasks. With the recent advancements in Artificial Intelligence (AI) and the Internet of things (IoT), several maintenance tasks can be automated, which significantly improves productivity and safety. This work proposes a real-time remote insect trap monitoring system and insect detection method using IoT and Deep Learning (DL) frameworks. The remote trap monitoring system framework is constructed using IoT and the Faster RCNN (Region-based Convolutional Neural Networks) Residual neural Networks 50 (ResNet50) unified object detection framework. The Faster RCNN ResNet 50 object detection framework was trained with built environment insects and farm field insect images and deployed in IoT. The proposed system was tested in real-time using four-layer IoT with built environment insects image captured through sticky trap sheets. Further, farm field insects were tested through a separate insect image database. The experimental results proved that the proposed system could automatically identify the built environment insects and farm field insects with an average of 94% accuracy.

[1]  Ming-Ming Cheng,et al.  IP102: A Large-Scale Benchmark Dataset for Insect Pest Recognition , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Bowen Zheng,et al.  Extraction and Research of Crop Feature Points Based on Computer Vision , 2019, Sensors.

[3]  D.J.A. Rustia,et al.  An Iot-based Wireless Imaging and Sensor Node System for Remote Greenhouse Pest Monitoring , 2017 .

[4]  Nikolaos Doulamis,et al.  Deep Learning for Computer Vision: A Brief Review , 2018, Comput. Intell. Neurosci..

[5]  Rajesh Elara Mohan,et al.  Vision Based Wall Following Framework: A Case Study With HSR Robot for Cleaning Application , 2020, Sensors.

[6]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[7]  Nicola Ivan Giannoccaro,et al.  Development of Sensors-Based Agri-Food Traceability System Remotely Managed by a Software Platform for Optimized Farm Management , 2020, Sensors.

[8]  Jitendra Malik,et al.  Region-Based Convolutional Networks for Accurate Object Detection and Segmentation , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Mingjie Liu,et al.  UAV-YOLO: Small Object Detection on Unmanned Aerial Vehicle Perspective , 2020, Sensors.

[10]  Jun Zhang,et al.  Insect Detection and Classification Based on an Improved Convolutional Neural Network , 2018, Sensors.

[11]  Silvia Liberata Ullo,et al.  Advances in Smart Environment Monitoring Systems Using IoT and Sensors , 2020, Sensors.

[12]  Phan Duy Hung,et al.  Pest detection on Traps using Deep Convolutional Neural Networks , 2018 .

[13]  Nuno M. Garcia,et al.  Internet of Things Architectures, Technologies, Applications, Challenges, and Future Directions for Enhanced Living Environments and Healthcare Systems: A Review , 2019, Electronics.

[14]  Fangyuan Wang,et al.  PestNet: An End-to-End Deep Learning Approach for Large-Scale Multi-Class Pest Detection and Classification , 2019, IEEE Access.

[15]  Phan Duy Hung,et al.  SSD-Mobilenet Implementation for Classifying Fish Species , 2019, Advances in Intelligent Systems and Computing.

[16]  Ilyas Potamitis,et al.  Automated Remote Insect Surveillance at a Global Scale and the Internet of Things , 2017, Robotics.

[17]  Duy-Dinh Le,et al.  Evaluation of Deep Models for Real-Time Small Object Detection , 2017, ICONIP.

[18]  Chenglu Wen,et al.  Image-based orchard insect automated identification and classification method , 2012 .

[19]  M. A. Viraj J. Muthugala,et al.  A Human Support Robot for the Cleaning and Maintenance of Door Handles Using a Deep-Learning Framework , 2020, Sensors.

[20]  Yan Song,et al.  Inception Single Shot MultiBox Detector for object detection , 2017, 2017 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[21]  Byung-Seo Kim,et al.  IoT Elements, Layered Architectures and Security Issues: A Comprehensive Survey , 2018, Sensors.

[22]  Tony Morelli,et al.  A four-layer wireless sensor network framework for IoT applications , 2016, 2016 IEEE 59th International Midwest Symposium on Circuits and Systems (MWSCAS).

[23]  Rajesh Elara Mohan,et al.  Table Cleaning Task by Human Support Robot Using Deep Learning Technique , 2020, Sensors.

[24]  Graham W. Taylor,et al.  Automatic moth detection from trap images for pest management , 2016, Comput. Electron. Agric..

[25]  Lei Zhang,et al.  Object Tracking for a Smart City Using IoT and Edge Computing , 2019, Sensors.

[26]  Pascal Urien,et al.  A new approach to investigate IoT threats based on a four layer model , 2016, 2016 13th International Conference on New Technologies for Distributed Systems (NOTERE).

[27]  Rodrigo Castañeda-Miranda,et al.  Original paper: Scale invariant feature approach for insect monitoring , 2011 .

[28]  Ta-Te Lin,et al.  An Online Unsupervised Deep Learning Approach for an Automated Pest Insect Monitoring System , 2019, 2019 Boston, Massachusetts July 7- July 10, 2019.

[29]  Jun Lv,et al.  An Insect Imaging System to Automate Rice Light-Trap Pest Identification , 2012 .

[30]  Muhammad Ilyas,et al.  Cascaded Machine-Learning Technique for Debris Classification in Floor-Cleaning Robot Application , 2018, Applied Sciences.

[31]  Jinyan Li,et al.  Automatic classification for field crop insects via multiple-task sparse representation and multiple-kernel learning , 2015, Comput. Electron. Agric..

[32]  Iraklis Rigakis,et al.  A “Smart” Trap Device for Detection of Crawling Insects and Other Arthropods in Urban Environments , 2018, Electronics.

[33]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  G KeerthanKumarT,et al.  Automated Agricultural FieldAnalysis and Monitoring System Using IOT , 2018 .

[35]  Waldir Moreira,et al.  IoT Sensing Platform as a Driver for Digital Farming in Rural Africa , 2020, Sensors.

[36]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Michael Weber,et al.  Affordable Bimodal Optical Sensors to Spread the Use of Automated Insect Monitoring , 2018, J. Sensors.

[38]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[39]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  Pascal Perez,et al.  Edge-Computing Video Analytics for Real-Time Traffic Monitoring in a Smart City , 2019, Sensors.

[41]  Weiming Shen,et al.  Internet of Things in Marine Environment Monitoring: A Review , 2019, Sensors.

[42]  Michael S. Lew,et al.  Deep learning for visual understanding: A review , 2016, Neurocomputing.

[43]  Huan Zhang,et al.  Localization and Classification of Paddy Field Pests using a Saliency Map and Deep Convolutional Neural Network , 2016, Scientific Reports.

[44]  Loreto Susperregi,et al.  A Benchmarking of Learning Strategies for Pest Detection and Identification on Tomato Plants for Autonomous Scouting Robots Using Internal Databases , 2019, J. Sensors.