An Improved Near-Field Computer Vision for Jet Trajectory Falling Position Prediction of Intelligent Fire Robot

An improved Near-Field Computer Vision (NFCV) system for intelligent fire robot was proposed that was based on our previous works in this paper, whose aims are to realize falling position prediction of jet trajectory in fire extinguishing. Firstly, previous studies respecting the NFCV system were briefly reviewed and several issues during application testing were analyzed and summarized. The improved work mainly focuses on the segmentation and discrimination of jet trajectory adapted to complex lighting environment and interference scenes. It mainly includes parameters adjustment on the variance threshold and background update rate of the mixed Gaussian background method, jet trajectory discrimination based on length and area proportion parameters, parameterization, and feature extraction of jet trajectory based on superimposed radial centroid method. When compared with previous works, the proposed method reduces the average error of prediction results from 1.36 m to 0.1 m, and the error variance from 1.58 m to 0.13 m. The experimental results suggest that every part plays an important role in improving the functionality and reliability of the NFCV system, especially the background subtraction and radial centroid methods. In general, the improved NFCV system for jet trajectory falling position prediction has great potential for intelligent fire extinguishing by fire-fighting robots.

[1]  Siew Wen Chin,et al.  FireDroid - An automated fire extinguishing robot , 2013, 2013 IEEE International Conference on Control System, Computing and Engineering.

[2]  Satoshi Tadokoro,et al.  Aerial Hose Type Robot by Water Jet for Fire Fighting , 2018, IEEE Robotics and Automation Letters.

[3]  Yifan Li,et al.  A Fire Protection Robot System Based on SLAM Localization and Fire Source Identification , 2019, 2019 IEEE 9th International Conference on Electronics Information and Emergency Communication (ICEIEC).

[4]  A. Sasikala,et al.  Fire Detection using Artificial Intelligence for Fire-Fighting Robots , 2020, 2020 4th International Conference on Intelligent Computing and Control Systems (ICICCS).

[5]  Sen Li,et al.  A Fire Reconnaissance Robot Based on SLAM Position, Thermal Imaging Technologies, and AR Display , 2019, Sensors.

[6]  Wei Li,et al.  Study on Water Jet Trajectory Model of Fire Monitor Based on Simulation and Experiment , 2018, Fire Technology.

[7]  Kazuyoshi Miyazawa Fire robots developed by the Tokyo Fire Department , 2002, Adv. Robotics.

[8]  Gordon Thomas,et al.  Estimating Water Requirements for Firefighting Operations Using FIERAsystem , 2001 .

[9]  Huibin Wang,et al.  Monocular Vision-Based Underwater Object Detection , 2017, Sensors.

[10]  Kuo L. Su Automatic Fire Detection System Using Adaptive Fusion Algorithm for Fire Fighting Robot , 2006, 2006 IEEE International Conference on Systems, Man and Cybernetics.

[11]  Joseph W. Starr,et al.  A comparison of IR stereo vision and LIDAR for use in fire environments , 2012, 2012 IEEE Sensors.

[12]  Ali Marjovi,et al.  Multi-robot exploration and fire searching , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Brian Y. Lattimer,et al.  Real-Time Classification of Water Spray and Leaks for Robotic Firefighting , 2015, Int. J. Comput. Vis. Image Process..

[14]  Masayuki Okugawa,et al.  Verification of Scenario for Robot-Assisted Fire-Fighting and Rescue Operations , 2019, 2019 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR).

[15]  Eric T. Matson,et al.  NL-based communication with firefighting robots , 2012, 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[16]  Brian Y. Lattimer,et al.  Robotic Fire Suppression Through Autonomous Feedback Control , 2017 .

[17]  M. A. Rashid Sarkar,et al.  Design and fabrication of an autonomous fire fighting robot with multisensor fire detection using PID controller , 2016, 2016 5th International Conference on Informatics, Electronics and Vision (ICIEV).

[18]  Da Lin,et al.  Real-Time Monitoring of Jet Trajectory during Jetting Based on Near-Field Computer Vision , 2019, Sensors.

[19]  Prithvish Mamtora,et al.  FIRE FIGHTING ROBOT , 2013 .

[20]  P Anantha Raj,et al.  Internet of Robotic Things Based Autonomous Fire Fighting Mobile Robot , 2018, 2018 IEEE International Conference on Computational Intelligence and Computing Research (ICCIC).

[21]  Albert W. Jones,et al.  Research Roadmap for Smart Fire Fighting , 2015 .