Improved Real-Time Fire Warning System Based on Advanced Technologies for Visually Impaired People

Early fire detection and notification techniques provide fire prevention and safety information to blind and visually impaired (BVI) people within a short period of time in emergency situations when fires occur in indoor environments. Given its direct impact on human safety and the environment, fire detection is a difficult but crucial problem. To prevent injuries and property damage, advanced technology requires appropriate methods for detecting fires as quickly as possible. In this study, to reduce the loss of human lives and property damage, we introduce the development of the vision-based early flame recognition and notification approach using artificial intelligence for assisting BVI people. The proposed fire alarm control system for indoor buildings can provide accurate information on fire scenes. In our proposed method, all the processes performed manually were automated, and the performance efficiency and quality of fire classification were improved. To perform real-time monitoring and enhance the detection accuracy of indoor fire disasters, the proposed system uses the YOLOv5m model, which is an updated version of the traditional YOLOv5. The experimental results show that the proposed system successfully detected and notified the occurrence of catastrophic fires with high speed and accuracy at any time of day or night, regardless of the shape or size of the fire. Finally, we compared the competitiveness level of our method with that of other conventional fire-detection methods to confirm the seamless classification results achieved using performance evaluation matrices.

[1]  T. Whangbo,et al.  Attention 3D U-Net with Multiple Skip Connections for Segmentation of Brain Tumor Images , 2022, Sensors.

[2]  Fang Wang,et al.  A Small Target Forest Fire Detection Model Based on YOLOv5 Improvement , 2022, Forests.

[3]  Fengxi Zhang,et al.  Swin-YOLOv5: Research and Application of Fire and Smoke Detection Algorithm Based on YOLOv5 , 2022, Computational Intelligence and Neuroscience.

[4]  M. Mukhiddinov,et al.  Automatic Fire Detection and Notification System Based on Improved YOLOv4 for the Blind and Visually Impaired , 2022, Sensors.

[5]  Zhiguang Xu,et al.  Recent Advances in Sensors for Fire Detection , 2022, Sensors.

[6]  Mukhriddin Mukhiddinov,et al.  An improvement for the automatic classification method for ultrasound images used on CNN , 2021, Int. J. Wavelets Multiresolution Inf. Process..

[7]  Ugur Ayvaz,et al.  Automatic Speaker Recognition Using Mel-Frequency Cepstral Coefficients Through Machine Learning , 2022, Computers, Materials & Continua.

[8]  M. Mukhiddinov,et al.  Fire Detection Method in Smart City Environments Using a Deep-Learning-Based Approach , 2021, Electronics.

[9]  Y. Cho,et al.  Novel Video Surveillance-Based Fire and Smoke Classification Using Attentional Feature Map in Capsule Networks , 2021, Sensors.

[10]  A. Abdusalomov,et al.  LDA-Based Topic Modeling Sentiment Analysis Using Topic/Document/Sentence (TDS) Model , 2021, Applied Sciences.

[11]  M. Mukhiddinov,et al.  Smart Glass System Using Deep Learning for the Blind and Visually Impaired , 2021, Electronics.

[12]  Taeg Keun Whangbo,et al.  3D Volume Reconstruction from MRI Slices based on VTK , 2021, 2021 International Conference on Information and Communication Technology Convergence (ICTC).

[13]  Taeg Keun Whangbo,et al.  An Improvement of the Fire Detection and Classification Method Using YOLOv3 for Surveillance Systems , 2021, Sensors.

[14]  Shabir Ahmad,et al.  Towards Mountain Fire Safety Using Fire Spread Predictive Analytics and Mountain Fire Containment in IoT Environment , 2021, Sustainability.

[15]  Lin Cao,et al.  A Forest Fire Detection System Based on Ensemble Learning , 2021, Forests.

[16]  Sergio Saponara,et al.  Real-time video fire/smoke detection based on CNN in antifire surveillance systems , 2020, J. Real Time Image Process..

[17]  Taeg Keun Whangbo,et al.  Evolving Hierarchical and Tag Information via the Deeply Enhanced Weighted Non-Negative Matrix Factorization of Rating Predictions , 2020, Symmetry.

[18]  Young Im Cho,et al.  Automatic Fire and Smoke Detection Method for Surveillance Systems Based on Dilated CNNs , 2020, Atmosphere.

[19]  Nikolaos Grammalidis,et al.  Early Fire Detection Based on Aerial 360-Degree Sensors, Deep Convolution Neural Networks and Exploitation of Fire Dynamic Textures , 2020, Remote. Sens..

[20]  Young Im Cho,et al.  Improvement of the end-to-end scene text recognition method for "text-to-speech" conversion , 2020, Int. J. Wavelets Multiresolution Inf. Process..

[21]  Rag-Gyo Jeong,et al.  Saliency cuts: salient region extraction based on local adaptive thresholding for image information recognition of the visually impaired , 2020, Int. Arab J. Inf. Technol..

[22]  Wei Chen,et al.  A Fire Monitoring and Alarm System Based on YOLOv3 with OHEM , 2020, 2020 39th Chinese Control Conference (CCC).

[23]  Pu Li,et al.  Image fire detection algorithms based on convolutional neural networks , 2020, Case Studies in Thermal Engineering.

[24]  Taeg Keun Whangbo,et al.  Automatic Salient Object Extraction Based on Locally Adaptive Thresholding to Generate Tactile Graphics , 2020, Applied Sciences.

[25]  Hong-Yuan Mark Liao,et al.  YOLOv4: Optimal Speed and Accuracy of Object Detection , 2020, ArXiv.

[26]  Byoung Chul Ko,et al.  Two-Step Real-Time Night-Time Fire Detection in an Urban Environment Using Static ELASTIC-YOLOv3 and Temporal Fire-Tube , 2020, Sensors.

[27]  Taeg Keun Whangbo,et al.  Detection and Removal of Moving Object Shadows Using Geometry and Color Information for Indoor Video Streams , 2019 .

[28]  Jiashi Feng,et al.  PANet: Few-Shot Image Semantic Segmentation With Prototype Alignment , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[29]  Taeg Keun Whangbo,et al.  Fully Automatic Stroke Symptom Detection Method Based on Facial Features and Moving Hand Differences , 2019, 2019 International Symposium on Multimedia and Communication Technology (ISMAC).

[30]  Chen Chen,et al.  SmokeNet: Satellite Smoke Scene Detection Using Convolutional Neural Network with Spatial and Channel-Wise Attention , 2019, Remote. Sens..

[31]  Dong Wang,et al.  Long-Range Raman Distributed Fiber Temperature Sensor With Early Warning Model for Fire Detection and Prevention , 2019, IEEE Sensors Journal.

[32]  Mohamed Elhoseny,et al.  Efficient Fire Detection for Uncertain Surveillance Environment , 2019, IEEE Transactions on Industrial Informatics.

[33]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[34]  Taeg Keun Whangbo,et al.  An improvement for the foreground recognition method using shadow removal technique for indoor environments , 2017, Int. J. Wavelets Multiresolution Inf. Process..

[35]  Taeg Keun Whangbo,et al.  A Review on various widely used shadow detection methods to identify a shadow from image , 2016 .

[36]  Moulay A. Akhloufi,et al.  Automatic fire pixel detection using image processing: a comparative analysis of rule-based and machine learning-based methods , 2016, Signal Image Video Process..

[37]  A. Abdusalomov,et al.  Robust Shadow Removal Technique For Improving Image Enhancement Based On Segmentation Method , 2016 .

[38]  Qiang Wang,et al.  Large Space Fire Image Processing of Improving Canny Edge Detector Based on Adaptive Smoothing , 2010, 2010 International Conference on Innovative Computing and Communication and 2010 Asia-Pacific Conference on Information Technology and Ocean Engineering.

[39]  Dengyi Zhang,et al.  Contour Based Forest Fire Detection Using FFT and Wavelet , 2008, 2008 International Conference on Computer Science and Software Engineering.

[40]  Turgay Çelik,et al.  Fire detection using statistical color model in video sequences , 2007, J. Vis. Commun. Image Represent..