A review of missing video frame estimation techniques for their suitability analysis in NPP

Abstract The application of video processing techniques are useful for the safety of nuclear power plants by tracking the people online on video to estimate the dose received by staff during work in nuclear plants. Nuclear reactors remotely visually controlled to evaluate the plant's condition using video processing techniques. Internal reactor components should be frequently inspected but in current scenario however involves human technicians, who review inspection videos and identify the costly, time-consuming and subjective cracks on metallic surfaces of underwater components. In case, if any frame of the inspection video degraded/corrupted/missed due to noise or any other factor, then it may cause serious safety issue. The problem of missing/degraded/corrupted video frame estimation is a challenging problem till date. In this paper a systematic literature review on video processing techniques is carried out, to perform their suitability analysis for NPP applications. The limitation of existing approaches are also identified along with a roadmap to overcome these limitations.

[1]  Lei Zhang,et al.  Frame Rate Up-Conversion Using Trilateral Filtering , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Wensheng Zhang,et al.  The Twist Tensor Nuclear Norm for Video Completion , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[3]  Nima Khademi Kalantari,et al.  Deep Slow Motion Video Reconstruction With Hybrid Imaging System , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Wen Gao,et al.  Multiple Hypotheses Bayesian Frame Rate Up-Conversion by Adaptive Fusion of Motion-Compensated Interpolations , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Timothy K. Shih,et al.  Video Inpainting on Digitized Vintage Films via Maintaining Spatiotemporal Continuity , 2011, IEEE Transactions on Multimedia.

[6]  Qing Zhang,et al.  Video Background Completion Using Motion-Guided Pixel Assignment Optimization , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Wan-Chi Siu,et al.  Computationally scalable adaptive image interpolation algorithm using maximum-likelihood denoising for real-time applications , 2013, J. Electronic Imaging.

[8]  Manoranjan Paul,et al.  Virtual View Synthesis for Free Viewpoint Video and Multiview Video Compression using Gaussian Mixture Modelling , 2018, IEEE Transactions on Image Processing.

[9]  Philippe Robert,et al.  Multi-reference combinatorial strategy towards longer long-term dense motion estimation , 2016, Comput. Vis. Image Underst..

[10]  Dana H. Brooks,et al.  Electrical imaging of the heart , 1997, IEEE Signal Process. Mag..

[11]  Thomas S. Huang,et al.  Image and Video Restorations via Nonlocal Kernel Regression , 2013, IEEE Transactions on Cybernetics.

[12]  S. Kong,et al.  Frame-Based Recovery of Corrupted Video Files Using Video Codec Specifications , 2014, IEEE Transactions on Image Processing.

[13]  Ju Liu,et al.  A spatiotemporal super-resolution algorithm for a hybrid stereo video system , 2016, Signal Image Video Process..

[14]  Raj Rao Nadakuditi,et al.  Panoramic Robust PCA for Foreground–Background Separation on Noisy, Free-Motion Camera Video , 2017, IEEE Transactions on Computational Imaging.

[15]  Michael Blumenstein,et al.  Crowd Counting in Low-Resolution Crowded Scenes Using Region-Based Deep Convolutional Neural Networks , 2019, IEEE Access.

[16]  Li-Wei Kang,et al.  Temporally Coherent Superresolution of Textured Video via Dynamic Texture Synthesis , 2015, IEEE Transactions on Image Processing.

[17]  Aggelos K. Katsaggelos,et al.  Unequal Error Protection for Robust Streaming of Scalable Video Over Packet Lossy Networks , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Bo Yan,et al.  A Hybrid Frame Concealment Algorithm for H.264/AVC , 2010, IEEE Transactions on Image Processing.

[19]  Ting-Lan Lin,et al.  Improved interview video error concealment on whole frame packet loss , 2014, J. Vis. Commun. Image Represent..

[20]  Shahram Shirani,et al.  De-Interlacing Using Nonlocal Costs and Markov-Chain-Based Estimation of Interpolation Methods , 2013, IEEE Transactions on Image Processing.

[21]  Aggelos K. Katsaggelos,et al.  Digital image restoration , 2012, IEEE Signal Process. Mag..

[22]  Kwon Lee,et al.  High quality deinterlacing using content adaptive vertical temporal filtering , 2010, IEEE Transactions on Consumer Electronics.