Fast spatio-temporal digital paths video filter

This paper describes a novel fast 3D filtering technique for enhancement of color video sequences using digital paths created on the image grid extended to a spatio-temporal domain. Numerous modifications improved impulsive noise filtering efficiency and cope with video artifacts such as Gaussian, impulsive and grain noise and still preserves and even enhances edges. It can even remove block compression artifacts and video flickering. Simulations show that it performs well under PSNR and SSIM metrics. It gives particularly good results for mixed Gaussian and impulse noise—PSNR is approximately 3 dB better than VMF3D and my previous spatial filters. The new algorithm allows video processing in real time for low resolution images; in the preliminary simulations, the processing rate of over 50 fps for the CIF (CIF standard: 352 $$\times$$× 288 pixel) video sequences was obtained.

[1]  Zhou Wang,et al.  Video Denoising Based on a Spatiotemporal Gaussian Scale Mixture Model , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  L. McMillan,et al.  Video enhancement using per-pixel virtual exposures , 2005, SIGGRAPH 2005.

[3]  Konstantinos N. Plataniotis,et al.  Adaptive fuzzy systems for multichannel signal processing , 1999, Proc. IEEE.

[4]  Marek Szczepanski.  Spatio-Temporal Filters in Video Stream Processing , 2011, Computer Recognition Systems 4.

[5]  J. Astola,et al.  Vector median filters , 1990, Proc. IEEE.

[6]  Konstantinos N. Plataniotis,et al.  On the distance function approach to color image enhancement , 2004, Discret. Appl. Math..

[7]  Volodymyr I. Ponomaryov,et al.  Fuzzy Directional (FD) Filter for impulsive noise reduction in colour video sequences , 2012, J. Vis. Commun. Image Represent..

[8]  O. Cuisenaire.  Distance transformations: fast algorithms and applications to medical image processing , 1999 .

[9]  Konstantinos N. Plataniotis,et al.  Self-adaptive algorithm of impulsive noise reduction in color images , 2002, Pattern Recognit..

[10]  Jean-Michel Morel,et al.  Nonlocal Image and Movie Denoising , 2008, International Journal of Computer Vision.

[11]  Konstantinos N. Plataniotis,et al.  Fast Modified Vector Median Filter , 2001, CAIP.

[12]  Marek Szczepanski.  Spatio-Temporal Fuzzy FDPA Filter , 2011, CAIP.

[13]  Abderrahim Elmoataz,et al.  Nonlocal video denoising, simplification and inpainting using discrete regularization on graphs , 2010, Signal Process..

[14]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[15]  Konstantinos N. Plataniotis,et al.  Fuzzy adaptive filters for multichannel image processing , 1996, Signal Process..

[16]  Konstantinos N. Plataniotis,et al.  On the geodesic paths approach to color image filtering , 2003, Signal Process..

[17]  Konrad W. Wojciechowski,et al.  Random walk approach to image enhancement , 2001, Signal Process..

[18]  Hassan A. Kingravi,et al.  Nonlinear vector filtering for impulsive noise removal from color images , 2007, J. Electronic Imaging.

[19]  Konstantinos N. Plataniotis,et al.  Color image processing using adaptive multichannel filters , 1997, IEEE Trans. Image Process..

[20]  Bogdan Smolka,et al.  Peer group switching filter for impulse noise reduction incolor images , 2010, Pattern Recognit. Lett..

[21]  Eric Dubois,et al.  Noise Reduction in Image Sequences Using Motion-Compensated Temporal Filtering , 1984, IEEE Trans. Commun..

[22]  J. Schwartz,et al.  Theory of Self-Reproducing Automata , 1967 .

[23]  Karen O. Egiazarian,et al.  Nonlocal Transform-Domain Filter for Volumetric Data Denoising and Reconstruction , 2013, IEEE Transactions on Image Processing.

[24]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[25]  Volodymyr I. Ponomaryov,et al.  Fuzzy 3D filter for color video sequences contaminated by impulsive noise , 2012, Journal of Real-Time Image Processing.

[26]  Jean-Michel Morel,et al.  Non-Local Means Denoising , 2011, Image Process. Line.

[27]  Konrad W. Wojciechowski,et al.  Random walk approach to image enhancement , 1999, Proceedings 10th International Conference on Image Analysis and Processing.

[28]  Marek Szczepanski.  Spatio-temporal Digital Path Approach to Video Enhancement , 2014, IP&C.

[29]  Pekka J. Toivanen,et al.  Erratum to "New geodesic distance transforms for gray-scale images" [Pattern Recognition Letters 17 (1996) 437-450] , 1996, Pattern Recognit. Lett..

[30]  Karen O. Egiazarian,et al.  Video Denoising, Deblocking, and Enhancement Through Separable 4-D Nonlocal Spatiotemporal Transforms , 2012, IEEE Transactions on Image Processing.

[31]  Jürgen Pandel.  Measuring of Flickering Artifacts in Predictive Coded Video Sequences , 2008, 2008 Ninth International Workshop on Image Analysis for Multimedia Interactive Services.

[32]  Bogdan Smolka,et al.  Trimmed Non-local Means Technique for Mixed Noise Removal in Color Images , 2013, 2013 IEEE International Symposium on Multimedia.