DCT coefficients generation model for film grain noise and its application in super-resolution

Film grain noise (FGN) is generated by the procedure of capturing pictures using photographic film. Images with FGN are subjectively pleasing. However, FGN is difficult to compress and its pleasant features are difficult to preserve when the images are resized. So in literature, FGN is extracted first, then regenerated for the processed noise-free images. In this paper a new method is proposed to generate FGN. In contrast to some other models which generate FGN in spatial domain, our method captures the statistic feature of FGN in frequency domain. FGN is signal dependent and the signal independent scaled noise image (SNI) is obtained by scaling FGN by corresponding noise-free image. We model each discrete cosine transform (DCT) coefficient of SNI as a Gaussian random variable. The Gaussian model parameters can be estimated from the stack of all the blocks in SNI based on stationary assumption. Experimental results show that proposed model recovers FGN with similar visual and spectrum properties to the original FGN. We also apply proposed model in superresolution and the quality of resultant images are improved.

[1]  Dimitrios Hatzinakos,et al.  Signal-dependent film grain noise removal and generation based on higher-order statistics , 1997, Proceedings of the IEEE Signal Processing Workshop on Higher-Order Statistics.

[2]  Ian Stephenson,et al.  Simulating Film Grain using the Noise-Power Spectrum , 2007, TPCG.

[3]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[4]  Luhong Liang,et al.  Fast single frame super-resolution using perceptual visibility optimization , 2014, 2014 IEEE International Symposium on Circuits and Systems (ISCAS).

[5]  C.-C. Jay Kuo,et al.  Advanced Film Grain Noise Extraction and Synthesis for High-Definition Video Coding , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Oscar C. Au,et al.  Film grain noise removal and synthesis in video coding , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[7]  Edmund Y. Lam,et al.  Fast single frame super-resolution using scale-invariant self-similarity , 2013, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).

[8]  Dimitrios Hatzinakos,et al.  Signal-dependent film grain noise generation using homomorphic adaptive filtering , 2000 .