A Masking Model for Motion Sharpening Phenomenon in Video Sequences

In this paper, we show that motion sharpening phenomenon can be explained as a form of visual masking for a special case where a video sequence is composed of alternate frames with different level of sharpness. A frame of higher sharpness behaves to mask the ambiguity of a subsequent frame of lower sharpness and hence preserves the perceptive quality of the whole sequence. Borrowing the mechanism for visual masking, we formulated a quantitative model for deriving the minimum spatial frequency conditions which preserves the subjective quality of the frames being masked. The quantitative model takes into account three fundamental properties of the video signals, namely the size of motion, average luminance and the power of each frequency components. The psychophysical responses towards the changes of these properties are obtained through subjective assessment tests using video sequences of simple geometrical patterns. Subjective experiments on natural video sequences show that more than 75% of viewers could make no distinction between the original sequence and the one processed using the quantitative model.

[1]  Gillian S. Barbieri-Hesse,et al.  Motion sharpening and contrast: Gain control precedes compressive non-linearity? , 2003, Vision Research.

[2]  B. H. Crawford.  Visual adaptation in relation to brief conditioning stimuli , 1947, Proceedings of the Royal Society of London. Series B - Biological Sciences.

[3]  R. Hess,et al.  Temporal detection in human vision: dependence on stimulus energy. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[4]  M. Georgeson,et al.  Motion blur and motion sharpening: temporal smear and local contrast non-linearity , 1998, Vision Research.

[5]  Karen K. De Valois,et al.  Sharpening image motion based on the spatio-temporal characteristics of human vision , 2005, IS&T/SPIE Electronic Imaging.

[6]  B G Breitmeyer,et al.  Implications of sustained and transient channels for theories of visual pattern masking, saccadic suppression, and information processing. , 1976, Psychological review.

[7]  J. Bergen,et al.  A four mechanism model for threshold spatial vision , 1979, Vision Research.

[8]  J. Robson,et al.  Application of fourier analysis to the visibility of gratings , 1968, The Journal of physiology.

[9]  Tatsuto Takeuchi,et al.  Modulation of perceived contrast by a moving surround , 2000, Vision Research.

[10]  M. Georgeson,et al.  Seeing blur: ‘motion sharpenin’ without motion , 2002, Proceedings of the Royal Society of London. Series B: Biological Sciences.