Saliency Driven Video Motion Magnification

The main goal of the proposed work is to detect certain spatial and temporal changes in videos that are not visible to the human eye and magnify them in order to make them perceptible while making sure that the background noise is not amplified. We apply Eulerian motion magnification on only the salient area of each frame of the video. The salient object is processed independent of the rest of the image using alpha matting aided by scribbles. We demonstrate the need to isolate the salient object from background motions and propose a simple and efficient way to do so. The proposed algorithm is tested on videos with imperceptible motion along with background motion to illustrate the significance of the proposed method. We compare the proposed method with linear and phase based Eulerian motion magnification techniques.

[1]  Silvia L. Pintea,et al.  Video Acceleration Magnification , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Shanmuganathan Raman,et al.  Automatic video matting through scribble propagation , 2016, ICVGIP '16.

[3]  Frédo Durand,et al.  Eulerian video magnification for revealing subtle changes in the world , 2012, ACM Trans. Graph..

[4]  Samarth Bharadwaj,et al.  Computationally Efficient Face Spoofing Detection with Motion Magnification , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[5]  Julian F. P. Kooij,et al.  Depth-Aware Motion Magnification , 2016, ECCV.

[6]  Kan Hong,et al.  Classification of emotional stress and physical stress using facial imaging features , 2016 .

[7]  Frédo Durand,et al.  Video magnification in presence of large motions , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Sébastien Marcel,et al.  Finger vein liveness detection using motion magnification , 2015, 2015 IEEE 7th International Conference on Biometrics Theory, Applications and Systems (BTAS).

[9]  Derek Nowrouzezahrai,et al.  Learning hatching for pen-and-ink illustration of surfaces , 2012, TOGS.

[10]  Frédo Durand,et al.  Phase-based video motion processing , 2013, ACM Trans. Graph..

[11]  Frédo Durand,et al.  Detecting Pulse from Head Motions in Video , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Michael Cohen,et al.  The cartoon animation filter , 2006, SIGGRAPH 2006.

[13]  Yong Man Ro,et al.  Subtle Facial Expression Recognition Using Adaptive Magnification of Discriminative Facial Motion , 2015, ACM Multimedia.

[14]  A. Torralba,et al.  Motion magnification , 2005, SIGGRAPH 2005.

[15]  Bing Li,et al.  Salient Object Detection via Structured Matrix Decomposition. , 2016, IEEE transactions on pattern analysis and machine intelligence.

[16]  Peter Xiaoping Liu,et al.  Using Eulerian video magnification framework to measure pulse transit time , 2014, 2014 IEEE International Symposium on Medical Measurements and Applications (MeMeA).

[17]  Frédo Durand,et al.  Riesz pyramids for fast phase-based video magnification , 2014, 2014 IEEE International Conference on Computational Photography (ICCP).