Interest Region Based Motion Magnification

In this paper, we proposed a method known as interest region based motion magnification for amplification of invisible motions. This method enables one to magnify subtle motion in the video for specific objects of interest to the user. To achieve this task, we have used object extraction using kernel K-means approach, automatic scribble drawing using super pixels and Bezier curves, alpha matting, and Eulerian motion magnification. The proposed method is tested on previously used video sequences for motion magnification and our own new videos with large background motion. We show the effectiveness of the proposed method by comparing with Eulerian motion magnification technique. We have presented visual results and performed no-reference video quality assessment for original videos and motion magnified videos. We further discuss the future improvements for motion magnification applications.

[1]  Frédo Durand,et al.  Eulerian video magnification for revealing subtle changes in the world , 2012, ACM Trans. Graph..

[2]  Shanmuganathan Raman,et al.  Automatic video matting through scribble propagation , 2016, ICVGIP '16.

[3]  Frédo Durand,et al.  Phase-based video motion processing , 2013, ACM Trans. Graph..

[4]  Christophe Charrier,et al.  Blind Prediction of Natural Video Quality , 2014, IEEE Transactions on Image Processing.

[5]  Frédo Durand,et al.  Video magnification in presence of large motions , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Frédo Durand,et al.  Riesz pyramids for fast phase-based video magnification , 2014, 2014 IEEE International Conference on Computational Photography (ICCP).

[7]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Kiran B. Raja,et al.  Video Presentation Attack Detection in Visible Spectrum Iris Recognition Using Magnified Phase Information , 2015, IEEE Transactions on Information Forensics and Security.

[9]  Julian F. P. Kooij,et al.  Depth-Aware Motion Magnification , 2016, ECCV.

[10]  Derek Nowrouzezahrai,et al.  Learning hatching for pen-and-ink illustration of surfaces , 2012, TOGS.

[11]  Michael Cohen,et al.  The cartoon animation filter , 2006, SIGGRAPH 2006.

[12]  Frédo Durand,et al.  Visual vibrometry: Estimating material properties from small motions in video , 2015, CVPR.

[13]  Samarth Bharadwaj,et al.  Computationally Efficient Face Spoofing Detection with Motion Magnification , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[14]  Ismail Ben Ayed,et al.  Secrets of GrabCut and Kernel K-Means , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[15]  Terry M. Peters,et al.  Motion magnification for endoscopic surgery , 2014, Medical Imaging.

[16]  Dani Lischinski,et al.  A Closed-Form Solution to Natural Image Matting , 2008 .

[17]  A. Torralba,et al.  Motion magnification , 2005, SIGGRAPH 2005.

[18]  Frédo Durand,et al.  Deviation magnification , 2015, ACM Trans. Graph..

[19]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).