Edge-Aware Spatial Filtering-Based Motion Magnification

In this paper, we present a novel approach toward motion magnification using edge-aware filtering. Edge-aware filters have been used for applications such as image denoising, enhancement, and tone mapping. In this work, we have used fast local Laplacian filter followed by Eulerian motion magnification for enhancement of subtle changes in the video. The proposed method aims to reduce the noise and artifacts in the output video apart from motion magnification. Experiments are conducted on sample videos having minute changes which are imperceptible to see with the human eyes. A no-reference video quality assessment has been employed using a video quality score in order to quantify the motion magnification results.

[1]  Frédo Durand,et al.  Fast Local Laplacian Filters , 2014, ACM Trans. Graph..

[2]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[3]  Markus H. Gross,et al.  Phase-Based Modification Transfer for Video , 2016, ECCV.

[4]  Terry M. Peters,et al.  Motion magnification for endoscopic surgery , 2014, Medical Imaging.

[5]  A. Torralba,et al.  Motion magnification , 2005, SIGGRAPH 2005.

[6]  Jan Kautz,et al.  Local Laplacian filters , 2015, Commun. ACM.

[7]  Max Grosse,et al.  Phase-based frame interpolation for video , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Cordelia Schmid,et al.  EpicFlow: Edge-preserving interpolation of correspondences for optical flow , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Frédo Durand,et al.  Eulerian video magnification for revealing subtle changes in the world , 2012, ACM Trans. Graph..

[10]  Frédo Durand,et al.  Video magnification in presence of large motions , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Michael Cohen,et al.  The cartoon animation filter , 2006, SIGGRAPH 2006.

[12]  Frédo Durand,et al.  Detecting Pulse from Head Motions in Video , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Ghassan Hamarneh,et al.  Auto Localization and Segmentation of Occluded Vessels in Robot-Assisted Partial Nephrectomy , 2014, MICCAI.

[14]  Frédo Durand,et al.  Deviation magnification , 2015, ACM Trans. Graph..

[15]  Julian F. P. Kooij,et al.  Depth-Aware Motion Magnification , 2016, ECCV.

[16]  Hans-Peter Seidel,et al.  Real-time temporal shaping of high-speed video streams , 2010, Comput. Graph..

[17]  Frédo Durand,et al.  Phase-based video motion processing , 2013, ACM Trans. Graph..

[18]  Christophe Charrier,et al.  Blind Prediction of Natural Video Quality , 2014, IEEE Transactions on Image Processing.

[19]  Nasir A Aziz,et al.  A microscope for subtle movements in clinical neurology , 2015, Neurology.

[20]  Frédo Durand,et al.  Riesz pyramids for fast phase-based video magnification , 2014, 2014 IEEE International Conference on Computational Photography (ICCP).

[21]  Silvia L. Pintea,et al.  Making a Case for Learning Motion Representations with Phase , 2016, ECCV Workshops.