Subtle Motion Analysis and Spotting using the Riesz Pyramid

Analyzing and temporally spotting motions which are almost invisible to the human eye might reveal interesting information about the world. However, detecting these events is difficult due to their short duration and low intensities. Taking inspiration from video magnification techniques, we design a workflow for analyzing and temporally spotting subtle motions based on the Riesz pyramid. In addition, we propose a filtering and masking scheme that segments motions of interest without producing undesired artifacts or delays. In order to be able to evaluate the spotting accuracy of our method, we introduce our own database containing videos of subtle motions. Experiments are carried out under different types and levels of noise. Finally, we show that our method is able to outperform other state of the art methods in this challenging task.

[1]  Frédo Durand,et al.  Quaternionic Representation of the Riesz Pyramid for Video Magnification , 2014 .

[2]  Frédo Durand,et al.  Detecting Pulse from Head Motions in Video , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Nuri Yilmazer,et al.  Application of Object Detection and Tracking Techniques for Unmanned Aerial Vehicles , 2015, Complex Adaptive Systems.

[4]  Matti Pietikäinen,et al.  Towards Reading Hidden Emotions: A Comparative Study of Spontaneous Micro-Expression Spotting and Recognition Methods , 2015, IEEE Transactions on Affective Computing.

[5]  Sungsoo Park,et al.  Subtle facial expression recognition using motion magnification , 2009, Pattern Recognit. Lett..

[6]  Frédo Durand,et al.  Riesz pyramids for fast phase-based video magnification , 2014, 2014 IEEE International Conference on Computational Photography (ICCP).

[7]  Thomas B. Moeslund,et al.  Improved pulse detection from head motions using DCT , 2014, 2014 International Conference on Computer Vision Theory and Applications (VISAPP).

[8]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[9]  Terry M. Peters,et al.  Motion magnification for endoscopic surgery , 2014, Medical Imaging.

[10]  Taha H. Rassem,et al.  Completed Local Ternary Pattern for Rotation Invariant Texture Classification , 2014, TheScientificWorldJournal.

[11]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[12]  Frédo Durand,et al.  Eulerian video magnification for revealing subtle changes in the world , 2012, ACM Trans. Graph..

[13]  Frédo Durand,et al.  Phase-based video motion processing , 2013, ACM Trans. Graph..

[14]  Frédo Durand,et al.  Motion magnification , 2005, ACM Trans. Graph..

[15]  Samarth Bharadwaj,et al.  Computationally Efficient Face Spoofing Detection with Motion Magnification , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[16]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  KimDaijin,et al.  Subtle facial expression recognition using motion magnification , 2009 .

[18]  Sébastien Marcel,et al.  Finger vein liveness detection using motion magnification , 2015, 2015 IEEE 7th International Conference on Biometrics Theory, Applications and Systems (BTAS).

[19]  Frédo Durand,et al.  Modal identification of simple structures with high-speed video using motion magnification , 2015 .

[20]  Dimitri Van De Ville,et al.  Multiresolution Monogenic Signal Analysis Using the Riesz–Laplace Wavelet Transform , 2009, IEEE Transactions on Image Processing.

[21]  Sung Yong Shin,et al.  General Construction of Time-Domain Filters for Orientation Data , 2002, IEEE Trans. Vis. Comput. Graph..