Video motion magnification for monitoring of vital signals using a perceptual model

In this paper we present an Eulerian motion magnification technique using a spatial decomposition based on the Steered Hermite Transform (SHT) which is inspired in the Human Vision System (HVS). We test our method in one sequence of the breathing of a newborn baby and on a video sequence that shows the heartbeat on the wrist. We estimate the heart pulse applying the Fourier transform on the magnified sequences. Our motion magnification approach is compared to the Laplacian and the Cartesian Hermite decomposition strategies by means of quantitative metrics.

[1]  Jean-Bernard Martens,et al.  Image representation and compression with steered Hermite transforms , 1997, Signal Process..

[2]  Boris Escalante-Ramírez,et al.  Motion magnification using the Hermite transform , 2015, Symposium on Medical Information Processing and Analysis.

[3]  Frédo Durand,et al.  Riesz pyramids for fast phase-based video magnification , 2014, 2014 IEEE International Conference on Computational Photography (ICCP).

[4]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[5]  Rosalind W. Picard,et al.  Non-contact, automated cardiac pulse measurements using video imaging and blind source separation , 2022 .

[6]  Frédo Durand,et al.  Detecting Pulse from Head Motions in Video , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Jeffrey A. Bloom,et al.  A Gaussian derivative-based transform , 1996, IEEE Trans. Image Process..

[8]  Jean-Bernard Martens.  The Hermite transform-applications , 1990, IEEE Trans. Acoust. Speech Signal Process..

[9]  José Luis Silván-Cárdenas,et al.  The multiscale Hermite transform for local orientation analysis , 2006, IEEE Transactions on Image Processing.

[10]  Rama Chellappa,et al.  A generalized motion model for estimating optical flow using 3-D Hermite polynomials , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[11]  Sungsoo Park,et al.  Subtle facial expression recognition using motion magnification , 2009, Pattern Recognit. Lett..

[12]  Jean-Bernard Martens,et al.  The Hermite transform-theory , 1990, IEEE Trans. Acoust. Speech Signal Process..

[13]  Frédo Durand,et al.  Quaternionic Representation of the Riesz Pyramid for Video Magnification , 2014 .

[14]  Sabine Van Huffel,et al.  Automated Respiration Detection from Neonatal Video Data , 2015, ICPRAM.

[15]  Frédo Durand,et al.  Eulerian video magnification for revealing subtle changes in the world , 2012, ACM Trans. Graph..

[16]  Frédo Durand,et al.  Phase-based video motion processing , 2013, ACM Trans. Graph..

[17]  A. Torralba,et al.  Motion magnification , 2005, SIGGRAPH 2005.

[18]  H. Barlow,et al.  A model for the economical encoding of the visual image in cerebral cortex , 2004, Biological Cybernetics.