EPD Similarity Measure and Demons Algorithm for Object-Based Motion Estimation

Reduction of the temporal redundancies among frames, which can be achieved by the proper motion-compensated prediction, is the key to efficient video compression. Image registration is a technique, which can be exploited to find the motion between the frames. As the motion of an individual scene in a frame is varying across time, it is important to find the motion of the individual object for efficient motion-compensated prediction instead of finding the global motion in a video frame as has been used in the video coding literature. In this paper, we propose a motion estimation technique for video coding that estimates the correct motion of the individual object rather than estimating the motion of the combination of objects in the frame. This method adopts a registration technique using a new edge position difference (EPD) similarity measure to separate the region of individual objects in the frame. Then we apply either EPD-based registration or the Demons registration algorithm to estimate the true motion of each object in the frame. Experimental results show that the proposed EPD-Demons registration algorithm achieves superior motion-compensated prediction of a frame when compared to the global motion estimation-based approach.

[1]  Emile A. Hendriks,et al.  Confidence Estimation for Medical Image Registration Based On Stereo Confidences , 2016, IEEE Transactions on Medical Imaging.

[2]  Tom Ward,et al.  Image-assisted non-invasive and dynamic biomechanical analysis of human joints. , 2013, Physics in medicine and biology.

[3]  Nicholas Ayache,et al.  Symmetric Log-Domain Diffeomorphic Registration: A Demons-Based Approach , 2008, MICCAI.

[4]  Yao Zhao,et al.  Control-Point Representation and Differential Coding Affine-Motion Compensation , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Mark R. Pickering,et al.  Fast and Robust Multi-Modal Image Registration for 3D Knee Kinematics , 2017, 2017 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[6]  Thomas Sikora,et al.  Adaptive Global Motion Temporal Filtering for High Efficiency Video Coding , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  A. Ben Hamza,et al.  An information-theoretic method for multimodality medical image registration , 2012, Expert Syst. Appl..

[8]  Mark R. Pickering,et al.  Segmentation and reconstruction of cervical muscles using knowledge-based grouping adaptation and new step-wise registration with discrete cosines , 2019, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[9]  J. Chu,et al.  Evaluation of four volume-based image registration algorithms. , 2009, Medical dosimetry : official journal of the American Association of Medical Dosimetrists.

[10]  Mark R. Pickering A new similarity measure for multi-modal image registration , 2011, 2011 18th IEEE International Conference on Image Processing.

[11]  Jonathan Nissanov,et al.  Elastic 3-D alignment of rat brain histological images , 2003, IEEE Transactions on Medical Imaging.

[12]  João Manuel R S Tavares,et al.  Medical image registration: a review , 2014, Computer methods in biomechanics and biomedical engineering.

[13]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[14]  Frédéric Dufaux,et al.  Efficient, robust, and fast global motion estimation for video coding , 2000, IEEE Trans. Image Process..

[15]  Gunilla Borgefors,et al.  Hierarchical Chamfer Matching: A Parametric Edge Matching Algorithm , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Mark R. Pickering,et al.  Object-Based Motion Estimation Using the EPD Similarity Measure , 2018, 2018 Picture Coding Symposium (PCS).

[17]  Gunilla Borgefors,et al.  Distance transformations in digital images , 1986, Comput. Vis. Graph. Image Process..

[18]  Karl J. Friston,et al.  Spatial registration and normalization of images , 1995 .

[19]  Mark R. Pickering,et al.  Atlas-based segmentation of neck muscles from MRI for the characterisation of Whiplash Associated Disorder , 2016, International Conference on Digital Image Processing.

[20]  Guy B. Williams,et al.  A New Fast Accurate Nonlinear Medical Image Registration Program Including Surface Preserving Regularization , 2014, IEEE Transactions on Medical Imaging.

[21]  Jean-Philippe Thirion,et al.  Image matching as a diffusion process: an analogy with Maxwell's demons , 1998, Medical Image Anal..

[22]  Mark R. Pickering,et al.  Video Coding Using Elastic Motion Model and Larger Blocks , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  Abdessalam Benzinou,et al.  Geodesics-Based Image Registration: Applications To Biological And Medical Images Depicting Concentric Ring Patterns , 2013, IEEE Transactions on Image Processing.

[24]  Nassir Navab,et al.  Entropy and Laplacian images: Structural representations for multi-modal registration , 2012, Medical Image Anal..

[25]  Paul Suetens,et al.  Comparative evaluation of multiresolution optimization strategies for multimodality image registration by maximization of mutual information , 1999, Medical Image Anal..

[26]  Tom Vercauteren,et al.  Diffeomorphic demons: Efficient non-parametric image registration , 2009, NeuroImage.

[27]  Mark R. Pickering,et al.  Registration of multi-sensor remote sensing imagery by gradient-based optimization of cross-cumulative residual entropy , 2008, SPIE Defense + Commercial Sensing.