Object-Oriented Motion Estimation using Edge-Based Image Registration

Video data storage and transmission cost can be reduced by minimizing the temporally redundant information among frames using an appropriate motion-compensated prediction technique. In the current video coding standard, the neighbouring frames are exploited to predict the motion of the current frame using global motion estimation-based approaches. However, the global motion estimation of a frame may not produce the actual motion of individual objects in the frame as each of the objects in a frame usually has its own motion. In this paper, an edge-based motion estimation technique is presented that finds the motion of each object in the frame rather than finding the global motion of that frame. In the proposed method, edge position difference (EPD) similarity measure-based image registration between the two frames is applied to register each object in the frame. A superpixel search is then applied to segment the registered object. Finally, the proposed edge-based image registration technique and Demons algorithm are applied to predict the objects in the current frame. Our experimental analysis demonstrates that the proposed algorithm can estimate the motions of individual objects in the current frame accurately compared to the existing global motion estimation-based approaches.

[1]  Jonathan Nissanov,et al.  Elastic 3-D alignment of rat brain histological images , 2003, IEEE Transactions on Medical Imaging.

[2]  Guy B. Williams,et al.  A New Fast Accurate Nonlinear Medical Image Registration Program Including Surface Preserving Regularization , 2014, IEEE Transactions on Medical Imaging.

[3]  Mark R. Pickering,et al.  EPD Similarity Measure and Demons Algorithm for Object-Based Motion Estimation , 2018, 2018 Digital Image Computing: Techniques and Applications (DICTA).

[4]  Nassir Navab,et al.  Entropy and Laplacian images: Structural representations for multi-modal registration , 2012, Medical Image Anal..

[5]  Abdessalam Benzinou,et al.  Geodesics-Based Image Registration: Applications To Biological And Medical Images Depicting Concentric Ring Patterns , 2013, IEEE Transactions on Image Processing.

[6]  Gunilla Borgefors,et al.  Hierarchical Chamfer Matching: A Parametric Edge Matching Algorithm , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Mark R. Pickering,et al.  Segmentation and reconstruction of cervical muscles using knowledge-based grouping adaptation and new step-wise registration with discrete cosines , 2019, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[8]  Tom Ward,et al.  Image-assisted non-invasive and dynamic biomechanical analysis of human joints. , 2013, Physics in medicine and biology.

[9]  A. Ben Hamza,et al.  An information-theoretic method for multimodality medical image registration , 2012, Expert Syst. Appl..

[10]  Mark R. Pickering,et al.  Registration of multi-sensor remote sensing imagery by gradient-based optimization of cross-cumulative residual entropy , 2008, SPIE Defense + Commercial Sensing.

[11]  Mark R. Pickering A new similarity measure for multi-modal image registration , 2011, 2011 18th IEEE International Conference on Image Processing.

[12]  Mark R. Pickering,et al.  Object-Based Motion Estimation Using the EPD Similarity Measure , 2018, 2018 Picture Coding Symposium (PCS).

[13]  Mark R. Pickering,et al.  Inter-Subject Image Registration of Clinical Neck MRI Volumes using Discrete Periodic Spline Wavelet and Free form Deformation , 2018, 2018 Digital Image Computing: Techniques and Applications (DICTA).

[14]  Mark R. Pickering,et al.  Fast and Robust Multi-Modal Image Registration for 3D Knee Kinematics , 2017, 2017 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[15]  Mark R. Pickering,et al.  Video Coding Using Elastic Motion Model and Larger Blocks , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Gunilla Borgefors,et al.  Distance transformations in digital images , 1986, Comput. Vis. Graph. Image Process..

[17]  Karl J. Friston,et al.  Spatial registration and normalization of images , 1995 .

[18]  Mark R. Pickering,et al.  Atlas-based segmentation of neck muscles from MRI for the characterisation of Whiplash Associated Disorder , 2016, International Conference on Digital Image Processing.

[19]  Jean-Philippe Thirion,et al.  Image matching as a diffusion process: an analogy with Maxwell's demons , 1998, Medical Image Anal..