Event Dynamics Based Temporal Registration

Temporal registration is the establishment of correspondence between two (or more) temporal frames of video sequences, or 3-D volume data. In this paper, we propose to use event dynamics, a property that is inherent to an event and is thus common to all acquisitions of the event, for both global and local temporal registration of video sequences in order to generate high temporal resolution video. We compare our approach to a widely used linear interpolation based temporal registration algorithm and demonstrate that in the case of low temporal acquisition rate, a global event dynamics based approach, such as ours, has smaller temporal registration error. We also present a unique application of our work in solving 3-D (2D + time) high temporal resolution medical data visualization problem.

[1]  Maureen Stone,et al.  Dynamic programming method for temporal registration of three-dimensional tongue surface motion from multiple utterances , 2002, Speech Commun..

[2]  Anup Basu,et al.  Image Based Temporal Registration of MRI Data for Medical Visualization , 2006, 2006 International Conference on Image Processing.

[3]  Jitendra Malik,et al.  Recognizing action at a distance , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[4]  Shih-Fu Chang,et al.  Motion trajectory matching of video objects , 1999, Electronic Imaging.

[5]  G. Vachtsevanos,et al.  Dynamic autonomous agent placement for target tracking based on target motion models , 2005, Proceedings. 2005 IEEE Networking, Sensing and Control, 2005..

[6]  Tieniu Tan,et al.  Articulated model based people tracking using motion models , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[7]  Ajay Divakaran,et al.  Video browsing system based on compressed domain feature extraction , 2000, IEEE Trans. Consumer Electron..

[8]  Werner Moshage,et al.  Noninvasive Coronary Angiography by Retrospectively ECG-Gated Multislice Spiral CT , 2000, Circulation.

[9]  James W. Davis,et al.  Categorical representation and recognition of oscillatory motion patterns , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[10]  M. Irani,et al.  Spatio-Temporal Alignment of Sequences , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Patrick Pérez,et al.  Spatio-temporal Wiener filtering of image sequences using a parametric motion model , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[12]  Yongxia Zhou,et al.  Extraction of Temporal Information in , 2002 .

[13]  Richard B Thompson,et al.  Flow‐gated phase‐contrast MRI using radial acquisitions , 2004, Magnetic resonance in medicine.

[14]  Yaron Caspi,et al.  Under the supervision of , 2003 .

[15]  T. Gasser,et al.  Alignment of curves by dynamic time warping , 1997 .

[16]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[17]  Radford M. Neal,et al.  Multiple Alignment of Continuous Time Series , 2004, NIPS.

[18]  Jake K. Aggarwal,et al.  A new Bayesian relaxation framework for the estimation and segmentation of multiple motions , 2000, 4th IEEE Southwest Symposium on Image Analysis and Interpretation.

[19]  Oscar C. Au,et al.  Temporal interpolation of video sequences using zonal based algorithms , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[20]  Daniel Rueckert,et al.  Fast Spatio-temporal Free-Form Registration of Cardiac MR Image Sequences , 2005, FIMH.

[21]  Donald H. House,et al.  An integrated approach towards the representation, manipulation and reuse of pre-recorded motion , 2000, Proceedings Computer Animation 2000.

[22]  Martin A. Giese,et al.  Morphable Models for the Analysis and Synthesis of Complex Motion Patterns , 2000, International Journal of Computer Vision.

[23]  Eric Bruno,et al.  Video structuring, indexing and retrieval based on global motion wavelet coefficients , 2002, Object recognition supported by user interaction for service robots.

[24]  A.M. Tekalp,et al.  Multi-view spatial integration and tracking with Bayesian networks , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[25]  O M Weber,et al.  Evaluation of the anatomical and functional properties of deglutition with various kinetic high‐speed MRI sequences , 2001, Journal of magnetic resonance imaging : JMRI.

[26]  Ajay Divakaran,et al.  MPEG-7 visual motion descriptors , 2001, IEEE Trans. Circuits Syst. Video Technol..

[27]  C. Stiller,et al.  Parametric object motion estimation , 1992, [Proceedings] Singapore ICCS/ISITA `92.

[28]  J. Little,et al.  Describing motion for recognition , 1995, Proceedings of International Symposium on Computer Vision - ISCV.

[29]  Kuo-Chin Fan,et al.  A motion-flow-based fast video retrieval system , 2005, MIR '05.

[30]  Fatos T. Yarman-Vural,et al.  Morphing as a tool for motion modelling , 1999, Proceedings 10th International Conference on Image Analysis and Processing.

[31]  Anup Basu,et al.  Temporal Alignment of Time Varying MRI Datasets for High Resolution Medical Visualization , 2006, ISVC.

[32]  Harry Wechsler,et al.  Motion estimation using statistical learning theory , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Lihi Zelnik-Manor,et al.  Event-based analysis of video , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[34]  Narciso García,et al.  Region-based control points determination for multivector motion description , 2001, IEEE Trans. Circuits Syst. Video Technol..

[35]  Nuno Vasconcelos,et al.  A spatiotemporal motion model for video summarization , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[36]  Michael F. Cohen,et al.  Verbs and Adverbs: Multidimensional Motion Interpolation , 1998, IEEE Computer Graphics and Applications.

[37]  HongJiang Zhang,et al.  Motion texture: a new motion based video representation , 2002, Object recognition supported by user interaction for service robots.

[38]  Eric Dubois,et al.  Representation and estimation of motion using a dictionary of models , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[39]  Roberta Piroddi,et al.  A simple framework for spatio-temporal video segmentation and delayering using dense motion fields , 2006, IEEE Signal Processing Letters.

[40]  Richard B Thompson,et al.  High temporal resolution phase contrast MRI with multiecho acquisitions † , 2002, Magnetic resonance in medicine.

[41]  Alex Pentland,et al.  Pfinder: real-time tracking of the human body , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[42]  Patrick Pérez,et al.  Super-resolution from noisy image sequences exploiting a 2D parametric motion model , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.