Anatomical Landmark Tracking by One-shot Learned Priors for Augmented Active Appearance Models

For animal bipedal locomotion analysis, an immense amount of recorded image data has to be evaluated by biological experts. During this time-consuming evaluation single anatomical landmarks have to be annotated in each image. In this paper we reduce this effort by automating the annotation with a minimum level of user interaction. Recent approaches, based on Active Appearance Models, are improved by priors based on anatomical knowledge and an online tracking method, requiring only a single labeled frame. However, the limited search space of the online tracker can lead to a template drift in case of severe self-occlusions. In contrast, we propose a one-shot learned tracking-by-detection prior which overcomes the shortcomings of template drifts without increasing the number of training data. We evaluate our approach based on a variety of real-world X-ray locomotion datasets and show that our method outperforms recent state-of-the-art concepts for the task at hand.

[1]  Joachim Denzler,et al.  Interactive Image Retrieval for Biodiversity Research , 2015, GCPR.

[2]  Reinhard Blickhan,et al.  Adjustments of global and local hindlimb properties during terrestrial locomotion of the common quail (Coturnix coturnix) , 2013, Journal of Experimental Biology.

[3]  Tahir Nawaz,et al.  PETS 2015: Datasets and challenge , 2015, 2015 12th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[4]  Joachim Denzler,et al.  Accurate 3D Multi-marker Tracking in X-ray Cardiac Sequences Using a Two-Stage Graph Modeling Approach , 2013, CAIP.

[5]  Afshin Dehghan,et al.  GMMCP tracker: Globally optimal Generalized Maximum Multi Clique problem for multiple object tracking , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  D. Kendall SHAPE MANIFOLDS, PROCRUSTEAN METRICS, AND COMPLEX PROJECTIVE SPACES , 1984 .

[7]  Avian bipedal locomotion , 2012 .

[8]  Bernt Schiele,et al.  Monocular 3D pose estimation and tracking by detection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Jitendra Malik,et al.  Discriminative Decorrelation for Clustering and Classification , 2012, ECCV.

[10]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[11]  Joachim Denzler,et al.  Anatomical Landmark Tracking for the Analysis of Animal Locomotion in X-ray Videos Using Active Appearance Models , 2011, SCIA.

[12]  Milan Sonka,et al.  Multi-view active appearance models for consistent segmentation of multiple standard views: application to long and short-axis cardiac MR images , 2003, CARS.

[13]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Ramakant Nevatia,et al.  Global data association for multi-object tracking using network flows , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Xiaogang Wang,et al.  Deep Convolutional Network Cascade for Facial Point Detection , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  D Haase,et al.  Automated approximation of center of mass position in X-ray sequences of animal locomotion. , 2013, Journal of biomechanics.

[18]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[19]  Joachim Denzler,et al.  Robust pictorial structures for x-ray animal skeleton tracking , 2014, 2014 International Conference on Computer Vision Theory and Applications (VISAPP).

[20]  Pascal Fua,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence 1 Multiple Object Tracking Using K-shortest Paths Optimization , 2022 .

[21]  Joachim Denzler,et al.  Multi-view Active Appearance Models for the X-Ray Based Analysis of Avian Bipedal Locomotion , 2011, DAGM-Symposium.

[22]  Yuning Jiang,et al.  Extensive Facial Landmark Localization with Coarse-to-Fine Convolutional Network Cascade , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[23]  Joachim Denzler,et al.  2D and 3D analysis of animal locomotion from biplanar X-ray videos using augmented active appearance models , 2013, EURASIP J. Image Video Process..

[24]  Joachim Denzler,et al.  Fast and Robust Landmark Tracking in X-ray Locomotion Sequences Containing Severe Occlusions , 2012, VMV.

[25]  Timothy F. Cootes,et al.  Active Appearance Models , 1998, ECCV.