A functional pipeline framework for landmark identification on 3D surface extracted from volumetric data

Landmarks, also known as feature points, are one of the important geometry primitives that describe the predominant characteristics of a surface. In this study we proposed a self-contained framework to generate landmarks on surfaces extracted from volumetric data. The framework is designed to be a three-fold pipeline structure. The pipeline comprises three phases which are surface construction, crest line extraction and landmark identification. With input as a volumetric data and output as landmarks, the pipeline takes in 3D raw data and produces a 0D geometry feature. In each phase we investigate existing methods, extend and tailor the methods to fit the pipeline design. The pipeline is designed to be functional as it is modularised to have a dedicated function in each phase. We extended the implicit surface polygonizer for surface construction in first phase, developed an alternative way to compute the gradient of maximal curvature for crest line extraction in second phase and finally we combine curvature information and K-means clustering method to identify the landmarks in the third phase. The implementations are firstly carried on a controlled environment, i.e. synthetic data, for proof of concept. Then the method is tested on a small scale data set and subsequently on huge data set. Issues and justifications are addressed accordingly for each phase.

[1]  Xin Liu,et al.  A Dynamic Extraction of Feature Points in Lip Regions Based on Color Statistic , 2015, ITITS.

[2]  John R. Hutchinson,et al.  Idealized landmark-based geometric reconstructionsof poorly preserved fossil material: A case study of an early tetrapod vertebra , 2012 .

[3]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[4]  Jim Austin,et al.  A Machine-Learning Approach to Keypoint Detection and Landmarking on 3D Meshes , 2012, International Journal of Computer Vision.

[5]  Olivier Monga,et al.  Using Partial Derivatives of 3D Images to Extract Typical Surface Features , 1995, Comput. Vis. Image Underst..

[6]  O. Monga,et al.  Using partial Derivatives of 3D images to extract typical surface features , 1992, Proceedings of the Third Annual Conference of AI, Simulation, and Planning in High Autonomy Systems 'Integrating Perception, Planning and Action'..

[7]  C. Brenner,et al.  3 D FEATURE POINT EXTRACTION FROM LIDAR DATA USING A NEURAL NETWORK , 2016 .

[8]  Jean-Philippe Thirion,et al.  Extremal points: definition and application to 3D image registration , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Chang Shu,et al.  Automatic Locating of Anthropometric Landmarks on 3D Human Models , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[10]  Sébastien Ourselin,et al.  Landmark detection and coupled patch registration for cardiac motion tracking , 2013, Medical Imaging.

[11]  Jakob Andreas Bærentzen,et al.  Volume Sculpting Using the Level-Set Method , 2002, Shape Modeling International.

[12]  William E. Lorensen,et al.  Marching cubes: a high resolution 3D surface construction algorithm , 1996 .

[13]  Xiangxiang Zeng,et al.  Spiking Neural P Systems with Thresholds , 2014, Neural Computation.

[14]  Rita Cunha,et al.  Landmark based nonlinear observer for rigid body attitude and position estimation , 2007, 2007 46th IEEE Conference on Decision and Control.

[15]  Niels Jørgen Christensen,et al.  Volume sculpting using the level-set method , 2002, Proceedings SMI. Shape Modeling International 2002.

[16]  Jim Austin,et al.  3D landmark model discovery from a registered set of organic shapes , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[17]  Linqiang Pan,et al.  Spiking neural P systems with request rules , 2016, Neurocomputing.

[18]  Wieslaw Lucjan Nowinski,et al.  A Model-Based, Semi-Global Segmentation Approach for Automatic 3-D Point Landmark Localization in Neuroimages , 2008, IEEE Transactions on Medical Imaging.

[19]  Federico Tombari,et al.  Learning a Descriptor-Specific 3D Keypoint Detector , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[20]  Ying Ju,et al.  Complex Network Clustering by a Multi-objective Evolutionary Algorithm Based on Decomposition and Membrane Structure , 2016, Scientific Reports.

[21]  Mark Boehmer,et al.  3-D landmark detection and identification in the CAESAR project , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[22]  Andrea J. van Doorn,et al.  Surface shape and curvature scales , 1992, Image Vis. Comput..

[23]  Jean-Philippe Thirion,et al.  New feature points based on geometric invariants for 3D image registration , 1996, International Journal of Computer Vision.

[24]  Tyson L Hedrick,et al.  Software techniques for two- and three-dimensional kinematic measurements of biological and biomimetic systems , 2008, Bioinspiration & biomimetics.

[25]  Peng Zhang,et al.  Face Feature Points Detection Based on Adaboost and AAM , 2016, GRMSE.

[26]  R C Woledge,et al.  Manual landmark identification and tracking during the medial rotation test of the shoulder: an accuracy study using three-dimensional ultrasound and motion analysis measures. , 2008, Manual therapy.

[27]  Cristina Conde,et al.  Automatic 3D Face Feature Points Extraction with Spin Images , 2006, ICIAR.

[28]  Stephanie Wilson Reflections on Model-Based Design: Definitions and Challenges , 1996, CADUI.

[29]  Jay B. West,et al.  Predicting error in rigid-body point-based registration , 1998, IEEE Transactions on Medical Imaging.

[30]  Thomas A. Funkhouser,et al.  Schelling points on 3D surface meshes , 2012, ACM Trans. Graph..

[31]  Bahari Belaton,et al.  Finite difference error analysis of geometry properties of implicit surfaces , 2011, 2011 IEEE Symposium on Computers & Informatics.

[32]  Ana L. N. Fred,et al.  Data clustering using evidence accumulation , 2002, Object recognition supported by user interaction for service robots.

[33]  Xiaobo Zhang,et al.  3D Facial Landmark Localization via a Local Surface Descriptor HoSNI , 2012, IScIDE.

[34]  Karl Rohr,et al.  Localization of anatomical point landmarks in 3D medical images by fitting 3D parametric intensity models , 2006, Medical Image Anal..

[35]  Claus Brenner,et al.  3D feature point extraction from LiDAR data using a neural network , 2016 .

[36]  Jules Bloomenthal,et al.  An Implicit Surface Polygonizer , 1994, Graphics Gems.

[37]  P. Rousseeuw Silhouettes: a graphical aid to the interpretation and validation of cluster analysis , 1987 .

[38]  Zhengyou Zhang,et al.  Iterative point matching for registration of free-form curves and surfaces , 1994, International Journal of Computer Vision.

[39]  Andrea F. Abate,et al.  2D and 3D face recognition: A survey , 2007, Pattern Recognit. Lett..

[40]  Wolfram Burgard,et al.  Point feature extraction on 3D range scans taking into account object boundaries , 2011, 2011 IEEE International Conference on Robotics and Automation.