3D reconstruction of the human rib cage from 2D projection images using a statistical shape model

PurposeThis paper describes an approach for the three-dimensional (3D) shape and pose reconstruction of the human rib cage from few segmented two-dimensional (2D) projection images. Our work is aimed at supporting temporal subtraction techniques of subsequently acquired radiographs by establishing a method for the assessment of pose differences in sequences of chest radiographs of the same patient.MethodsThe reconstruction method is based on a 3D statistical shape model (SSM) of the rib cage, which is adapted to binary 2D projection images of an individual rib cage. To drive the adaptation we minimize a distance measure that quantifies the dissimilarities between 2D projections of the 3D SSM and the projection images of the individual rib cage. We propose different silhouette-based distance measures and evaluate their suitability for the adaptation of the SSM to the projection images.ResultsAn evaluation was performed on 29 sets of biplanar binary images (posterior–anterior and lateral). Depending on the chosen distance measure, our experiments on the combined reconstruction of shape and pose of the rib cages yield reconstruction errors from 2.2 to 4.7mm average mean 3D surface distance. Given a geometry of an individual rib cage, the rotational errors for the pose reconstruction range from 0.1° to 0.9°.ConclusionsThe results show that our method is suitable for the estimation of pose differences of the human rib cage in binary projection images. Thus, it is able to provide crucial 3D information for registration during the generation of 2D subtraction images.

[1]  Richard Szeliski,et al.  Recovering the Position and Orientation of Free-Form Objects from Image Contours Using 3D Distance Maps , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Russell H. Taylor,et al.  Projected tetrahedra revisited: a barycentric formulation applied to digital radiograph reconstruction using higher-order attenuation functions , 2006, IEEE Transactions on Visualization and Computer Graphics.

[3]  Michael Kuhn,et al.  Reconstruction of 3D Patient-Specific Bone Models From Biplanar X-Ray Images Utilizing Morphometric Measurements , 2006, IPCV.

[4]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  K Doi,et al.  Digital chest radiography: effect of temporal subtraction images on detection accuracy. , 1997, Radiology.

[6]  Anil K. Jain,et al.  A modified Hausdorff distance for object matching , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[7]  William Rucklidge,et al.  Efficiently Locating Objects Using the Hausdorff Distance , 1997, International Journal of Computer Vision.

[8]  E. Hoffman,et al.  Geometry and respiratory displacement of human ribs. , 1987, Journal of applied physiology.

[9]  David Mitton,et al.  Iconography : Three-dimensional reconstruction of the rib cage from biplanar radiography , 2008 .

[10]  Noriyuki Tomiyama,et al.  Temporal subtraction for the detection of hazy pulmonary opacities on chest radiography. , 2002, AJR. American journal of roentgenology.

[11]  Georges Charpak,et al.  Une nouvelle imagerie Ostéo-Articulaire basse dose en position debout : le système EOS , 2005 .

[12]  E R Valstar,et al.  Image-based RSA: Roentgen stereophotogrammetric analysis based on 2D-3D image registration. , 2008, Journal of biomechanics.

[13]  Cristian Lorenz,et al.  Automated Model-Based Rib Cage Segmentation and Labeling in CT Images , 2007, MICCAI.

[14]  M. Giger,et al.  Digital image subtraction of temporally sequential chest images for detection of interval change. , 1994, Medical physics.

[15]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[16]  M. F.,et al.  Bibliography , 1985, Experimental Gerontology.

[17]  Benedikt Schuler,et al.  Comparison of Different Metrics for Appearance-Model-Based 2D/3D-registration with X-ray Images , 2008, Bildverarbeitung für die Medizin.

[18]  Nicholas Ayache,et al.  3D-2D Projective Registration of Free-Form Curves and Surfaces , 1997, Comput. Vis. Image Underst..

[19]  I. Jolliffe.  Principal Component Analysis , 2002 .

[20]  Yvan Petit,et al.  Three-dimensional (3-D) reconstruction of the spine from a single X-ray image and prior vertebra models , 2004, IEEE Transactions on Biomedical Engineering.

[21]  Russell H. Taylor,et al.  A statistical bone density atlas and deformable medical image registration , 2002 .

[22]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[23]  Hans Lamecker,et al.  Variational and statistical shape modeling for 3D geometry reconstruction , 2008 .

[24]  Wee Kheng Leow,et al.  Recovery of 3D Pose of Bones in Single 2D X-ray Images , 2007, 2007 IEEE Workshop on Applications of Computer Vision (WACV '07).

[25]  D Mitton,et al.  A Biplanar Reconstruction Method Based on 2D and 3D Contours: Application to the Distal Femur , 2003, Computer methods in biomechanics and biomedical engineering.

[26]  Guoyan Zheng,et al.  Reconstruction of Patient-Specific 3D Bone Model from Biplanar X-Ray Images and Point Distribution Models , 2006, 2006 International Conference on Image Processing.

[27]  Ehsan Hekmatian,et al.  Literature review Digital Subtraction Radiography in Dentistry , 2008 .

[28]  W. C. Röntgen,et al.  Ueber eine neue Art von Strahlen , 1898 .

[29]  Paul Suetens,et al.  Temporal subtraction of thorax CR images using a statistical deformation model , 2003, IEEE Transactions on Medical Imaging.

[30]  Max Mignotte,et al.  Three-dimensional biplanar reconstruction of scoliotic rib cage using the estimation of a mixture of probabilistic prior models , 2005, IEEE Transactions on Biomedical Engineering.

[31]  Bram van Ginneken,et al.  Automatic delineation of ribs in frontal chest radiographs , 2000, Medical Imaging: Image Processing.

[32]  Rhodri H. Davies,et al.  Learning Shape: Optimal Models for Analysing Natural Variability , 2004 .

[33]  Max A. Viergever,et al.  Retrospective motion correction in digital subtraction angiography: a review , 1999, IEEE Transactions on Medical Imaging.

[34]  Russell H. Taylor,et al.  Tetrahedral Mesh Modeling of Density Data for Anatomical Atlases and Intensity-Based Registration , 2000, MICCAI.

[35]  Thomas Lange,et al.  Shape Constrained Automatic Segmentation of the Liver based on a Heuristic Intensity Model , 2007 .

[36]  I A Stokes,et al.  Measurements of the three-dimensional shape of the rib cage. , 1988, Journal of biomechanics.

[37]  Forouzan Golshani,et al.  Reconstructing the human ribcage in 3d with x-rays and geometric models , 2010 .

[38]  K. Hirata,et al.  The ribs: anatomic and radiologic considerations. , 1999, Radiographics : a review publication of the Radiological Society of North America, Inc.

[39]  L. S. Wilson,et al.  Detection and labeling ribs on expiration chest radiographs , 2003, SPIE Medical Imaging.

[40]  Noriyuki Tomiyama,et al.  Temporal subtraction for detection of solitary pulmonary nodules on chest radiographs: evaluation of a commercially available computer-aided diagnosis system. , 2002, Radiology.

[41]  Jürgen Weese,et al.  A Comparison of Simularity Measures for use in 2D-3D Medical Image Registration , 1998, MICCAI.

[42]  M. Roberts,et al.  Quantitative vertebral fracture detection on DXA images using shape and appearance models. , 2007, Academic radiology.

[43]  Yvan Petit,et al.  Assessment of the 3-D reconstruction and high-resolution geometrical modeling of the human skeletal trunk from 2-D radiographic images , 2003, IEEE Transactions on Biomedical Engineering.

[44]  Genaro Tolentino Marzan,et al.  Rational Design for Close-Range Photogrammetry , 1976 .

[45]  Guoyan Zheng,et al.  A 2D/3D correspondence building method for reconstruction of a patient-specific 3D bone surface model using point distribution models and calibrated X-ray images , 2009, Medical Image Anal..

[46]  Hideki Yoshikawa,et al.  Improvement of depth position in 2-D/3-D registration of knee implants using single-plane fluoroscopy , 2004, IEEE Transactions on Medical Imaging.

[47]  Stefan Zachow,et al.  Reconstruction of mandibular dysplasia using a statistical 3D shape model , 2005 .

[48]  Hans-Christian Hege,et al.  Automatic Segmentation of the Pelvic Bones from CT Data Based on a Statistical Shape Model , 2008, VCBM.

[49]  Max A. Viergever,et al.  Computer-aided diagnosis in chest radiography: a survey , 2001, IEEE Transactions on Medical Imaging.

[50]  Stéphane Lavallée,et al.  Nonrigid 3-D/2-D Registration of Images Using Statistical Models , 1999, MICCAI.

[51]  Cristian Lorenz,et al.  Towards model-based 3-D reconstruction of the human rib cage from radiographs , 2008 .

[52]  Chao Yang,et al.  3D reconstruction of the ribs from lateral and frontal X-rays in comparison to 3D CT-scan reconstruction. , 2008, Journal of biomechanics.

[53]  Benjamin B. Kimia,et al.  2D-3D registration based on shape matching , 2000, Proceedings IEEE Workshop on Mathematical Methods in Biomedical Image Analysis. MMBIA-2000 (Cat. No.PR00737).

[54]  Kunio Doi,et al.  Effect of temporal subtraction technique on interpretation time and diagnostic accuracy of chest radiography. , 2006, AJR. American journal of roentgenology.

[55]  A. Ardeshir Goshtasby,et al.  Automatic detection of rib borders in chest radiographs , 1995, IEEE Trans. Medical Imaging.

[56]  Bram van Ginneken,et al.  Segmentation of the posterior ribs in chest radiographs using iterated contextual pixel classification , 2006, IEEE Transactions on Medical Imaging.

[57]  J. Gower.  Generalized procrustes analysis , 1975 .

[58]  F Cheriet,et al.  Semi-automatic detection of scoliotic rib borders using chest radiographs. , 2006, Studies in health technology and informatics.

[59]  Hans-Christian Hege,et al.  Atlas-based 3D-Shape Reconstruction from X-Ray Images , 2006, 18th International Conference on Pattern Recognition (ICPR'06).