Review on Segmentation of Computer-Aided Skeletal Maturity Assessment

Bone age assessment (BAA) is an examination of ossification development with the purpose of deducing the skeletal age of children to monitor their skeletal development and predict their future adult height. Conventionally, it is performed by comparing left-hand radiographs to standard atlas by visual inspection; this process is subjective and time-consuming; therefore, the automated inspection system to overcome the drawbacks is established. However, the automated BAA system invariably confronts with problem in segmentation, which is the most crucial procedure in the computer-aided BAA. Inappropriate segmentation methods will produce unwanted noises that will affect the subsequent processes of the system. The current manual or semi-automated segmentation frameworks have impeded the system from becoming truly automated, objective, and efficient. The objective of this thesis is to provide a solution to the mentioned unsolved technical problem in segmentation for automated BAA system. The task is accomplished by first applying the modified histogram equalized module, then undergoing the proposed automated anisotropic diffusion, following by a novel fuzzy quadruple division scheme to optimize the central segmentation algorithm, and finally, the process ends with an additional quality assurance scheme. The designed segmentation framework works without the need of resources such as training sets and skillful operator. The quantitative and qualitative analysis of the resultant images have both shown that the designed framework is capable of separating the soft tissue and background from the hand bone with relatively high accuracy despite omitting the above-mentioned resources.

[1]  Hans Henrik Thodberg Hands-on experience with active appearance models , 2002, SPIE Medical Imaging.

[2]  Bülent Sankur,et al.  Survey over image thresholding techniques and quantitative performance evaluation , 2004, J. Electronic Imaging.

[3]  Benjamin B. Kimia,et al.  Segmentation of carpal bones from CT images using skeletally coupled deformable models , 2003, Medical Image Anal..

[4]  Alejandro F. Frangi,et al.  Multi-view face segmentation using fusion of statistical shape and appearance models , 2010, Comput. Vis. Image Underst..

[5]  Thomas M. Breuel,et al.  Efficient implementation of local adaptive thresholding techniques using integral images , 2008, Electronic Imaging.

[6]  A. Poznanski,et al.  Assessment of Skeletal Maturity and Prediction of Adult Height (TW2 Method) , 1977 .

[7]  F Kainberger,et al.  Computational radiology in skeletal radiography. , 2009, European journal of radiology.

[8]  Baba C. Vemuri,et al.  Shape Modeling with Front Propagation: A Level Set Approach , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Max A. Viergever,et al.  Assessing the skeletal age from a hand radiograph: automating the Tanner-Whitehouse method , 2003, SPIE Medical Imaging.

[10]  W. Greulich,et al.  Radiographic Atlas of Skeletal Development of the Hand and Wrist , 1999 .

[11]  C. Sklar,et al.  Endocrine complications in long-term survivors of childhood cancers. , 2010, Endocrine-related cancer.

[12]  Hong Zhang,et al.  A multistage adaptive thresholding method , 2005, Pattern Recognit. Lett..

[13]  Yi-Hong Chou,et al.  Computerized geometric features of carpal bone for bone age estimation. , 2007, Chinese medical journal.

[14]  A F Roche,et al.  Differences in skeletal maturity levels between the knee and hand. , 1970, The American journal of roentgenology, radium therapy, and nuclear medicine.

[15]  Aaron Fenster,et al.  Prostate boundary segmentation from ultrasound images using 2D active shape models: Optimisation and extension to 3D , 2006, Comput. Methods Programs Biomed..

[16]  U E Heinrich [Significance of radiologic skeletal age determination in clinical practice]. , 1986, Der Radiologe.

[17]  Olivier D. Faugeras,et al.  Statistical shape influence in geodesic active contours , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[18]  Tai-Lang Jong,et al.  Carpal growth assessment based on fuzzy description , 2008, 2008 IEEE Conference on Soft Computing in Industrial Applications.

[19]  M. Roberts,et al.  Quantitative vertebral fracture detection on DXA images using shape and appearance models. , 2007, Academic radiology.

[20]  Sansanee Auephanwiriyakul,et al.  Bone Age Assessment in Young Children Using Automatic Carpal Bone Feature Extraction and Support Vector Regression , 2011, Journal of Digital Imaging.

[21]  Stephen M. Smith,et al.  A Bayesian model of shape and appearance for subcortical brain segmentation , 2011, NeuroImage.

[22]  Timothy F. Cootes,et al.  Interpreting face images using active appearance models , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[23]  J. Talairach,et al.  L??EXPLORATION CHIRURGICALE ST??R??OTAXIQUE DU LOBE TEMPORAL DANS L??EPILEPSIE TEMPORALE , 1959 .

[24]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[25]  Won Tae Kim,et al.  Object tracking based on the modular active shape model , 2005 .

[26]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[27]  H. K. Huang,et al.  Computer-assisted bone age assessment: image preprocessing and epiphyseal/metaphyseal ROI extraction , 2001, IEEE Transactions on Medical Imaging.

[28]  H. H. Thodberg,et al.  A paediatric bone index derived by automated radiogrammetry , 2009, Osteoporosis International.

[29]  Sansanee Auephanwiriyakul,et al.  Boundary Detection in Medical Images Using Edge Following Algorithm Based on Intensity Gradient and Texture Gradient Features , 2011, IEEE Transactions on Biomedical Engineering.

[30]  Jerry L. Prince,et al.  Generalized gradient vector flow external forces for active contours , 1998, Signal Process..

[31]  Steven K Boyd,et al.  Automatic segmentation of cortical and trabecular compartments based on a dual threshold technique for in vivo micro-CT bone analysis. , 2007, Bone.

[32]  Du-Ming Tsai,et al.  A fast thresholding selection procedure for multimodal and unimodal histograms , 1995, Pattern Recognit. Lett..

[33]  R. Acheson,et al.  STUDIES IN THE RELIABILITY OF ASSESSING SKELETAL MATURITY FROM X-RAYS. I. GREULICH-PYLE ATLAS. , 1963, Human biology.

[34]  Hans Henrik Thodberg,et al.  Prediction of adult height based on automated determination of bone age. , 2009, The Journal of clinical endocrinology and metabolism.

[35]  Rachid Deriche,et al.  Geodesic active regions for supervised texture segmentation , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[36]  H. K. Huang,et al.  Automatic background recognition and removal (ABRR) in computed radiography images , 1997, IEEE Transactions on Medical Imaging.

[37]  Eam Khwang Teoh,et al.  Bayesian shape model for facial feature extraction and recognition , 2003, Pattern Recognit..

[38]  J Y Goulermas,et al.  Automated anatomical demarcation using an active shape model for videofluoroscopic analysis in swallowing. , 2010, Medical engineering & physics.

[39]  A. De Santis,et al.  A Bayesian approach to edge detection in noisy images , 1999 .

[40]  F. Leymarie Tracking and Describing Deformable Objects Using Active Contour Models , 1990 .

[41]  Hong Yan,et al.  An adaptive thresholding method for binarization of blueprint images , 2000, Pattern Recognit. Lett..

[42]  Hans Henrik Thodberg,et al.  Application of the Active Shape Model in a commercial medical device for bone densitometry , 2001, BMVC.

[43]  V. Caselles,et al.  A geometric model for active contours in image processing , 1993 .

[44]  Carlos Alberola-López,et al.  A computational TW3 classifier for skeletal maturity assessment. A Computing with Words approach , 2004, J. Biomed. Informatics.

[45]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[46]  Laurent D. Cohen,et al.  Finite-Element Methods for Active Contour Models and Balloons for 2-D and 3-D Images , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[47]  Laurent D. Cohen,et al.  On active contour models and balloons , 1991, CVGIP Image Underst..

[48]  Bayan S. Sharif,et al.  Skeletal growth estimation using radiographic image processing and analysis , 2000, IEEE Transactions on Information Technology in Biomedicine.

[49]  Sasan Mahmoodi,et al.  Automated vision system for skeletal age assessment using knowledge based techniques , 1997 .

[50]  Whoi-Yul Kim,et al.  Epiphyses Extraction Method Using Shape Information for Left Hand Radiography , 2008, 2008 International Conference on Convergence and Hybrid Information Technology.

[51]  Wayne Niblack,et al.  An introduction to digital image processing , 1986 .

[52]  Concetto Spampinato,et al.  An Automatic System for Skeletal Bone Age Measurement by Robust Processing of Carpal and Epiphysial/Metaphysial Bones , 2010, IEEE Transactions on Instrumentation and Measurement.

[53]  José M Sotoca,et al.  Hand bone segmentation in radioabsorptiometry images for computerised bone mass assessment. , 2003, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[54]  Chin-Chuan Han,et al.  Hand radiograph image segmentation using a coarse-to-fine strategy , 2007, Pattern Recognit..

[55]  Heinrich Ue,et al.  Significance of radiologic skeletal age determination in clinical practice , 1986 .

[56]  Hans Luijendijk,et al.  Automatic threshold selection using histograms based on the count of 4-connected regions , 1991, Pattern Recognit. Lett..

[57]  D. Michael,et al.  HANDX: a model-based system for automatic segmentation of bones from digital hand radiographs. , 1989, IEEE transactions on medical imaging.

[58]  James M. Tanner,et al.  Assessment of skeletal maturity and prediction of adult height : (TW2 method) , 1986 .

[59]  Bayan S. Sharif,et al.  Bone edge detection in hand radiographic images , 1994, Proceedings of 16th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[60]  Rafael C. González,et al.  Local Determination of a Moving Contrast Edge , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[61]  Wen Gao,et al.  Thresholding technique with adaptive window selection for uneven lighting image , 2005, Pattern Recognit. Lett..

[62]  H. K. Huang,et al.  Feature extraction in carpal-bone analysis , 1993, IEEE Trans. Medical Imaging.

[63]  Linda G. Shapiro,et al.  Computer Vision , 2001 .

[64]  S. M. Pandit,et al.  Automatic threshold selection based on histogram modes and a discriminant criterion , 1998, Machine Vision and Applications.

[65]  Andrew Mehnert,et al.  An improved seeded region growing algorithm , 1997, Pattern Recognit. Lett..

[66]  David Sinclair,et al.  Automatic segmentation of hand-wrist radiographs , 1993, Image Vis. Comput..

[67]  Sanguklee,et al.  A comparative performance study of several global thresholding techniques for segmentation , 1990 .

[68]  Jie Yang,et al.  Facial feature localization based on an improved active shape model , 2008, Inf. Sci..

[69]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[70]  Juan Ignacio Arribas,et al.  A Radius and Ulna TW3 Bone Age Assessment System , 2008, IEEE Transactions on Biomedical Engineering.

[71]  Sven Kreiborg,et al.  The BoneXpert Method for Automated Determination of Skeletal Maturity , 2009, IEEE Transactions on Medical Imaging.

[72]  Bayan S. Sharif,et al.  Bayesian estimation of growth age using shape and texture descriptors , 1999 .

[73]  Christopher J. Taylor,et al.  Automatic measurement of vertebral shape using active shape models , 1997, Image Vis. Comput..

[74]  Wen-June Wang,et al.  Image segmentation with complicated background by using seeded region growing , 2012 .

[75]  G K Manos,et al.  Segmenting radiographs of the hand and wrist. , 1994, Computer methods and programs in biomedicine.

[76]  Dewen Hu,et al.  Tracking objects using shape context matching , 2012, Neurocomputing.

[77]  Timothy F. Cootes,et al.  Statistical Grey-Level Models for Object Location and Identification , 1995, BMVC.

[78]  E Pietka,et al.  Computer-assisted bone age assessment based on features automatically extracted from a hand radiograph. , 1995, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[79]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[80]  M. Ivanovic,et al.  Bone age in children of diverse ethnicity. , 1996, AJR. American journal of roentgenology.

[81]  E Pietka,et al.  Digital hand atlas and web-based bone age assessment: system design and implementation. , 2000, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[82]  J M Tanner,et al.  Automatic Bone Age Measurement Using Computerized Image Analysis , 1994, The Journal of pediatric endocrinology.

[83]  Anant Madabhushi,et al.  A magnetic resonance spectroscopy driven initialization scheme for active shape model based prostate segmentation , 2011, Medical Image Anal..

[84]  Alejandro F. Frangi,et al.  Projective active shape models for pose-variant image analysis of quasi-planar objects: Application to facial analysis , 2010, Pattern Recognit..

[85]  Hans Henrik Thodberg,et al.  Clinical application of automated Greulich-Pyle bone age determination in children with short stature , 2009, Pediatric Radiology.

[86]  Jian Liu,et al.  Automatic bone age assessment based on intelligent algorithms and comparison with TW3 method , 2008, Comput. Medical Imaging Graph..

[87]  Andreas Hoppe,et al.  Robust and automated unimodal histogram thresholding and potential applications , 2004, Pattern Recognit..

[88]  Alain Trémeau,et al.  A region growing and merging algorithm to color segmentation , 1997, Pattern Recognit..

[89]  Xuelong Li,et al.  A Review of Active Appearance Models , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[90]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[91]  R. J. Whatmough,et al.  Automatic threshold selection from a histogram using the "exponential hull" , 1991, CVGIP Graph. Model. Image Process..

[92]  Jerry L. Prince,et al.  Gradient vector flow: a new external force for snakes , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[93]  Aifeng Zhang,et al.  Automatic bone age assessment for young children from newborn to 7-year-old using carpal bones , 2007, Comput. Medical Imaging Graph..

[94]  Hyung-Il Choi,et al.  Active models for tracking moving objects , 2000, Pattern Recognit..

[95]  Junaed Sattar Snakes , Shapes and Gradient Vector Flow , 2022 .

[96]  S. Milani,et al.  Assessment of skeletal maturity of the hand‐wrist and knee: A comparison among methods , 2000, American journal of human biology : the official journal of the Human Biology Council.

[98]  Weinan Chen,et al.  Gray level image thresholding based on fisher linear projection of two-dimensional histogram , 1997, Pattern Recognit..

[99]  David Fernández Llorca,et al.  Face tracking with automatic model construction , 2011, Image Vis. Comput..

[100]  Yan Chai Hum,et al.  Segmentation of Hand Bone for Bone Age Assessment , 2013 .

[101]  James M. Tanner,et al.  Assessment of skeletal maturity and prediction of adult height:(TW3 Method) , 2001 .