Fast and effective quantification of symmetry in medical images for pathology detection: Application to chest radiography

Purpose Symmetry is an important feature of human anatomy and the absence of symmetry in medical images can indicate the presence of pathology. Quantification of image symmetry can then be used to improve the automatic analysis of medical images. Methods A method is presented that computes both local and global symmetry in 2D medical images. A symmetry axis is determined to define for each position p in the image a mirrored position Symbol on the contralateral side of the axis. In the neighborhood of Symbol, an optimally corresponding position Symbol is determined by minimizing a cost function d that combines intensity differences in a patch around p and the mirrored patch around Symbol and the spatial distance between Symbol and Symbol. The optimal value of d is used as a measure of local symmetry s. The average of all values of s, indicated as S, quantifies global symmetry. Starting from an initial approximation of the symmetry axis, the optimal orientation and position of the axis is determined by greedy minimization of S. Symbol. No caption available. Symbol. No caption available. Symbol. No caption available. Symbol. No caption available. Symbol. No caption available. Symbol. No caption available. Results The method was evaluated in three experiments concerning abnormality detection in frontal chest radiographs. In the first experiment, global symmetry S was used to discriminate between 174 normal images and 174 images containing diffuse textural abnormalities from the publicly available CRASS database of tuberculosis suspects. Performance, measured as area under the receiver operating characteristic curve Symbol was 0.838. The second experiment investigated whether adding the local symmetry s as an additional feature to a set of 106 texture features resulted in improvements in classifying local patches in the same image database. We found that Symbol increased from 0.878 to 0.891 (P = 0.001). In the third experiment, it was shown that the contrast of pulmonary nodules, obtained from the publicly available JSRT database, increased significantly in the local symmetry map compared to the original image. Symbol. No caption available. Symbol. No caption available. Conclusions We conclude that the proposed algorithm for symmetry computation provides informative features which can be used to improve abnormality detection in medical images both at a local and a global level.

[1]  J. V. van Engelshoven,et al.  Miss rate of lung cancer on the chest radiograph in clinical practice. , 1999, Chest.

[2]  Giovanni Marola,et al.  On the Detection of the Axes of Symmetry of Symmetric and Almost Symmetric Planar Images , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  H Yoshida,et al.  Contralateral subtraction: a novel technique for detection of asymmetric abnormalities on digital chest radiographs. , 2000, Medical physics.

[4]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  K. Grammer,et al.  Human (Homo sapiens) facial attractiveness and sexual selection: the role of symmetry and averageness. , 1994, Journal of comparative psychology.

[6]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[7]  Bram van Ginneken,et al.  Clavicle segmentation in chest radiographs , 2012, Medical Image Anal..

[8]  S Katsuragawa,et al.  Improved contralateral subtraction images by use of elastic matching technique. , 2000, Medical physics.

[9]  Andrew W. Moore,et al.  An Investigation of Practical Approximate Nearest Neighbor Algorithms , 2004, NIPS.

[10]  K. Doi,et al.  Development of a digital image database for chest radiographs with and without a lung nodule: receiver operating characteristic analysis of radiologists' detection of pulmonary nodules. , 2000, AJR. American journal of roentgenology.

[11]  C. Rutter,et al.  Bootstrap estimation of diagnostic accuracy with patient-clustered data. , 2000, Academic radiology.

[12]  Eli Saber,et al.  Frontal-view face detection and facial feature extraction using color, shape and symmetry based cost functions , 1998, Pattern Recognit. Lett..

[13]  Benjamin B. Kimia,et al.  On the Intrinsic Reconstruction of Shape from Its Symmetries , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Karl J. Friston,et al.  Cerebral Asymmetry and the Effects of Sex and Handedness on Brain Structure: A Voxel-Based Morphometric Analysis of 465 Normal Adult Human Brains , 2001, NeuroImage.

[15]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[16]  Sunil Arya,et al.  An optimal algorithm for approximate nearest neighbor searching fixed dimensions , 1998, JACM.

[17]  Paul Suetens,et al.  Minimal Shape and Intensity Cost Path Segmentation , 2007, IEEE Transactions on Medical Imaging.

[18]  Yanxi Liu,et al.  Robust midsagittal plane extraction from normal and pathological 3-D neuroradiology images , 2001, IEEE Transactions on Medical Imaging.

[19]  Mubarak Shah,et al.  Tracking and Object Classification for Automated Surveillance , 2002, ECCV.

[20]  Alexei A. Efros,et al.  Discovering Texture Regularity as a Higher-Order Correspondence Problem , 2006, ECCV.

[21]  Bir Bhanu,et al.  Automatic symmetry-integrated brain injury detection in MRI sequences , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[22]  Hiroyuki Yoshida,et al.  Local contralateral subtraction based on bilateral symmetry of lung for reduction of false positives in computerized detection of pulmonary nodules , 2004, IEEE Transactions on Biomedical Engineering.

[23]  Bir Bhanu,et al.  Reflection Symmetry-Integrated Image Segmentation , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  R. Gunderman,et al.  Gestalt theory: implications for radiology education. , 2008, AJR. American journal of roentgenology.

[25]  Bram van Ginneken,et al.  A computer-aided diagnosis system for detection of lung nodules in chest radiographs with an evaluation on a public database , 2006, Medical Image Anal..

[26]  Hayit Greenspan,et al.  X-ray Categorization and Retrieval on the Organ and Pathology Level, Using Patch-Based Visual Words , 2011, IEEE Transactions on Medical Imaging.

[27]  Bram van Ginneken,et al.  Segmentation of anatomical structures in chest radiographs using supervised methods: a comparative study on a public database , 2006, Medical Image Anal..

[28]  B. van Ginneken,et al.  Computer-aided detection (CAD) of lung nodules and small tumours on chest radiographs. , 2009, European journal of radiology.

[29]  J. Friedman Special Invited Paper-Additive logistic regression: A statistical view of boosting , 2000 .

[30]  Luc Van Gool,et al.  Computational Symmetry in Computer Vision and Computer Graphics , 2010, Found. Trends Comput. Graph. Vis..

[31]  Wai Ho Li,et al.  Real Time Object Tracking using Reflectional Symmetry and Motion , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[32]  Shmuel Raz,et al.  Fluctuating Asymmetry: Methods, Theory, and Applications , 2010, Symmetry.

[33]  Max A. Viergever,et al.  Global and Local Multi-valued Dissimilarity-Based Classification: Application to Computer-Aided Detection of Tuberculosis , 2009, MICCAI.

[34]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Bram van Ginneken,et al.  Fusion of Local and Global Detection Systems to Detect Tuberculosis in Chest Radiographs , 2010, MICCAI.

[36]  G. Gescheider Psychophysics: The Fundamentals , 1997 .

[37]  H L Kundel,et al.  Interpreting chest radiographs without visual search. , 1975, Radiology.

[38]  Hagit Hel-Or,et al.  Symmetry as a Continuous Feature , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  D. Burr,et al.  A feature–based model of symmetry detection , 2003, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[40]  David Avnir,et al.  Quantitative Symmetry in Structure−Activity Correlations: The Near C2 Symmetry of Inhibitor/HIV Protease Complexes , 2000 .

[41]  Jan-Olof Eklundh,et al.  Detecting Symmetry and Symmetric Constellations of Features , 2006, ECCV.