Analyzing the evolution of breast tumors through flow fields and strain tensors

Abstract Breast cancer is one of the most perilous diseases that annually attack thousands of women. Physicians usually monitor the breast tumor changes during the course of a chemotherapy treatment. Computer programs may help physicians to predict the pathological response in order to adjust the medical treatment to produce the intended effects. This paper proposes a method for quantifying and visualizing the changes of breast tumors of cases undergoing medical treatment through strain tensors. The proposed method determines the displacement fields between each follow-up mammogram and its baseline. To compute the displacement fields, we evaluated the performance of eight robust and recent optical flow methods through landmark-based error and statistical analysis. Since, there is no ground truth to evaluate the optical flow methods when they are applied to mammograms, we propose to aggregate the best optical flow methods using ordered weighted averaging operators. The aggregated optical flow methods using the ‘as many as possible’ operator yields the smallest landmark-based error among three aggregation approaches analyzed with the proposed algorithm. The resulting optical flow is then used to estimate the strain tensors. The proposed method provides a good quantification and visualization for breast tumor changes and that helps physicians to plan treatment for their patients.

[1]  Kevin A. Lee A Mammographic Registration Method Based on Optical Flow and Multiresolution Computing. , 1997 .

[2]  Joachim Weickert,et al.  Lucas/Kanade Meets Horn/Schunck: Combining Local and Global Optic Flow Methods , 2005, International Journal of Computer Vision.

[3]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[4]  Rudolf Mester,et al.  Illumination-Robust Dense Optical Flow Using Census Signatures , 2011, DAGM-Symposium.

[5]  Jitendra Malik,et al.  Large Displacement Optical Flow: Descriptor Matching in Variational Motion Estimation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Antonio Moreno,et al.  Analysis of the evolution of breast tumours using strain tensors , 2015, CCIA.

[7]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[8]  Michael J. Black,et al.  Secrets of optical flow estimation and their principles , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  R. Chandrasekhar,et al.  Gross segmentation of mammograms using a polynomial model , 1996, Proceedings of 18th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[10]  Ronald R. Yager,et al.  On ordered weighted averaging aggregation operators in multicriteria decision-making , 1988 .

[11]  Jerry L. Prince,et al.  Direct three-dimensional myocardial strain tensor quantification and tracking using zHARP , 2008, Medical Image Anal..

[12]  Bärbel Mertsching,et al.  Illumination-Robust Optical Flow Using a Local Directional Pattern , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  J. Weickert,et al.  Lucas/Kanade meets Horn/Schunck: combining local and global optic flow methods , 2005 .

[14]  H. Ermert,et al.  Ultrasonic strain imaging of the female breast using phase root seeking and three-dimensional "optical flow" , 1998, 1998 IEEE Ultrasonics Symposium. Proceedings (Cat. No. 98CH36102).

[15]  Michael Liebling,et al.  Cardiac tissue and erythrocyte separation in bright-field microscopy images of the embryonic zebrafish heart for motion estimation , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[16]  R. Yager Families of OWA operators , 1993 .

[17]  F Levi,et al.  European cancer mortality predictions for the year 2015: does lung cancer have the highest death rate in EU women? , 2015, Annals of oncology : official journal of the European Society for Medical Oncology.

[18]  Vennila Ramalingam,et al.  Automated assessment of breast tissue density in digital mammograms , 2010, Comput. Vis. Image Underst..

[19]  Mohamed Abdel-Nasser,et al.  Temporal mammogram image registration using optimized curvilinear coordinates , 2016, Comput. Methods Programs Biomed..

[20]  E. Conant,et al.  Deformable registration for quantifying longitudinal tumor changes during neoadjuvant chemotherapy , 2015, Magnetic resonance in medicine.

[21]  Zheng Li,et al.  A New Approach to Evaluate Drug Treatment Response of Ovarian Cancer Patients Based on Deformable Image Registration , 2016, IEEE Transactions on Medical Imaging.

[22]  Yrjö Neuvo,et al.  Detail-preserving median based filters in image processing , 1994, Pattern Recognit. Lett..

[23]  Ronald R. Yager,et al.  On ordered weighted averaging aggregation operators in multicriteria decisionmaking , 1988, IEEE Trans. Syst. Man Cybern..

[24]  Puneet Singla,et al.  Evaluation of advanced Lukas–Kanade optical flow on thoracic 4D-CT , 2013, Journal of Clinical Monitoring and Computing.

[25]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[26]  Stephen Pistorius,et al.  Tissue motion tracking at the edges of a radiation treatment field using local optical flow analysis , 2014 .

[27]  Nikos Paragios,et al.  DRAMMS: Deformable Registration via Attribute Matching and Mutual-Saliency Weighting , 2009, IPMI.

[28]  Herman B. K. Boom,et al.  Bridging Disciplines For Biomedicine , 1997 .

[29]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Hatem A. Rashwan,et al.  Illumination Robust Optical Flow Model Based on Histogram of Oriented Gradients , 2013, GCPR.

[31]  Christos Davatzikos,et al.  Quantification of tumor changes during neoadjuvant chemotherapy with longitudinal breast DCE-MRI registration , 2015, Medical Imaging.

[32]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .