Tracking Mammographic Structures Over Time

A method to correspond linear structures in mammographic images is presented. Our approach is based on automatically establishing correspondence between linear structures which appear in images using robust features such as orientation, width and curvature extracted from those structures. The resulting correspondence is used to track linear structures and regions in mammographic images taken at different times. Medical image analysis [1] has been an important research subject in recent years where computer vision techniques have been successfully applied to develop detection and diagnosis systems, enhancement and training tools. The analysis of mammographic images is one of those fields and as such a very challenging one due to the complexity of the images and the subtle nature of the abnormalities. Detection of abnormal structures or architectural distortions in mammographic images can be performed by analysing different images of the same patient. Various approaches have been adopted which bring images into alignment in order to detect differences which are likely to be due to an abnormality. A large number of those methods are based on automatically corresponding extracted landmarks from mammographic images. Those landmarks include breast boundary [15, 20, 9], pectoral muscle [9], salient regions extracted using wavelets [14], iso-intensity contours [11] or steerable filters [20] and crossing points of horizontal and vertical structures [22]. This work presents an approach to the correspondence in mammographic images based on anatomical features which appear as linear structures in the images. The correspondence is used here to track linear structures in mammograms of the same patient over several years. Tracking of linear structures could be used to assess and model the development of architectural changes and abnormal structures. By being able to track regions back in time the available information will help to improve early detection of subtle abnormalities which are initially missed by radiologists. The tracking of objects in image sequences is a well-developed area [21]. However, in general this involves rigid objects (like cars [8]) or objects with a predictable behaviour (like humans [10] or animals [18]). Another difference with the current application is the fact that normally tracking is established using sequences of tens to hundreds of images and not only a few.

[1]  A. Rosenfeld,et al.  Edge and Curve Detection for Visual Scene Analysis , 1971, IEEE Transactions on Computers.

[2]  Nico Karssemeijer,et al.  Combining Single View Features and Asymmetry for Detection of Mass Lesions , 1998, Digital Mammography / IWDM.

[3]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Stephen J. Maybank,et al.  Vehicle Tracking with Applications to Collision Alert , 1997, BMVC.

[5]  Christopher J. Taylor,et al.  Automated asbestos fibre counting , 1979 .

[6]  Roberto Cipolla,et al.  Real-time tracking of complex structures with on-line camera calibration , 2002, Image Vis. Comput..

[7]  Ralph Highnam,et al.  Comparing Mammogram Pairs for the Detection of Lesions , 1998, Digital Mammography / IWDM.

[8]  Jake K. Aggarwal,et al.  Line Correspondences from Cooperating Spatial and Temporal Grouping Processes for a Sequence of Images , 1997, Comput. Vis. Image Underst..

[9]  Michael Brady,et al.  Multi-scale landmark selection for improved registration of temporal mammograms , 2000 .

[10]  A. David Marshall,et al.  A Hierarchical Model of Dynamics for Tracking People with a Single Video Camera , 2000, BMVC.

[11]  Marc Acheroy,et al.  Feature extraction using the constrained gradient , 1998 .

[12]  Djemel Ziou,et al.  Detection of line junctions and line terminations using curvilinear features , 2000, Pattern Recognit. Lett..

[13]  Sebastian Stier,et al.  Extraction of line properties based on direction fields , 1996, IEEE Trans. Medical Imaging.

[14]  Robin D. Tillett,et al.  Modelling Collective Animal Behaviour using Extended Point Distribution Models , 1997, BMVC.

[15]  Ramakant Nevatia,et al.  Matching Images Using Linear Features , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Dragana Brzakovic,et al.  Establishing the correspondence between control points in pairs of mammographic images , 1997, IEEE Trans. Image Process..

[17]  Kevin W. Bowyer,et al.  Registration and difference analysis of corresponding mammogram images , 1999, Medical Image Anal..

[18]  Nicholas Ayache,et al.  Medical Computer Vision, Virtual Reality and Robotics: Promising Research Tracks , 1995, BMVC.

[19]  Gunilla Borgefors,et al.  Hierarchical Chamfer Matching: A Parametric Edge Matching Algorithm , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  F. Chabat,et al.  A corner orientation detector , 1999, Image Vis. Comput..

[21]  Robert Marti,et al.  Automatic Registration of Mammograms Based on Linear Structures , 2001, IPMI.