Using a spatiotemporal neural network on dynamic gadolinium-enhanced MR images for diagnosing recurrent nasal papilloma

Gadolinium (Gd)-enhanced magnetic resonance imaging (MRI) is widely used in the detection of recurrent nasal tumors. We have developed a spatiotemporal neural network (STNN) for identifying the tumor and fibrosis in the nasal regions. A more accurate signal-time curve called relative intensity change (RIC) for dynamic MR images is proposed as representation of gadolinium-enhanced MRI temporal information. The RIC curves of different diseases are embedded into the STNN and stored in the synaptic weights of the input layer through learning. In addition, to enhance the capability of the STNN in discriminating temporal information between tumors and fibrosis, the synaptic weights of its tap delays were obtained through a creative learning scheme, which reinforces the most distinguishable features, between tumor and fibrosis while inhibiting the indistinguishable features. The outputs of proposed STNN were indexed on a colormap in which red represents tumor and green represents fibrosis. The color-coded tumor/fibrosis areas are fused to the original MR image to facilitate visual interpretation. The experimental results show that the proposed method is able to detect abnormal tissues precisely.

[1]  C. Hsu,et al.  Recurrent inverted papilloma: diagnosis with pharmacokinetic dynamic gadolinium-enhanced MR imaging. , 1999, AJNR. American journal of neuroradiology.

[2]  Linda G. Shapiro,et al.  Computer and Robot Vision , 1991 .

[3]  Nicholas Ayache,et al.  Extension of the ICP Algorithm to Nonrigid Intensity-Based Registration of 3D Volumes , 1997, Comput. Vis. Image Underst..

[4]  S J Zinreich,et al.  Inverted papilloma: evaluation with MR imaging. , 1992, Radiology.

[5]  D P Vrabec,et al.  The inverted schneiderian papilloma: A 25‐year study , 1994, The Laryngoscope.

[6]  L Axel,et al.  Tumor recurrence versus fibrosis in the female pelvis: differentiation with MR imaging at 1.5 T. , 1988, Radiology.

[7]  Chuan-Yu Chang,et al.  An eigen-support differential operator to fuse ct and mr images for nasopharyngeal carcinoma diagnosis , 2000 .

[8]  W. Lawson,et al.  Inverted papilloma: A report of 112 cases , 1995, The Laryngoscope.

[9]  J. Mazziotta,et al.  MRI‐PET Registration with Automated Algorithm , 1993, Journal of computer assisted tomography.

[10]  Pau-Choo Chung,et al.  A spatiotemporal neural network for recognizing partially occluded objects , 1998, IEEE Trans. Signal Process..

[11]  Benoit M. Dawant,et al.  Registration of 3-D images using weighted geometrical features , 1996, IEEE Trans. Medical Imaging.

[12]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[13]  H Soltanian-Zadeh,et al.  Optimization of MRI protocols and pulse sequence parameters for eigenimage filtering. , 1994, IEEE transactions on medical imaging.

[14]  J P Windham,et al.  Eigenimage Filtering in MR Imaging , 1988, Journal of computer assisted tomography.

[15]  John J. Hopfield,et al.  Connected-digit speaker-dependent speech recognition using a neural network with time-delayed connections , 1991, IEEE Trans. Signal Process..

[16]  Manuel G. Penedo,et al.  Computer-aided diagnosis: a neural-network-based approach to lung nodule detection , 1998, IEEE Transactions on Medical Imaging.

[17]  L Kaufman,et al.  The utility of principal component analysis for the image display of brain lesions. A preliminary, comparative study , 1987, Magnetic resonance in medicine.

[18]  Thrasyvoulos N. Pappas An adaptive clustering algorithm for image segmentation , 1992, IEEE Trans. Signal Process..

[19]  W C Huang,et al.  Recurrent nasal tumor detection by dynamic MRI. , 1999, IEEE engineering in medicine and biology magazine : the quarterly magazine of the Engineering in Medicine & Biology Society.

[20]  Max A. Viergever,et al.  Evaluation of Ridge Seeking Operators for Multimodality Medical Image Matching , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Steven K. Feiner,et al.  Computer graphics: principles and practice (2nd ed.) , 1990 .

[22]  James B. Farison,et al.  Spatially invariant image sequences , 1992, IEEE Trans. Image Process..

[23]  Hamid Soltanian-Zadeh,et al.  Optimal transformation for correcting partial volume averaging effects in magnetic resonance imaging , 1992 .

[24]  L R Schad,et al.  Pharmacokinetic parameters in CNS Gd-DTPA enhanced MR imaging. , 1991, Journal of computer assisted tomography.

[25]  G Brix,et al.  Recurrent rectal cancer: diagnosis with dynamic MR imaging. , 1993, Radiology.

[26]  Hamid Soltanian-Zadeh,et al.  Optimal linear transformation for MRI feature extraction , 1996, IEEE Trans. Medical Imaging.

[27]  Michael Unser,et al.  Weighted averaging of a set of noisy images for maximum signal-to-noise ratio , 1990, IEEE Trans. Acoust. Speech Signal Process..

[28]  J. W. V. Miller,et al.  Optimal Filtering of Radiographic Image Sequences Using Simultaneous Diagonalization , 1984, IEEE Transactions on Medical Imaging.