Logarithmic simulated annealing for X-ray diagnosis

We present a new stochastic learning algorithm and first results of computational experiments on fragments of liver CT images. The algorithm is designed to compute a depth-three threshold circuit, where the first layer is calculated by an extension of the Perceptron algorithm by a special type of simulated annealing. The fragments of CT images are of size 119x119 with eight bit grey levels. From 348 positive (focal liver tumours) and 348 negative examples a number of hypotheses of the type w(1)x(1)+. . .;+w(n)x(n)>/=theta were calculated for n=14161. The threshold functions at levels two and three were determined by computational experiments. The circuit was tested on various sets of 50+50 additional positive and negative examples. For depth-three circuits, we obtained a correct classification of about 97%. The input to the algorithm is derived from the DICOM standard representation of CT images. The simulated annealing procedure employs a logarithmic cooling schedule c(k)=Gamma/ln(k+2), where Gamma is a parameter that depends on the underlying configuration space. In our experiments, the parameter Gamma is chosen according to estimations of the maximum escape depth from local minima of the associated energy landscape.

[1]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[2]  A. A. Mullin,et al.  Principles of neurodynamics , 1962 .

[3]  Chak-Kuen Wong,et al.  On Logarithmic Simulated Annealing , 2000, IFIP TCS.

[4]  David B. Fogel,et al.  Evolving artificial neural networks for screening features from mammograms , 1998, Artif. Intell. Medicine.

[5]  Thomas Roß,et al.  Feature selection for optimized skin tumor recognition using genetic algorithms , 1999, Artif. Intell. Medicine.

[6]  Yan Zhu,et al.  Computerized tumor boundary detection using a Hopfield neural network , 1997, IEEE Transactions on Medical Imaging.

[7]  Kwong-Sak Leung,et al.  An expert system for the detection of cervical cancer cells using knowledge-based image analyzer , 1996, Artif. Intell. Medicine.

[8]  Alvaro L. Ronco,et al.  Use of artificial neural networks in modeling associations of discriminant factors: towards an intelligent selective breast cancer screening , 1999, Artif. Intell. Medicine.

[9]  Edith Cohen,et al.  Learning noisy perceptrons by a perceptron in polynomial time , 1997, Proceedings 38th Annual Symposium on Foundations of Computer Science.

[10]  Moshe Sipper,et al.  A fuzzy-genetic approach to breast cancer diagnosis , 1999, Artif. Intell. Medicine.

[11]  Olivier Catoni,et al.  Metropolis, Simulated Annealing, and Iterated Energy Transformation Algorithms: Theory and Experiments , 1996, J. Complex..

[12]  Emile H. L. Aarts,et al.  Simulated annealing and Boltzmann machines - a stochastic approach to combinatorial optimization and neural computing , 1990, Wiley-Interscience series in discrete mathematics and optimization.

[13]  S. Agmon The Relaxation Method for Linear Inequalities , 1954, Canadian Journal of Mathematics.

[14]  Bruce E. Hajek,et al.  Cooling Schedules for Optimal Annealing , 1988, Math. Oper. Res..

[15]  Andreas Alexander Albrecht,et al.  Stochastic Simulations of Two-Dimensional Composite Packings , 1997 .

[16]  Tom Bylander,et al.  Learning linear threshold functions in the presence of classification noise , 1994, COLT '94.

[17]  Tom Bylander Learning Linear Threshold Approximations Using Perceptrons , 1995, Neural Computation.

[18]  Alan M. Frieze,et al.  A Polynomial-Time Algorithm for Learning Noisy Linear Threshold Functions , 1996, Algorithmica.

[19]  Kunio Doi,et al.  Neural network approach for differential diagnosis of interstitial lung diseases , 1990, Medical Imaging: Image Processing.

[20]  V. Cerný Thermodynamical approach to the traveling salesman problem: An efficient simulation algorithm , 1985 .

[21]  Eric B. Baum,et al.  The Perceptron Algorithm is Fast for Nonmalicious Distributions , 1990, Neural Computation.

[22]  Stephen I. Gallant,et al.  Perceptron-based learning algorithms , 1990, IEEE Trans. Neural Networks.

[23]  Y. Wu,et al.  Potential usefulness of an artificial neural network for differential diagnosis of interstitial lung diseases: pilot study. , 1990, Radiology.

[24]  L. Mango Computer-assisted cervical cancer screening using neural networks. , 1994, Cancer Letters.

[25]  Xiaohong Li,et al.  Labeling of MR brain images using Boolean neural network , 1996, IEEE Trans. Medical Imaging.

[26]  Hong Yan,et al.  Computerized tumour boundary detection using a Hopfield neural network , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[27]  Chak-Kuen Wong,et al.  On Various Cooling Schedules for Simulated Annealing Applied to the Job Shop Problem , 1998, RANDOM.