Bounded-depth threshold circuits for computer-assisted CT image classification

We present a stochastic algorithm that computes threshold circuits designed to discriminate between two classes of computed tomography (CT) images. The algorithm employs a partition of training examples into several classes according to the average grey scale value of images. For each class, a sub-circuit is computed, where the first layer of the sub-circuit is calculated by a new combination of the Perceptron algorithm with a special type of simulated annealing. The algorithm is evaluated for the case of liver tissue classification. A depth-five threshold circuit (with pre-processing: depth-seven) is calculated from 400 positive (abnormal findings) and 400 negative (normal liver tissue) examples. The examples are of size n=14,161 (119 x 119) with an 8 bit grey scale. On test sets of 100 positive and 100 negative examples (all different from the learning set) we obtain a correct classification close to 99%. The total sequential run-time to compute a depth-five circuit is about 75h up to 230h on a SUN Ultra 5/360 workstation, depending on the width of the threshold circuit at depth-three. In our computational experiments, the depth-five circuits were calculated from three simultaneous runs for depth-four circuits. The classification of a single image is performed within a few seconds.

[1]  Pavel Pudlák,et al.  Threshold circuits of bounded depth , 1987, 28th Annual Symposium on Foundations of Computer Science (sfcs 1987).

[2]  Kristin P. Bennett,et al.  Multicategory Classification by Support Vector Machines , 1999, Comput. Optim. Appl..

[3]  Geoffrey Holmes,et al.  Experiences with a weighted decision tree learner , 2001 .

[4]  Y. Wu,et al.  Potential usefulness of an artificial neural network for differential diagnosis of interstitial lung diseases: pilot study. , 1990, Radiology.

[5]  O. Mangasarian,et al.  Multisurface method of pattern separation for medical diagnosis applied to breast cytology. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[6]  Thomas Roß,et al.  Feature selection for optimized skin tumor recognition using genetic algorithms , 1999, Artif. Intell. Medicine.

[7]  J. K. Lenstra,et al.  Local Search in Combinatorial Optimisation. , 1997 .

[8]  Moshe Sipper,et al.  A fuzzy-genetic approach to breast cancer diagnosis , 1999, Artif. Intell. Medicine.

[9]  Kwong-Sak Leung,et al.  An expert system for the detection of cervical cancer cells using knowledge-based image analyzer , 1996, Artif. Intell. Medicine.

[10]  A. A. Mullin,et al.  Principles of neurodynamics , 1962 .

[11]  Kunio Doi,et al.  Neural network approach for differential diagnosis of interstitial lung diseases , 1990, Medical Imaging: Image Processing.

[12]  Paul E. Utgoff,et al.  Many-Layered versus Few-Layered Learning TITLE2: , 2001 .

[13]  Yoav Freund,et al.  Boosting the margin: A new explanation for the effectiveness of voting methods , 1997, ICML.

[14]  Bruce E. Hajek,et al.  Cooling Schedules for Optimal Annealing , 1988, Math. Oper. Res..

[15]  Chak-Kuen Wong,et al.  Logarithmic simulated annealing for X-ray diagnosis , 2001, Artif. Intell. Medicine.

[16]  William Nick Street,et al.  Breast Cancer Diagnosis and Prognosis Via Linear Programming , 1995, Oper. Res..

[17]  David B. Fogel,et al.  Evolving artificial neural networks for screening features from mammograms , 1998, Artif. Intell. Medicine.

[18]  Alvaro L. Ronco,et al.  Use of artificial neural networks in modeling associations of discriminant factors: towards an intelligent selective breast cancer screening , 1999, Artif. Intell. Medicine.