Fuzzy-set-based hierarchical networks for information fusion in computer vision

A new methodology based on fuzzy-set-theoretic connectives to achieve information fusion in computer vision systems is introduced. The proposed scheme may be treated as a neural network in which fuzzy aggregation functions are used as activation functions. The scheme involves generating degrees of satisfaction (memberships) of various decision criteria and aggregating the memberships in a hierarchical network. The nature and the parameters of the aggregation connectives are learnt through neural network training procedures. We present techniques to determine the structure of such networks when this structure is only approximately known. These techniques also provide a mechanism for selecting powerful features and discarding irrelevant features via the detection of redundancies. Another attractive feature of the proposed approach is that the networks that result after training can be interpreted as a set of ''rules'' that may be used for decision making. Applications of this method in various computer vision tasks are presented.

[1]  George J. Klir,et al.  Fuzzy sets, uncertainty and information , 1988 .

[2]  Jerome A. Feldman,et al.  Connectionist Models and Their Properties , 1982, Cogn. Sci..

[3]  Ren C. Luo,et al.  Multisensor integration and fusion in intelligent systems , 1989, IEEE Trans. Syst. Man Cybern..

[4]  Jake K. Aggarwal,et al.  Experiments in Intensity Guided Range Sensing Recognition of Three-Dimensional Objects , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Stefanos Kollias,et al.  An adaptive least squares algorithm for the efficient training of artificial neural networks , 1989 .

[6]  L. W. Tucker,et al.  Object recognition using the Connection Machine , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  Samir I. Shaheen,et al.  A Modular Computer Vision System for Picture Segmentation and Interpretation , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Allen R. Hanson,et al.  A Methodology for the Development of General Knowledge-Based Vision Systems , 1984, Wissensbasierte Systeme.

[9]  B. Malakooti,et al.  On training of artificial neural networks , 1989, International 1989 Joint Conference on Neural Networks.

[10]  H. Zimmermann,et al.  Latent connectives in human decision making , 1980 .

[11]  J. Keller,et al.  AN APPROXIMATE REASONING TECHNIQUE FOR RECOGNITION IN COLOR IMAGES OF BEEF STEAKS , 1990 .

[12]  Norio Baba,et al.  A new approach for finding the global minimum of error function of neural networks , 1989, Neural Networks.

[13]  Edward H. Shortliffe,et al.  A Method for Managing Evidential Reasoning in a Hierarchical Hypothesis Space , 1985, Artif. Intell..

[14]  M. Mizumoto.  Pictorial representations of fuzzy connectives, part I: cases of t-norms, t-conorms and averaging operators , 1989 .

[15]  Terrance L. Huntsberger,et al.  Representation of Uncertainty in Computer Vision Using Fuzzy Sets , 1986, IEEE Transactions on Computers.

[16]  Didier Dubois,et al.  A review of fuzzy set aggregation connectives , 1985, Inf. Sci..

[17]  Ronald R. Yager,et al.  On ordered weighted averaging aggregation operators in multicriteria decision-making , 1988 .

[18]  Terrance L. Huntsberger,et al.  Comparison Of Techniques For Sensor Fusion Under Uncertain Conditions , 1989, Optics East.

[19]  Judea Pearl,et al.  Fusion, Propagation, and Structuring in Belief Networks , 1986, Artif. Intell..

[20]  R. Yager.  On a general class of fuzzy connectives , 1980 .

[21]  A. Owens,et al.  Efficient training of the backpropagation network by solving a system of stiff ordinary differential equations , 1989, International 1989 Joint Conference on Neural Networks.

[22]  H. Zimmermann,et al.  Decisions and evaluations by hierarchical aggregation of information , 1983 .

[23]  Peter K. Allen,et al.  Integrating Vision and Touch for Object Recognition Tasks , 1988, Int. J. Robotics Res..

[24]  John M. Richardson,et al.  Fusion of Multisensor Data , 1988, Int. J. Robotics Res..

[25]  Ronald R. Yager,et al.  On ordered weighted averaging aggregation operators in multicriteria decisionmaking , 1988, IEEE Trans. Syst. Man Cybern..

[26]  L. Zadeh,et al.  Fuzzy sets and applications : selected papers , 1987 .

[27]  H. Zimmermann,et al.  On the suitability of minimum and product operators for the intersection of fuzzy sets , 1979 .

[28]  Victor R. Lesser,et al.  A Multi-Level Organization For Problem Solving Using Many, Diverse, Cooperating Sources Of Knowledge , 1975, IJCAI.

[29]  Jerome A. Feldman,et al.  Connectionist models and parallelism in high level vision , 1985, Comput. Vis. Graph. Image Process..

[30]  Didier Dubois,et al.  A class of fuzzy measures based on triangular norms , 1982 .

[31]  Richard W. Conners,et al.  A Theoretical Comparison of Texture Algorithms , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Rodney A. Brooks,et al.  Symbolic Reasoning Among 3-D Models and 2-D Images , 1981, Artif. Intell..

[33]  Joel Weisman,et al.  Introduction to optimization theory , 1973 .

[34]  Glenn Shafer,et al.  Implementing Dempster's Rule for Hierarchical Evidence , 1987, Artif. Intell..

[35]  Joonwhoan Lee,et al.  Fuzzy-connective-based hierarchical aggregation networks for decision making , 1992 .

[36]  Ze-Nian Li,et al.  Uncertainty management in a pyramid vision system , 1989, Int. J. Approx. Reason..

[37]  M. Mizumoto.  Pictorial representations of fuzzy connectives, Part II: cases of compensatory operators and self-dual operators , 1989 .

[38]  Keith Michael Andress,et al.  Evidence accumulation & flow of control , 1988 .

[39]  Daniel Sabbah.  Computing with connections in visual recognition of origami objects , 1985 .

[40]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[41]  Jake K. Aggarwal,et al.  Integrated Analysis of Thermal and Visual Images for Scene Interpretation , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[42]  T. Kanade,et al.  The 3D MOSAIC scene understanding system: incremental reconstruction of 3D scenes for complex images , 1987 .

[43]  Sergei Ovchinnikov,et al.  Fuzzy sets and applications , 1987 .

[44]  W. Pedrycz,et al.  Generalized means as model of compensative connectives , 1984 .

[45]  Jake K. Aggarwal,et al.  Multiple Sensor Integration/Fusion Through Image Processing: A Review , 1986 .

[46]  James M. Keller,et al.  Fuzzy Confidence Measures in Midlevel Vision , 1987, IEEE Transactions on Systems, Man, and Cybernetics.