Taxonomic knowledge structure discovery from imagery-based data using the neural associative incremental learning (NAIL) algorithm

An important component of higher level fusion is knowledge discovery. One form of knowledge is a set of relationships between concepts. This paper addresses the automated discovery of ontological knowledge representations such as taxonomies/thesauri from imagery-based data. Multi-target classification is used to transform each source data point into a set of conceptual predictions from a pre-defined lexicon. This classification pre-processing produces co-occurrence data that is suitable for input to an ontology learning algorithm. A neural network with an associative, incremental learning (NAIL) algorithm processes this co-occurrence data to find relationships between elements of the lexicon, thus uncovering the knowledge structure 'hidden' in the dataset. The efficacy of this approach is demonstrated on a dataset created from satellite imagery of a metropolitan region. The flexibility of the NAIL algorithm is illustrated by employing it on an additional dataset comprised of topic categories from a text document collection. The usefulness of the knowledge structure discovered from the imagery data is illustrated via construction of a Bayesian network, which produces an inference engine capable of exploiting the learned knowledge model. Effective automation of knowledge discovery in an information fusion context has considerable potential for aiding the development of machine-based situation awareness capabilities.

[1]  B. Lees,et al.  Combining Non-Parametric Models for Multisource Predictive Forest Mapping , 2004 .

[2]  Gail A. Carpenter,et al.  Information Fusion and Hierarchical Knowledge Discovery by ARTMAP Neural Networks , 2003 .

[3]  Richard E. Neapolitan,et al.  Learning Bayesian networks , 2007, KDD '07.

[4]  Kevin Murphy,et al.  Bayes net toolbox for Matlab , 1999 .

[5]  Maja J. Mataric,et al.  Learning in Autonomous Robots - Foreword , 1998, Mach. Learn..

[6]  Mehrnoush Shamsfard,et al.  Learning ontologies from natural language texts , 2004, Int. J. Hum. Comput. Stud..

[7]  Gail A. Carpenter,et al.  ARTMAP neural networks for information fusion and data mining: map production and target recognition methodologies , 2003, Neural Networks.

[8]  Gerd Stumme,et al.  FCA-MERGE: Bottom-Up Merging of Ontologies , 2001, IJCAI.

[9]  Steffen Staab,et al.  ECAI'2000 Workshop on Ontology Learning, Proceedings of the First Workshop on Ontology Learning OL'2000, Berlin, Germany, August 25, 2000. Held in conjunction with the 14th European Conference on Artificial Intelligence ECAI'2000, Berlin, Germany , 2000, ECAI Workshop on Ontology Learning.

[10]  Stephen Grossberg,et al.  Studies of mind and brain , 1982 .

[11]  David Faure,et al.  First experiences of using semantic knowledge learned by ASIUM for information extraction task using INTEX , 2000, ECAI Workshop on Ontology Learning.

[12]  Jeremy Kubica,et al.  A Comparison of Statistical and Machine Learning Algorithms on the Task of Link Completion , 2003 .

[13]  Marti A. Hearst.  Automatic Acquisition of Hyponyms from Large Text Corpora , 1992, COLING.

[14]  Borys Omelayenko,et al.  Learning of Ontologies from the Web: the Analysis of Existent Approaches , 2001, WebDyn@ICDT.

[15]  David A. Fay,et al.  Image fusion & mining tools for a COTS environment , 2003, Sixth International Conference of Information Fusion, 2003. Proceedings of the.

[16]  Gerd Stumme,et al.  Conceptual Clustering with Iceberg Concept Lattices , 2001 .

[17]  Mark Gahegan,et al.  Predictive Assessment of Neural Network Classifiers For Applications In GIS , 1997 .

[18]  Andrew W. Moore,et al.  ADtrees for Fast Counting and for Fast Learning of Association Rules , 1998, KDD.

[19]  C. A. Shah,et al.  Some recent results on hyperspectral image classification , 2003, IEEE Workshop on Advances in Techniques for Analysis of Remotely Sensed Data, 2003.

[20]  John W. Lloyd,et al.  Classification of Individuals with Complex Structure , 2000, ICML.

[21]  Steffen Staab,et al.  Taxonomy Learning - Factoring the Structure of a Taxonomy into a Semantic Classification Decision , 2002, COLING.

[22]  Steffen Staab,et al.  Discovering Conceptual Relations from Text , 2000, ECAI.

[23]  Tom M. Mitchell,et al.  Learning to Extract Symbolic Knowledge from the World Wide Web , 1998, AAAI/IAAI.

[24]  David A. Cohn,et al.  cGraph: A Fast Graph-Based Method for Link Analysis and Queries , 2004 .

[25]  Nicolas Pasquier,et al.  Efficient Mining of Association Rules Using Closed Itemset Lattices , 1999, Inf. Syst..

[26]  R. Mike Cameron-Jones,et al.  FOIL: A Midterm Report , 1993, ECML.

[27]  Gerd Stumme,et al.  Computing iceberg concept lattices with T , 2002, Data Knowl. Eng..

[28]  Michael R. Anderberg,et al.  Cluster Analysis for Applications , 1973 .

[29]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[30]  Heikki Mannila,et al.  Finding interesting rules from large sets of discovered association rules , 1994, CIKM '94.

[31]  Steffen Staab,et al.  International Handbooks on Information Systems , 2013 .

[32]  Padmini Srinivasan,et al.  Hierarchical Text Categorization Using Neural Networks , 2004, Information Retrieval.

[33]  Steffen Staab,et al.  Ontology Learning for the Semantic Web , 2002, IEEE Intell. Syst..

[34]  Philip S. Yu,et al.  Applying data mining in investigating money laundering crimes , 2003, KDD '03.

[35]  Jiawei Han,et al.  Mining knowledge at multiple concept levels , 1995, CIKM '95.

[36]  Allen M. Waxman,et al.  A new approach to higher-level information fusion using associative learning in semantic networks of spiking neurons , 2007, Inf. Fusion.

[37]  Ramakrishnan Srikant,et al.  Fast algorithms for mining association rules , 1998, VLDB 1998.

[38]  Joydeep Ghosh,et al.  Adaptive Feature Spaces For Land Cover Classification With Limited Ground Truth Data , 2004, Int. J. Pattern Recognit. Artif. Intell..

[39]  Steffen Staab,et al.  Deriving Concept Hierarchies from Text by Smooth Formal Concept Analysis , 2003 .

[40]  Tom M. Mitchell,et al.  Learning to construct knowledge bases from the World Wide Web , 2000, Artif. Intell..

[41]  Ramakrishnan Srikant,et al.  Fast Algorithms for Mining Association Rules in Large Databases , 1994, VLDB.

[42]  Naftali Tishby,et al.  Distributional Clustering of English Words , 1993, ACL.

[43]  Susie Stephens,et al.  Oracle Data Mining , 2005 .

[44]  G.A. Carpenter,et al.  Information fusion for image analysis: geospatial foundations for higher-level fusion , 2002, Proceedings of the Fifth International Conference on Information Fusion. FUSION 2002. (IEEE Cat.No.02EX5997).

[45]  M E Newman,et al.  Scientific collaboration networks. I. Network construction and fundamental results. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[46]  Gerd Stumme,et al.  Ontology Merging for Federated Ontologies on the Semantic Web , 2001, OIS@IJCAI.

[47]  Jiawei Han,et al.  Knowledge Discovery in Databases: An Attribute-Oriented Approach , 1992, VLDB.

[48]  A. J. Feelders,et al.  MAMBO: Discovering Association Rules Based on Conditional Independencies , 2001, IDA.

[49]  Andrew W. Moore,et al.  Finding Underlying Connections: A Fast Graph-Based Method for Link Analysis and Collaboration Queries , 2003, ICML.

[50]  Geoffrey I. Webb,et al.  An Experimental Evaluation of Integrating Machine Learning with Knowledge Acquisition , 1999, Machine Learning.

[51]  Steffen Staab,et al.  Measuring Similarity between Ontologies , 2002, EKAW.

[52]  Bart Selman,et al.  The Hidden Web , 1997, AI Mag..

[53]  M. Newman,et al.  Scientific collaboration networks. II. Shortest paths, weighted networks, and centrality. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[54]  J. Ross Quinlan,et al.  Learning logical definitions from relations , 1990, Machine Learning.

[55]  Mark Gahegan,et al.  Specifying the transformations within and between geographic data models , 1996, Trans. GIS.

[56]  Ramakrishnan Srikant,et al.  Mining generalized association rules , 1995, Future Gener. Comput. Syst..

[57]  Jim E. Greer,et al.  A Comparison of Association Rule Discovery and Bayesian Network Causal Inference Algorithms to Discover Relationships in Discrete Data , 2000, Canadian Conference on AI.