On the empirical justification of theoretical heuristic transference and learning

The solution of intractable problems implies the use of heuristics. Quantum computers may find use for optimization problems, but have yet to solve any NP-hard problems. This paper demonstrates results in game theory for domain transference and the reuse of problem-solving knowledge through the application of learned heuristics. It goes on to explore the possibilities for the acquisition of heuristics for the solution of the NP-hard TSP problem. Here, it is found that simple heuristics (e.g., pairwise exchange) often work best in the context of more or less sophisticated experimental designs. Often, these problems are not amenable to exclusive logic solutions; but rather, require the application of hybrid approaches predicated on search. In general, such approaches are based on randomization and supported by parallel processing. This means that heuristic solutions emerge from attempts to randomize the search space. The paper goes on to present a constructive proof of the unbounded density of knowledge in support of the Semantic Randomization Theorem (SRT). It highlights this result and its potential impact upon the community of machine learning researchers.

[1]  Nils J. Nilsson,et al.  Principles of Artificial Intelligence , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Steve Renals,et al.  Unsupervised cross-lingual knowledge transfer in DNN-based LVCSR , 2012, 2012 IEEE Spoken Language Technology Workshop (SLT).

[3]  Thouraya Bouabana-Tebibel,et al.  On Heuristic Randomization and Reuse as an Enabler of Domain Transference , 2015, 2015 IEEE International Conference on Information Reuse and Integration.

[4]  G. Chaitin Randomness and Mathematical Proof , 1975 .

[5]  Jie Lu,et al.  Text categorization by fuzzy domain adaptation , 2013, 2013 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[6]  G. Brindley,et al.  THE UNDERSTANDING OF THE BRAIN , 1973 .

[7]  Rich Caruana,et al.  Inductive Transfer for Bayesian Network Structure Learning , 2007, ICML Unsupervised and Transfer Learning.

[8]  Luís A. Alexandre,et al.  Improving Deep Neural Network Performance by Reusing Features Trained with Transductive Transference , 2014, ICANN.

[9]  Jie Lu,et al.  Fuzzy bridged Refinement Domain Adaptation: Long-Term Bank Failure Prediction , 2013, Int. J. Comput. Intell. Appl..

[10]  Daniel L. Silver,et al.  Context-Sensitive MTL Networks for Machine Lifelong Learning , 2007, FLAIRS Conference.

[11]  Jethro Shell,et al.  Fuzzy transfer learning , 2013 .

[12]  Stuart Harvey Rubin,et al.  KASER: knowledge amplification by structured expert randomization , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[13]  Yifan Gong,et al.  Cross-language knowledge transfer using multilingual deep neural network with shared hidden layers , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[14]  Stuart Harvey Rubin On randomization and discovery , 2007, Inf. Sci..

[15]  Edward A. Feigenbaum,et al.  The fifth generation - artificial intelligence and Japan's computer challenge to the world , 1991 .

[16]  Stuart Harvey Rubin On the auto-randomization of knowledge , 2004, Proceedings of the 2004 IEEE International Conference on Information Reuse and Integration, 2004. IRI 2004..

[17]  David B. Fogel,et al.  Blondie24: Playing at the Edge of AI , 2001 .

[18]  John R. Anderson,et al.  MACHINE LEARNING An Artificial Intelligence Approach , 2009 .

[19]  Thouraya Bouabana-Tebibel,et al.  Naval Intelligent Authentication and Support Through Randomization and Transformative Search , 2016, New Approaches in Intelligent Control.

[20]  A. J. Kfoury,et al.  A Programming Approach to Computability , 1982, Texts and Monographs in Computer Science.

[21]  Jie Lu,et al.  Long term bank failure prediction using Fuzzy Refinement-based Transductive Transfer learning , 2011, 2011 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE 2011).

[22]  Luis Enrique Sucar,et al.  Inductive transfer for learning Bayesian networks , 2010, Machine Learning.

[23]  Simon Coupland,et al.  Fuzzy Transfer Learning: Methodology and application , 2015, Inf. Sci..

[24]  Gödel’s Incompleteness Theorems and Physics , 2012 .

[25]  Stuart Harvey Rubin,et al.  On the inherent necessity of heuristic proofs , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[26]  Sumit Chopra,et al.  DLID: Deep Learning for Domain Adaptation by Interpolating between Domains , 2013 .

[27]  Simon Coupland,et al.  Towards Fuzzy Transfer Learning for Intelligent Environments , 2012, AmI.

[28]  Guangchun Luo,et al.  Transfer learning for cross-company software defect prediction , 2012, Inf. Softw. Technol..

[29]  Ahmet Arslan,et al.  Genetic transfer learning , 2010, Expert Syst. Appl..

[30]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[31]  Reinaldo A. C. Bianchi,et al.  Using Cases as Heuristics in Reinforcement Learning: A Transfer Learning Application , 2011, IJCAI.

[32]  Rich Caruana,et al.  Multitask Learning: A Knowledge-Based Source of Inductive Bias , 1993, ICML.

[33]  Ryszard S. Michalski,et al.  Machine learning: an artificial intelligence approach volume III , 1990 .

[34]  Stuart H. Rubin On Creativity and Intelligence in Computational Systems , 2012 .

[35]  H. Longuet-Higgins Understanding the Brain , 1968, Nature.

[36]  Rui Zhang,et al.  Improving Deep Neural Network Performance with Kernelized Min-Max Objective , 2018, ICONIP.

[37]  J. Vitter,et al.  Complexity results on learning by neural nets , 2004, Machine Learning.

[38]  Thouraya Bouabana-Tebibel,et al.  NNCS: Randomization and Informed Search for Novel Naval Cyber Strategies , 2016, Recent Advances in Computational Intelligence in Defense and Security.

[39]  Rich Caruana,et al.  Multitask Learning , 1997, Machine-mediated learning.

[40]  Peng Hao,et al.  Transfer learning using computational intelligence: A survey , 2015, Knowl. Based Syst..

[41]  Jie Lu,et al.  Fuzzy Refinement Domain Adaptation for Long Term Prediction in Banking Ecosystem , 2014, IEEE Transactions on Industrial Informatics.

[42]  Jürgen Schmidhuber,et al.  Transfer learning for Latin and Chinese characters with Deep Neural Networks , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[43]  Jaime G. Carbonell,et al.  Machine learning: a guide to current research , 1986 .

[44]  Terran Lane,et al.  Bayesian Discovery of Multiple Bayesian Networks via Transfer Learning , 2013, 2013 IEEE 13th International Conference on Data Mining.