Behavior of Analogical Inference w.r.t. Boolean Functions

It has been observed that a particular form of analogical inference, based on analogical proportions, yields competitive results in classification tasks. Using the algebraic normal form of Boolean functions, it has been shown that analogical prediction is always exact iff the labeling function is affine. We point out that affine functions are also meaningful when using another view of analogy. We address the accuracy of analogical inference for arbitrary Boolean functions and show that if a function is ε-close to an affine function, then the probability of making a wrong prediction is upper bounded by 4ε. This result is confirmed by an empirical study showing that the upper bound is tight. It highlights the specificity of analogical inference, also characterized in terms of the Hamming distance.

[1]  Sturart J. Russell,et al.  The use of knowledge in analogy and induction , 1989 .

[2]  Manuel Blum,et al.  Self-testing/correcting with applications to numerical problems , 1990, STOC '90.

[3]  V. Stepin,et al.  Culture , 2003 .

[4]  Gilles Richard,et al.  Analogy-based classifiers for nominal or numerical data , 2017, Int. J. Approx. Reason..

[5]  Kai-Uwe Kühnberger,et al.  Metaphors and heuristic-driven theory projection (HDTP) , 2006, Theor. Comput. Sci..

[6]  Simon Litsyn,et al.  Breaking the ε-Soundness Bound of the Linearity Test over GF(2) , 2007, Electron. Colloquium Comput. Complex..

[7]  M. Stone,et al.  The Theory of Representation for Boolean Algebras , 1936 .

[8]  Laurent Miclet,et al.  Analogical Dissimilarity: Definition, Algorithms and Two Experiments in Machine Learning , 2008, J. Artif. Intell. Res..

[9]  François Yvon,et al.  Analogical Learning and Formal Proportions : Definitions and Methodological Issues Apprentissage par analogie et proportions formelles : définitions et aspects méthodologiques , 2005 .

[10]  Laurent Miclet,et al.  Learning by Analogy: A Classification Rule for Binary and Nominal Data , 2007, IJCAI.

[11]  Kristen Grauman,et al.  Analogy-preserving Semantic Embedding for Visual Object Categorization , 2013, ICML.

[12]  Jean-Yves Béziau From analogical proportion to logical proportions , 2013 .

[13]  Gilles Richard,et al.  Analogy-preserving functions: A way to extend Boolean samples , 2017, IJCAI.

[14]  Stuart J. Russell,et al.  A Logical Approach to Reasoning by Analogy , 1987, IJCAI.

[15]  Gang Hua,et al.  Visual attribute transfer through deep image analogy , 2017, ACM Trans. Graph..

[16]  Á. Szendrei On closed classes of quasilinear functions , 1980 .

[17]  Gilles Richard,et al.  Analogical Classifiers: A Theoretical Perspective , 2016, ECAI.

[18]  D. Lau,et al.  Function Algebras on Finite Sets: Basic Course on Many-Valued Logic and Clone Theory (Springer Monographs in Mathematics) , 2006 .

[19]  Henri Prade,et al.  Handling Analogical Proportions in Classical Logic and Fuzzy Logics Settings , 2009, ECSQARU.

[20]  Klaus Denecke,et al.  Universal Algebra and Applications in Theoretical Computer Science , 2018 .