Constraint Verification With Kernel Machines

Based on a recently proposed framework of learning from constraints using kernel-based representations, in this brief, we naturally extend its application to the case of inferences on new constraints. We give examples for polynomials and first-order logic by showing how new constraints can be checked on the basis of given premises and data samples. Interestingly, this gives rise to a perceptual logic scheme in which the inference mechanisms do not rely only on formal schemes, but also on the data probability distribution. It is claimed that when using a properly relaxed computational checking approach, the complementary role of data samples makes it possible to break the complexity barriers of related formal checking mechanisms.

[1]  Mikhail Belkin,et al.  Laplacian Support Vector Machines Trained in the Primal , 2009, J. Mach. Learn. Res..

[2]  Sriraam Natarajan,et al.  Speeding Up Inference in Markov Logic Networks by Preprocessing to Reduce the Size of the Resulting Grounded Network , 2009, IJCAI.

[3]  Matthew Richardson,et al.  Markov logic networks , 2006, Machine Learning.

[4]  Luc De Raedt,et al.  Probabilistic Inductive Logic Programming , 2004, Probabilistic Inductive Logic Programming.

[5]  Stefanos Zafeiriou,et al.  Efficient Online Subspace Learning With an Indefinite Kernel for Visual Tracking and Recognition , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[6]  Marco Gori,et al.  Bridging logic and kernel machines , 2011, Machine Learning.

[7]  Girish Chowdhary,et al.  A reproducing Kernel Hilbert Space approach for the online update of Radial Bases in neuro-adaptive control , 2011, IEEE Conference on Decision and Control and European Control Conference.

[8]  C. Micchelli,et al.  Universal Multi-Task Kernels , 2008, J. Mach. Learn. Res..

[9]  Milos Krejnik,et al.  Reproducing Kernel Hilbert Spaces With Odd Kernels in Price Prediction , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[10]  Charles A. Micchelli,et al.  Universal Multi-Task Kernels , 2008, J. Mach. Learn. Res..