Learning with Intelligent Teacher

The paper considers several topics on learning with privileged information: 1 general machine learning models, where privileged information is positioned as the main mechanism to improve their convergence properties, 2 existing and novel approaches to leverage that privileged information, 3 algorithmic realization of one of these namely, knowledge transfer approaches, and its performance characteristics, illustrated on simple synthetic examples.

[1]  Rauf Izmailov,et al.  Learning using privileged information: similarity control and knowledge transfer , 2015, J. Mach. Learn. Res..

[2]  Ning Chen,et al.  Enhanced default risk models with SVM+ , 2012, Expert Syst. Appl..

[3]  Rauf Izmailov,et al.  SMO-Style Algorithms for Learning Using Privileged Information , 2010, DMIN.

[4]  G. Wahba,et al.  Some results on Tchebycheffian spline functions , 1971 .

[5]  Heng Yang,et al.  Privileged information-based conditional regression forest for facial feature detection , 2013, 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[6]  Rauf Izmailov,et al.  Learning with Intelligent Teacher: Similarity Control and Knowledge Transfer - In memory of Alexey Chervonenkis , 2015, SLDS.

[7]  Vladimir Vapnik,et al.  Estimation of Dependences Based on Empirical Data: Empirical Inference Science (Information Science and Statistics) , 2006 .

[8]  Christoph H. Lampert,et al.  Learning to Rank Using Privileged Information , 2013, 2013 IEEE International Conference on Computer Vision.

[9]  Peter Tiño,et al.  Incorporating Privileged Information Through Metric Learning , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[10]  Rauf Izmailov,et al.  Multidimensional splines with infinite number of knots as SVM kernels , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[11]  Rauf Izmailov,et al.  Learning with Privileged Information for Improved Target Classification , 2014, Int. J. Monit. Surveillance Technol. Res..

[12]  Hector J. Levesque,et al.  Knowledge Representation and Reasoning , 2004 .

[13]  Vladimir Vapnik,et al.  A new learning paradigm: Learning using privileged information , 2009, Neural Networks.

[14]  Christopher J. C. Burges,et al.  Simplified Support Vector Decision Rules , 1996, ICML.

[15]  Bernhard Schölkopf,et al.  A Generalized Representer Theorem , 2001, COLT/EuroCOLT.

[16]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[17]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .