Early Machine Learning Research in Ljubljana

We describe early machine learning research in Ljubljana, motivated by medical diagnostic problems, in the areas of building decision trees with Assistant, the development of Naive and Semi-Naive Bayesian classifier and its explanations of individual predictions, and the development of ReliefF and RReliefF algorithms for non-myopic evaluation of attributes in classification and regression, respectively.

[1]  L. Stein,et al.  Probability and the Weighing of Evidence , 1950 .

[2]  Bojan Cestnik,et al.  Estimating Probabilities: A Crucial Task in Machine Learning , 1990, ECAI.

[3]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[4]  Larry A. Rendell,et al.  A Practical Approach to Feature Selection , 1992, ML.

[5]  Irving John Good,et al.  The Estimation of Probabilities: An Essay on Modern Bayesian Methods , 1965 .

[6]  Ming Li,et al.  An Introduction to Kolmogorov Complexity and Its Applications , 1997, Texts in Computer Science.

[7]  Igor Kononenko,et al.  Machine learning for medical diagnosis: history, state of the art and perspective , 2001, Artif. Intell. Medicine.

[8]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[9]  Igor Kononenko,et al.  Bayesian neural networks , 1989, Biological Cybernetics.

[10]  Igor Kononenko,et al.  Semi-Naive Bayesian Classifier , 1991, EWSL.

[11]  Marko Robnik-Sikonja,et al.  An adaptation of Relief for attribute estimation in regression , 1997, ICML.

[12]  Igor Kononenko,et al.  The Minimum Description Length Based Decision Tree Pruning , 1998, PRICAI.

[13]  J. R. Quinlan.  Discovering rules by induction from large collections of examples Intro-ductory readings in expert s , 1979 .

[14]  Erik Strumbelj,et al.  Explanation and Reliability of Individual Predictions , 2013, Informatica.

[15]  Igor Kononenko,et al.  On Biases in Estimating Multi-Valued Attributes , 1995, IJCAI.

[16]  Donald Michie,et al.  Expert systems in the micro-electronic age , 1979 .

[17]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[18]  Igor Kononenko,et al.  Efficient Induction and Effective Use of First-Order Knowledge , 1998, Appl. Artif. Intell..

[19]  Ivan Bratko,et al.  Experiments in automatic learning of medical diagnostic rules , 1984 .

[20]  Ivan Bratko,et al.  On Estimating Probabilities in Tree Pruning , 1991, EWSL.

[21]  Igor Kononenko,et al.  Estimating Attributes: Analysis and Extensions of RELIEF , 1994, ECML.

[22]  Ivan Bratko,et al.  ASSISTANT 86: A Knowledge-Elicitation Tool for Sophisticated Users , 1987, EWSL.