Modelling for understanding AND for prediction / classification-the power of neural networks in research

Two articles, Edelsbrunner and, Schneider (2013), and Nokelainen and Silander (2014) comment on Musso, Kyndt, Cascallar, and Dochy (2013). Several relevant issues are raised and some important clarifications are made in response to both commentaries. Predictive systems based on artificial neural networks continue to be the focus of current research and several advances have improved the model building and the interpretation of the resulting neural network models. What is needed is the courage and open-mindedness to actually explore new paths and rigorously apply new methodologies which can perhaps, sometimes unexpectedly, provide new conceptualisations and tools for theoretical advancement and practical applied research. This is particularly true in the fields of educational science and social sciences, where the complexity of the problems to be solved requires the exploration of proven methods and new methods, the latter usually not among the common arsenal of tools of neither practitioners nor researchers in these fields. This response will enrich the understanding of the predictive systems methodology proposed by the authors and clarify the application of the procedure, as well as give a perspective on its place among other predictive approaches.

[1]  Kamel Jedidi,et al.  A Hierarchical Bayesian Methodology for Treating Heterogeneity in Structural Equation Models , 2000 .

[2]  Wynne W. Chin,et al.  A Partial Least Squares Latent Variable Modeling Approach for Measuring Interaction Effects: Results from a Monte Carlo Simulation Study and an Electronic - Mail Emotion/Adoption Study , 2003, Inf. Syst. Res..

[3]  M. Angélica Pinninghoff Junemann,et al.  Neural Networks to Predict Schooling Failure/Success , 2007, IWINAC.

[4]  Michael S. Garver,et al.  Structured Neural Network Techniques for Modeling Loyalty and Profitability , 2005 .

[5]  I. Dimopoulos,et al.  Role of some environmental variables in trout abundance models using neural networks , 1996 .

[6]  G. David Garson,et al.  Interpreting neural-network connection weights , 1991 .

[7]  David J. C. MacKay,et al.  A Practical Bayesian Framework for Backpropagation Networks , 1992, Neural Computation.

[8]  Lucila Ohno-Machado,et al.  Logistic regression and artificial neural network classification models: a methodology review , 2002, J. Biomed. Informatics.

[9]  Michael Schneider,et al.  Modelling for Prediction vs. Modelling for Understanding: Commentary on Musso et al. (2013) , 2013 .

[10]  Léon Personnaz,et al.  Construction of confidence intervals for neural networks based on least squares estimation , 2000, Neural Networks.

[11]  Jeffrey S. Racine,et al.  Statistical inference, the bootstrap, and neural-network modeling with application to foreign exchange rates , 2001, IEEE Trans. Neural Networks.

[12]  Haitham Al-Deek,et al.  Which Method Is Better for Developing Freight Planning Models at Seaports—Neural Networks or Multiple Regression? , 2001 .

[13]  Arun Agrawal,et al.  Explaining success on the commons: Community forest governance in the Indian Himalaya , 2006 .

[14]  Jiang Li,et al.  Confidence Intervals for Neural Networks and Applications to Modeling Engineering Materials , 2011 .

[15]  F. Dochy,et al.  Grasping the dynamic complexity of team learning: An integrative model for effective team learning in organisations , 2010 .

[16]  Heikki Mannila,et al.  Principles of Data Mining , 2001, Undergraduate Topics in Computer Science.

[17]  Ignacio Requena,et al.  Are artificial neural networks black boxes? , 1997, IEEE Trans. Neural Networks.

[18]  Rebecca Weston,et al.  A Brief Guide to Structural Equation Modeling , 2006 .

[19]  Ulrich Anders,et al.  Model selection in neural networks , 1999, Neural Networks.

[20]  Kristen Bell DeTienne,et al.  Neural Networks as Statistical Tools for Business Researchers , 2003 .

[21]  Ralph Grishman,et al.  Message Understanding Conference- 6: A Brief History , 1996, COLING.

[22]  Bill C. Hardgrave,et al.  Predicting Graduate Student Success in an MBA Program: Regression Versus Classification , 1995 .

[23]  Achilleas Zapranis,et al.  Prediction intervals for neural network models , 2005 .

[24]  Denis J. Dean,et al.  Comparative accuracies of artificial neural networks and discriminant analysis in predicting forest cover types from cartographic variables , 1999 .

[25]  R. Harré.  Models in Science. , 1978 .

[26]  Carolina Zambrano Matamala,et al.  Análisis de rendimiento académico estudiantil usando data warehouse y redes neuronales Analysis of students' academic performance using data warehouse and neural networks , 2011 .

[27]  Huub van den Bergh,et al.  Methodological challenges in research on student learning , 2015 .

[28]  Yoshua Bengio,et al.  Pattern Recognition and Neural Networks , 1995 .

[29]  Russell G. Death,et al.  An accurate comparison of methods for quantifying variable importance in artificial neural networks using simulated data , 2004 .

[30]  Lior Rokach,et al.  Ensemble-based classifiers , 2010, Artificial Intelligence Review.

[31]  A. Agrawal.  Common Property Institutions and Sustainable Governance of Resources , 2001 .

[32]  Kwan-Liu Ma,et al.  Intelligent Feature Extraction and Tracking for Visualizing Large-Scale 4D Flow Simulations , 2005, ACM/IEEE SC 2005 Conference (SC'05).

[33]  Sholom M. Weiss,et al.  Computer Systems That Learn , 1990 .

[34]  Patrick L. Brockett,et al.  A Comparative Analysis of Neural Networks and Statistical Methods for Predicting Consumer Choice , 1997 .

[35]  F. Dochy,et al.  Predicting general academic performance and identifying the differential contribution of participating variables using artificial neural networks , 2013 .

[36]  Caroline Di Bernardi Luft,et al.  Using online cognitive tasks to predict mathematics low school achievement , 2013, Comput. Educ..

[37]  Pui‐wa Lei,et al.  Introduction to Structural Equation Modeling: Issues and Practical Considerations , 2007 .

[38]  M. Boekaerts,et al.  Assessment in the Evaluation of Self-Regulation as a Process , 2006 .

[39]  Ulrich J. Frey,et al.  Research, part of a Special Feature on A Framework for Analyzing, Comparing, and Diagnosing Social-Ecological Systems Using Artificial Neural Networks for the Analysis of Social-Ecological Systems , 2013 .

[40]  Nghiep Nguyen,et al.  Predicting Housing Value: A Comparison of Multiple Regression Analysis and Artificial Neural Networks , 2001 .

[41]  John S. Bridle,et al.  Neural Networks or Hidden Markov Models for Automatic Speech Recognition: Is there a Choice? , 1992 .

[42]  Fabio Roli,et al.  Methods for Designing Multiple Classifier Systems , 2001, Multiple Classifier Systems.

[43]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[44]  R. Bhaskaran,et al.  A CHAID Based Performance Prediction Model in Educational Data Mining , 2010, ArXiv.

[45]  Frank Huber,et al.  Capturing Customer Heterogeneity using a Finite Mixture PLS Approach , 2002 .

[46]  Tony R. Martinez,et al.  Turning Bayesian model averaging into Bayesian model combination , 2011, The 2011 International Joint Conference on Neural Networks.

[47]  Heejune Ahn,et al.  A New Perspective for Neural Networks: Application to a Marketing Management Problem , 2009, J. Inf. Sci. Eng..

[48]  Eva Kyndt,et al.  Predicting Mathematical Performance: The Effect of Cognitive Processes and Self-Regulation Factors , 2012 .

[49]  Chi Leung Patrick Hui,et al.  Artificial Neural Networks - Application , 2011 .

[50]  Jon Atli Benediktsson,et al.  Multiple Classifier Systems , 2015, Lecture Notes in Computer Science.

[51]  Jan de Leeuw,et al.  MODELS OF DATA , 2000 .

[52]  D. M. Titterington,et al.  Neural Networks: A Review from a Statistical Perspective , 1994 .

[53]  Mark J. Kamstra,et al.  Neural network forecast combining with interaction effects , 1999 .

[54]  G. David Garson,et al.  Neural Networks: An Introductory Guide for Social Scientists , 1999 .

[55]  Leorey Marquez,et al.  Neural network models as an alternative to regression , 1991, Proceedings of the Twenty-Fourth Annual Hawaii International Conference on System Sciences.

[56]  M. Boekaerts,et al.  How Far Have We Moved Toward the Integration of Theory and Practice in Self-Regulation? , 2006 .

[57]  G. Coco,et al.  Complex Positive Connections between Functional Groups Are Revealed by Neural Network Analysis of Ecological Time Series , 2008, The American Naturalist.

[58]  F. Dochy,et al.  Predicting academic performance: The role of cognition, motivation and learning approaches. A neural network analysis , 2015 .

[59]  Nathan Intrator,et al.  Interpreting neural-network results: a simulation study , 2001 .

[60]  A. Lansner,et al.  Bayesian neural networks with confidence estimations applied to data mining , 2000 .

[61]  I-Cheng Yeh,et al.  First and second order sensitivity analysis of MLP , 2010, Neurocomputing.

[62]  Hudson Golino,et al.  Four Machine Learning Methods to Predict Academic Achievement of College Students : A Comparison Study , 2014 .

[63]  Rafael Martí,et al.  Neural network prediction in a system for optimizing simulations , 2002 .

[64]  Eva Kyndt,et al.  Predicting academic performance in higher education: Role of cognitive, learning and motivation , 2011 .

[65]  Filipe Aires,et al.  Neural Network Uncertainty Assessment Using Bayesian Statistics: A Remote Sensing Application , 2004, Neural Computation.

[66]  A. Tarski,et al.  Logic, Methodology and Philosophy of Science Proceedings of the 1960 International Congress , 1962 .

[67]  M. Gevrey,et al.  Review and comparison of methods to study the contribution of variables in artificial neural network models , 2003 .

[68]  JEFF RACINEAbstra,et al.  Statistical Inference, The Bootstrap, And Neural Network Modeling With Application To Foreign Exchange Rates , 2000 .

[69]  Karin Schermelleh-Engel,et al.  Evaluation of model fit in nonlinear multilevel structural equation modeling , 2013, Front. Psychol..

[70]  Julian D. Olden,et al.  Illuminating the “black box”: a randomization approach for understanding variable contributions in artificial neural networks , 2002 .

[71]  Daniel W. Apley,et al.  Image denoising with a multi-phase kernel principal component approach and an ensemble version , 2011, 2011 IEEE Applied Imagery Pattern Recognition Workshop (AIPR).

[72]  A. Kaplan,et al.  A Beginner's Guide to Partial Least Squares Analysis , 2004 .