The predictive accuracy of computer-based classification decision techniques.A review and research directions

Computer-based classification decision (CBCD) techniques can be important assets to organizations. However, empirical research evaluating CBCD performance has been inconsistent, resulting in a lack of understanding concerning various techniques' relative merits. An important reason for this is the absence of a theoretically-based research framework that can increase the productivity of CBCD empirical work. Employing statistical prediction theory, this paper provides such a framework. Research productivity can be improved by using the framework to help focus investigations on potentially important areas. A review of the empirical CBCD literature indicates that, though many of the propositions derived from the framework are acknowledged as important, few have been examined. Research productivity can also be improved when researchers are able to make judgments concerning the similarity of research contexts. For example, if characteristics important to CBCD accuracy are used to describe data sets employed, subsequent research can use such descriptions to create research designs that build on and extend previous research efforts. The framework offered in this paper enables such judgments.

[1]  James V. Hansen,et al.  Inducing rules for expert system development: an example using default and bankruptcy data , 1988 .

[2]  S. Selcuk Erenguc,et al.  Survey of mathematical programming models and experimental results for linear discriminant analysis , 1990 .

[3]  Bernard Widrow,et al.  The basic ideas in neural networks , 1994, CACM.

[4]  Ting-Peng Liang,et al.  A composite approach to inducing knowledge for expert systems design , 1992 .

[5]  E A Joachimsthaler,et al.  Mathematical Programming Approaches for the Classification Problem in Two-Group Discriminant Analysis. , 1990, Multivariate behavioral research.

[6]  Mark S. Silver,et al.  Rule‐Based Expert Systems and Linear Models: An Empirical Comparison of Learning‐By‐Examples Methods* , 1992 .

[7]  George S. Fishman,et al.  Solution of Large Networks by Matrix Methods , 1976, IEEE Transactions on Systems, Man, and Cybernetics.

[8]  Michael Y. Hu,et al.  An experimental evaluation of neural networks for classification , 1993, Comput. Oper. Res..

[9]  Michael W. Kattan,et al.  A Comparison of Machine Learning with Human Judgment , 1993, J. Manag. Inf. Syst..

[10]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[11]  Douglas H. Fisher,et al.  An Empirical Comparison of ID3 and Back-propagation , 1989, IJCAI.

[12]  Timothy Paul Cronan,et al.  Production System Development for Expert Systems Using a Recursive Partitioning Induction Approach: An Application to Mortgage, Commercial, and Consumer Lending , 1991 .

[13]  Patrick K. Simpson,et al.  Artificial Neural Systems: Foundations, Paradigms, Applications, and Implementations , 1990 .

[14]  J. Ross Quinlan,et al.  Unknown Attribute Values in Induction , 1989, ML.

[15]  Richard A. Johnson,et al.  Applied Multivariate Statistical Analysis , 1983 .

[16]  Randolph B. Cooper,et al.  Review of management information systems research: A management support emphasis , 1988, Inf. Process. Manag..

[17]  Ingoo Han,et al.  Integrating statistical and inductive learning methods for knowledge acquisition , 1990 .

[18]  Halbert White,et al.  Learning in Artificial Neural Networks: A Statistical Perspective , 1989, Neural Computation.

[19]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[20]  Duane Davis,et al.  Business research for decision making , 1985 .

[21]  Norman R. Draper,et al.  Applied regression analysis (2. ed.) , 1981, Wiley series in probability and mathematical statistics.

[22]  Pamela K. Coats,et al.  Recognizing Financial Distress Patterns Using a Neural Network Tool , 1993 .

[23]  Melody Y. Kiang,et al.  Managerial Applications of Neural Networks: The Case of Bank Failure Predictions , 1992 .

[24]  James V. Hansen,et al.  Artificial Intelligence and Generalized Qualitative‐Response Models: An Empirical Test on Two Audit Decision‐Making Domains , 1992 .

[25]  J. Ross Quinlan,et al.  Learning Efficient Classification Procedures and Their Application to Chess End Games , 1983 .

[26]  Ignizio Introduction to expert systems , 1985 .

[27]  John S. Chandler,et al.  PREDICTING STOCK MARKET BEHAVIOR THROUGH RULE INDUCTION: AN APPLICATION OF THE LEARNING‐FROM‐EXAMPLE APPROACH* , 1987 .

[28]  Cliff T. Ragsdale,et al.  Introducing Discriminant Analysis to the Business Statistics Curriculum , 1992 .

[29]  John A. Elliott,et al.  Write-Offs as Accounting Procedures to Manage Perceptions , 1988 .

[30]  C. Steinfield,et al.  On the Role of Theory in Research on Information Technologies in Organizations , 1987 .

[31]  N. Draper,et al.  Applied Regression Analysis , 1966 .

[32]  Sholom M. Weiss,et al.  Computer Systems That Learn , 1990 .

[33]  Nigel Ford From information- to knowledge-management: the role of rule induction and neural net machine learning techniques in knowledge generation , 1989, J. Inf. Sci..

[34]  Gerardine DeSanctis,et al.  ICIS Paper: Methodological Issues in Experimental IS Research: Experiences and Recommendations , 1985, MIS Q..

[35]  W. R. Buckland,et al.  A dictionary of statistical terms , 1958 .

[36]  Padhraic Smyth,et al.  Decision tree design from a communication theory standpoint , 1988, IEEE Trans. Inf. Theory.

[37]  Robert J. Marks,et al.  Performance Comparisons Between Backpropagation Networks and Classification Trees on Three Real-World Applications , 1989, NIPS.

[38]  H. Frydman,et al.  Introducing Recursive Partitioning for Financial Classification: The Case of Financial Distress , 1985 .