Diversity of ability and cognitive style for group decision processes

This research investigates the potential for two forms of error diversity (ability diversity and diversity of cognitive style) to increase the accuracy of multi-agent group decision processes. An experimental methodology is employed that rigorously controls for the sources of error diversity. The results indicate that ability diversity decreases group decision errors by approximately 4%. Cognitive diversity is much more effective; decision errors are reduced by approximately 13% by groups formed from four cognitive classes. As sources of ability and cognitive diversity increase, the generalization error of the group decision decreases, and the prominence of the most capable member (i.e., expert) in the group diminishes. Thus, the popular reliance on using more capable members to create high performance homogenous groups may be misguided. This research indicates that a better strategy is to create groups of members that 'think differently' and cooperate to produce a group decision. Using this strategy, we are able to reduce the group decision error in two bankruptcy detection data sets by 11-47%. Reductions of this magnitude in high volume, high value, and repetitive decision environments characterizing the financial domain are extremely significant, where error reductions of even a fraction of a percent are welcome.

[1]  Siddhartha Bhattacharyya,et al.  Genetic programming in classifying large-scale data: an ensemble method , 2004, Inf. Sci..

[2]  Raymond J. Mooney,et al.  Creating diversity in ensembles using artificial data , 2005, Inf. Fusion.

[3]  Edward I. Altman,et al.  Corporate distress diagnosis: Comparisons using linear discriminant analysis and neural networks (the Italian experience) , 1994 .

[4]  Selwyn Piramuthu,et al.  Financial credit-risk evaluation with neural and neurofuzzy systems , 1999, Eur. J. Oper. Res..

[5]  Robert P. W. Duin,et al.  Bagging for linear classifiers , 1998, Pattern Recognit..

[6]  H. C. Lau.  On the complexity of manpower shift scheduling , 1996 .

[7]  Lu Hong,et al.  Groups of diverse problem solvers can outperform groups of high-ability problem solvers. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[8]  E. Mine Cinar,et al.  Neural Networks: A New Tool for Predicting Thrift Failures , 1992 .

[9]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Parag C. Pendharkar,et al.  The theory and experiments of designing cooperative intelligent systems , 2007, Decis. Support Syst..

[11]  Hyun-Chul Kim,et al.  Constructing support vector machine ensemble , 2003, Pattern Recognit..

[12]  Michael Y. Hu,et al.  Artificial neural networks in bankruptcy prediction: General framework and cross-validation analysis , 1999, Eur. J. Oper. Res..

[13]  Anders Krogh,et al.  Neural Network Ensembles, Cross Validation, and Active Learning , 1994, NIPS.

[14]  Bill C. Hardgrave,et al.  An improved method for developing neural networks: The case of evaluating commercial loan creditworthiness , 1996, Comput. Oper. Res..

[15]  Massimiliano Versace,et al.  Predicting the exchange traded fund DIA with a combination of genetic algorithms and neural networks , 2004, Expert Syst. Appl..

[16]  Andrew H. Sung,et al.  Intrusion detection using an ensemble of intelligent paradigms , 2005, J. Netw. Comput. Appl..

[17]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[18]  D. Opitz,et al.  Popular Ensemble Methods: An Empirical Study , 1999, J. Artif. Intell. Res..

[19]  Manoj K. Malhotra,et al.  Decision making using multiple models , 1999, Eur. J. Oper. Res..

[20]  Georgios Dounias,et al.  Bankruptcy prediction with neural logic networks by means of grammar-guided genetic programming , 2006, Expert Syst. Appl..

[21]  David West,et al.  Neural network credit scoring models , 2000, Comput. Oper. Res..

[22]  Michael Y. Hu,et al.  Explaining consumer choice through neural networks: The stacked generalization approach , 2003, Eur. J. Oper. Res..

[23]  YongSeog Kim,et al.  Toward a successful CRM: variable selection, sampling, and ensemble , 2006, Decis. Support Syst..

[24]  Shu-Heng Chen,et al.  Computationally intelligent agents in economics and finance , 2007, Inf. Sci..

[25]  Eric Bauer,et al.  An Empirical Comparison of Voting Classification Algorithms: Bagging, Boosting, and Variants , 1999, Machine Learning.

[26]  Harris Drucker,et al.  Boosting and Other Ensemble Methods , 1994, Neural Computation.

[27]  Michael J. Shaw,et al.  A multi-agent framework for the coordination and integration of information systems , 1998 .

[28]  Ingoo Han,et al.  Hybrid neural network models for bankruptcy predictions , 1996, Decis. Support Syst..

[29]  Stephen D. Bay.  Nearest neighbor classification from multiple feature subsets , 1999, Intell. Data Anal..

[30]  Ingoo Han,et al.  Bankruptcy prediction using case-based reasoning, neural networks, and discriminant analysis , 1997 .

[31]  Jie Zhang,et al.  Developing robust non-linear models through bootstrap aggregated neural networks , 1999, Neurocomputing.

[32]  R. E. Abdel-Aal,et al.  Improved classification of medical data using abductive network committees trained on different feature subsets , 2005, Comput. Methods Programs Biomed..

[33]  Ajith Abraham,et al.  Modeling intrusion detection system using hybrid intelligent systems , 2007, J. Netw. Comput. Appl..

[34]  Carlos Serrano-Cinca,et al.  Self organizing neural networks for financial diagnosis , 1996, Decision Support Systems.

[35]  Gary J. Koehler,et al.  Conditions that Obviate the No-Free-Lunch Theorems for Optimization , 2007, INFORMS J. Comput..

[36]  Ronald R. Yager,et al.  Modeling the concept of majority opinion in group decision making , 2006, Inf. Sci..

[37]  G DietterichThomas.  An Experimental Comparison of Three Methods for Constructing Ensembles of Decision Trees , 2000 .

[38]  Lars Kai Hansen,et al.  Neural Network Ensembles , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Carlos Serrano-Cinca,et al.  Feedforward neural networks in the classification of financial information , 1997 .

[40]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[41]  Nathan Intrator,et al.  Bootstrapping with Noise: An Effective Regularization Technique , 1996, Connect. Sci..

[42]  Vijay S. Desai,et al.  A comparison of neural networks and linear scoring models in the credit union environment , 1996 .

[43]  Edward I. Altman,et al.  FINANCIAL RATIOS, DISCRIMINANT ANALYSIS AND THE PREDICTION OF CORPORATE BANKRUPTCY , 1968 .

[44]  Yishay Mansour,et al.  On the boosting ability of top-down decision tree learning algorithms , 1996, STOC '96.

[45]  William W. Cooper,et al.  A case study in applying neural networks to predicting insolvency for property and casualty insurers , 1997 .

[46]  Marjorie B. Platt,et al.  Probabilistic Neural Networks in Bankruptcy Prediction , 1999 .

[47]  Oleksandr Makeyev,et al.  Neural network with ensembles , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[48]  Yoshua Bengio,et al.  Boosting Neural Networks , 2000, Neural Computation.

[49]  Sung-Bae Cho,et al.  Ensemble of structure-adaptive self-organizing maps for high performance classification , 2000, Inf. Sci..

[50]  Pádraig Cunningham,et al.  Stability problems with artificial neural networks and the ensemble solution , 2000, Artif. Intell. Medicine.

[51]  David West,et al.  Neural network ensemble strategies for financial decision applications , 2005, Comput. Oper. Res..

[52]  Garland Chow,et al.  The application of a neural network approach to predicting bankruptcy risks facing the major US air carriers: 1979–1996 , 1999 .

[53]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[54]  Thomas G. Dietterich.  An Experimental Comparison of Three Methods for Constructing Ensembles of Decision Trees: Bagging, Boosting, and Randomization , 2000, Machine Learning.

[55]  Daniel P. Lopresti,et al.  Improving classifier performance through repeated sampling , 1997, Pattern Recognit..

[56]  Kin Keung Lai,et al.  An intelligent-agent-based fuzzy group decision making model for financial multicriteria decision support: The case of credit scoring , 2009, Eur. J. Oper. Res..

[57]  Xin Yao,et al.  Diversity creation methods: a survey and categorisation , 2004, Inf. Fusion.

[58]  Sungzoon Cho,et al.  Constructing response model using ensemble based on feature subset selection , 2006, Expert Syst. Appl..

[59]  Michael H. Neumann,et al.  Bootstrapping Neural Networks , 2000, Neural Computation.

[60]  Soushan Wu,et al.  Credit rating analysis with support vector machines and neural networks: a market comparative study , 2004, Decis. Support Syst..

[61]  So Young Sohn,et al.  Data fusion, ensemble and clustering to improve the classification accuracy for the severity of road traffic accidents in Korea , 2003 .

[62]  Vivian West,et al.  Computing, Artificial Intelligence and Information Technology Ensemble strategies for a medical diagnostic decision support system: A breast cancer diagnosis application , 2005 .

[63]  Ramesh Sharda,et al.  Bankruptcy prediction using neural networks , 1994, Decis. Support Syst..

[64]  Leo Breiman,et al.  Randomizing Outputs to Increase Prediction Accuracy , 2000, Machine Learning.

[65]  Jozef Zurada,et al.  Neural Networks Versus Logit Regression Model For Predicting Financial Distress Response Variables , 2011 .

[66]  Koen Bertels,et al.  Qualitative company performance evaluation: Linear discriminant analysis and neural network models , 1999, Eur. J. Oper. Res..

[67]  Jakob Vogdrup Hansen,et al.  Combining Predictors: Comparison of Five Meta Machine Learning Methods , 1999, Inf. Sci..

[68]  A. Neil Burgess,et al.  Neural networks in financial engineering: a study in methodology , 1997, IEEE Trans. Neural Networks.

[69]  Pamela K. Coats,et al.  A neural network for classifying the financial health of a firm , 1995 .

[70]  Sung-Bae Cho,et al.  Ensemble classifiers based on correlation analysis for DNA microarray classification , 2006, Neurocomputing.

[71]  David West,et al.  Model selection for medical diagnosis decision support systems , 2004, Decis. Support Syst..

[72]  Ray L. Somorjai,et al.  Application of Several Methods of Classification Fusion to Magnetic Resonance Spectra , 1996, Connect. Sci..

[73]  Guoqiang Peter Zhang,et al.  A neural network ensemble method with jittered training data for time series forecasting , 2007, Inf. Sci..

[74]  Yu-Bin Yang,et al.  Lung cancer cell identification based on artificial neural network ensembles , 2002, Artif. Intell. Medicine.

[75]  Yoichi Hayashi,et al.  Combining neural network predictions for medical diagnosis , 2002, Comput. Biol. Medicine.

[76]  Melody Y. Kiang,et al.  Managerial Applications of Neural Networks: The Case of Bank Failure Predictions , 1992 .