Pattern recognition for evaluator errors in a credit scoring model for technology-based SMEs

A credit scoring model for technology-based small and medium enterprises presupposes evaluator objectivity and evaluation consistency; however, there is always some amount of error in any technology evaluation. This can be due in part to the subjective evaluation attributes that comprise part of the credit scoring model. The evaluated values of subjective attributes can vary among evaluators. In this study, we identified the significant characteristics of both evaluator and evaluation teams in terms of evaluation error using a decision tree analysis. Our results can improve the accuracy of a wide range of evaluation procedures for technology financing.

[1]  D. Waldman,et al.  A Field Study of Rating Conditions and Leniency in Performance Appraisal , 1988 .

[2]  Melvin M. Mark,et al.  Toward an Agenda for Research on Evaluation , 2003 .

[3]  Thomas E. McKee,et al.  Bankruptcy theory development and classification via genetic programming , 2006, Eur. J. Oper. Res..

[4]  Angelo S. DeNisi,et al.  A cognitive view of the performance appraisal process: A model and research propositions , 1984 .

[5]  Walter C. Borman,et al.  The rating of individuals in organizations: An alternate approach , 1974 .

[6]  Yongtae Park,et al.  A new method for technology valuation in monetary value: procedure and application , 2004 .

[7]  E. Altman,et al.  How Rating Agenices Achieve Rating Stability , 2003 .

[8]  Bert van Wegen,et al.  Understanding and valuing knowledge assets: Overview and method , 1997 .

[9]  Sanghoon Kim,et al.  Improved technology scoring model for credit guarantee fund , 2005, Expert Syst. Appl..

[10]  So Young Sohn,et al.  Intelligent approach for effective management of governmental funds for small and medium enterprises , 2005, Expert systems with applications.

[11]  Jennifer E. Iriti,et al.  Using Recommendations in Evaluation , 2005 .

[12]  Randall Matignon.  Data Mining Using SAS® Enterprise Miner™: Matignon/Data Mining , 2007 .

[13]  T. DeCotiis,et al.  The performance appraisal process: a model and some testable propositions. , 1978, Academy of management review. Academy of Management.

[14]  J Noak,et al.  Performance rating. , 1999, Nursing standard (Royal College of Nursing (Great Britain) : 1987).

[15]  Yen-Liang Chen,et al.  Constructing a multi-valued and multi-labeled decision tree , 2003, Expert Syst. Appl..

[16]  Janne Harkonen,et al.  Productisation: A Literature Review , 2013 .

[17]  Jack M. Feldman,et al.  Performance appraisal: A process focus. , 1983 .

[18]  Muammer Ozer,et al.  Factors which influence decision making in new product evaluation , 2005, Eur. J. Oper. Res..

[19]  H. P. Sims,et al.  The Thinking Organization: Dynamics of Organizational Social Cognition. , 1988 .

[20]  Jack M. Feldman,et al.  Beyond Attribution Theory: Cognitive Processes in Performance Appraisal , 1981 .

[21]  Barry Bozeman,et al.  Evaluating technology transfer and diffusion , 1988 .

[22]  Manuel Landajo,et al.  Forecasting business profitability by using classification techniques: A comparative analysis based on a Spanish case , 2005, Eur. J. Oper. Res..

[23]  Kenneth M. Alvares,et al.  Effects of sex on descriptions and evaluations of supervisory behavior in a simulated industrial setting. , 1977 .

[24]  So Young Sohn,et al.  Technology credit scoring model considering both SME characteristics and economic conditions: The Korean case , 2010, J. Oper. Res. Soc..

[25]  Vadlamani Ravi,et al.  Bankruptcy prediction in banks and firms via statistical and intelligent techniques - A review , 2007, Eur. J. Oper. Res..

[26]  R. L. Dipboye.  Some Neglected Variables in Research on Discrimination in Appraisals , 1985 .

[27]  K. Leithwood,et al.  Current Empirical Research on Evaluation Utilization , 1986 .

[28]  So Young Sohn,et al.  Random effects logistic regression model for default prediction of technology credit guarantee fund , 2007, Eur. J. Oper. Res..

[29]  Robert L. Holzbach,et al.  Rater bias in performance ratings: Superior, self-, and peer ratings. , 1978 .

[30]  Susanne Bahn,et al.  Evaluation of the Integrated Services Pilot Program from Western Australia. , 2009, Evaluation and program planning.

[31]  Randall Matignon,et al.  Data Mining Using SAS Enterprise Miner , 2007 .

[32]  Philip A. Chou,et al.  Optimal Partitioning for Classification and Regression Trees , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  W. Gale Cutler.  The Human Side , 1988 .

[34]  F. Black,et al.  The Pricing of Options and Corporate Liabilities , 1973, Journal of Political Economy.

[35]  G. Mitchell,et al.  Managing R&D as A Strategic Option , 1988 .

[36]  Joseph Sarkis,et al.  Evaluating performance of public–private research collaborations: A DEA analysis , 2003, J. Oper. Res. Soc..

[37]  Paul C. Ivey,et al.  An R&D options selection model for investment decisions , 2005 .

[38]  Ömer Kaan Baykan,et al.  Predicting bank financial failures using neural networks, support vector machines and multivariate statistical methods: A comparative analysis in the sample of savings deposit insurance fund (SDIF) transferred banks in Turkey , 2009, Expert Syst. Appl..

[39]  Gary P. Latham,et al.  Increasing productivity through performance appraisal , 1981 .

[40]  Where local and national evaluators meet: unintended threats to ethical evaluation practice. , 2007, Evaluation and program planning.

[41]  So Young Sohn,et al.  Technology scoring model for reflecting evaluator's perception within confidence limits , 2008, Eur. J. Oper. Res..

[42]  Koen Vanhoof,et al.  Bankruptcy prediction using a data envelopment analysis , 2004, Eur. J. Oper. Res..

[43]  Peter Villanova,et al.  Stability of Rater Leniency: Three Studies , 1995 .

[44]  Sanjaya Lall,et al.  Promoting technology development: The role of technology transfer and indigenous effort , 1993 .

[45]  David E. Smith,et al.  Training Programs for Performance Appraisal: A Review , 1986 .