Determining sources of relative inefficiency in heterogeneous samples: Methodology using Cluster Analysis, DEA and Neural Networks

Data Envelopment Analysis (DEA) is a powerful data analytic tool that is widely used by researchers and practitioners alike to assess relative performance of Decision Making Units (DMU). Commonly, the difference in the scores of relative performance of DMUs in the sample is considered to reflect their differences in the efficiency of conversion of inputs into outputs. In the presence of scale heterogeneity, however, the source of the difference in scores becomes less clear, for it is also possible that the difference in scores is caused by heterogeneity of the levels of inputs and outputs of DMUs in the sample. By augmenting DEA with Cluster Analysis (CA) and Neural Networks (NN), we propose a five-step methodology allowing an investigator to determine whether the difference in the scores of scale heterogeneous DMUs is due to the heterogeneity of the levels of inputs and outputs, or whether it is caused by their efficiency of conversion of inputs into outputs. An illustrative example demonstrates the application of the proposed methodology in action.

[1]  Fabio Crestani,et al.  A Model for Adaptive Information Retrieval , 2004, Journal of Intelligent Information Systems.

[2]  Cláudia S. Sarrico,et al.  Restricting virtual weights in data envelopment analysis , 2004, Eur. J. Oper. Res..

[3]  S. Miller,et al.  Productivity growth in large US commercial banks: The initial post-deregulation experience , 2001 .

[4]  Milind Sathye,et al.  X-efficiency in Australian banking: An empirical investigation , 2001 .

[5]  Zhexue Huang,et al.  CLUSTERING LARGE DATA SETS WITH MIXED NUMERIC AND CATEGORICAL VALUES , 1997 .

[6]  Toshio Tsuji,et al.  EMG-Based Motion Discrimination Using a Novel Recurrent Neural Network , 2003, Journal of Intelligent Information Systems.

[7]  G. Tellis,et al.  Research on Innovation: A Review and Agenda for Marketing Science , 2006 .

[8]  Tyrone T. Lin,et al.  Application of DEA in analyzing a bank's operating performance , 2009, Expert Syst. Appl..

[9]  Emmanuel Thanassoulis,et al.  Separating Market Efficiency from Profitability and its Implications for Planning , 1995 .

[10]  Ana S. Camanho,et al.  The measurement of relative efficiency using data envelopment analysis with assurance regions that link inputs and outputs , 2010, Eur. J. Oper. Res..

[11]  Sergey Samoilenko Contributing factors to information technology investment utilization in transition economies: An empirical investigation , 2008 .

[12]  Richard W. Lichty,et al.  An Efficiency Analysis of Minnesota Counties: A Data Envelopment Analysis Using 1993 IMPLAN Input-Output Analysis , 1997 .

[13]  Chien-Ming Chen,et al.  Measuring dynamic efficiency: Theories and an integrated methodology , 2010, Eur. J. Oper. Res..

[14]  Shintaro Okazaki,et al.  What do we know about mobile Internet adopters? A cluster analysis , 2006, Inf. Manag..

[15]  Kweku-Muata Osei-Bryson,et al.  Increasing the discriminatory power of DEA in the presence of the sample heterogeneity with cluster analysis and decision trees , 2008, Expert Syst. Appl..

[16]  John E. Beasley,et al.  Comparing university departments , 1990 .

[17]  María Guadalupe Villarreal Marroquín,et al.  Use of data envelopment analysis and clustering in multiple criteria optimization , 2008, Intell. Data Anal..

[18]  Robert Y. Cavana,et al.  Using DEA and survival analysis for measuring performance of branches in New Zealand's Accident Compensation Corporation , 2002, J. Oper. Res. Soc..

[19]  Liming Chen,et al.  Voice-Based Gender Identification in Multimedia Applications , 2005, Journal of Intelligent Information Systems.

[20]  Erik Mathijs,et al.  Production Organization and Efficiency During Transition: An Empirical Analysis of East German Agriculture , 2001, Review of Economics and Statistics.

[21]  Rajiv D. Banker,et al.  Software complexity and maintenance costs , 1993, CACM.

[22]  Inderjit S. Dhillon,et al.  Co-clustering documents and words using bipartite spectral graph partitioning , 2001, KDD '01.

[23]  R Ramanathan,et al.  Comparative Risk Assessment of Energy Supply Technologies: a Data Envelopment Analysis Approach , 2001 .

[24]  John Doyle,et al.  Strategic choice and data envelopment analysis: comparing computers across many attributes , 1994, J. Inf. Technol..

[25]  Muh-Cherng Wu,et al.  An effective application of decision tree to stock trading , 2006, Expert Syst. Appl..

[26]  K. Gerard,et al.  Assessing efficiency in the UK breast screening programme: does size of screening unit make a difference? , 2001, Health policy.

[27]  José Camacho,et al.  Productivity of the Service Sector: A Regional Perspective , 2001 .

[28]  Cláudia S. Sarrico,et al.  Using DEA for planning in UK universities—an institutional perspective , 2000, J. Oper. Res. Soc..

[29]  J. Schreyögg,et al.  Strategic groups and performance differences among academic medical centers , 2008, Health care management review.

[30]  Shouhong Wang,et al.  Adaptive non-parametric efficiency frontier analysis: a neural-network-based model , 2003, Comput. Oper. Res..

[31]  R. G. Dyson,et al.  Cost efficiency measurement with price uncertainty: a DEA application to bank branch assessments , 2005, Eur. J. Oper. Res..

[32]  Mark Keil,et al.  Assimilation patterns in the use of electronic procurement innovations: A cluster analysis , 2006, Inf. Manag..

[33]  D Parkin,et al.  The efficiency of the delivery of neonatal care in the UK. , 2001, Journal of public health medicine.

[34]  Ali Azadeh,et al.  Forecasting electrical consumption by integration of Neural Network, time series and ANOVA , 2007, Appl. Math. Comput..

[35]  Robert G. Dyson,et al.  On comparing the performance of primary care providers , 2008, Eur. J. Oper. Res..

[36]  Mark R. Fisher,et al.  Segmentation of the Angler Population by Catch Preference, Participation, and Experience: A Management-Oriented Application of Recreation Specialization , 1997 .

[37]  Juan Carlos Martín,et al.  An application of DEA to measure the efficiency of Spanish airports prior to privatization , 2001 .

[38]  Ali Emrouznejad,et al.  A combined neural network and DEA for measuring efficiency of large scale datasets , 2009, Comput. Ind. Eng..

[39]  E. Wailand Bessent,et al.  Determining the Comparative Efficiency of Schools through Data Envelopment Analysis , 1980 .

[40]  Hongjun Lu,et al.  Effective Data Mining Using Neural Networks , 1996, IEEE Trans. Knowl. Data Eng..

[41]  J. Kirigia,et al.  Technical efficiency of public clinics in Kwazulu-Natal Province of South Africa. , 2001, East African medical journal.

[42]  Marcin Piatkowski,et al.  The 'New Economy' and Economic Growth in Transition Economies , 2002 .

[43]  Suk I. Yoo,et al.  Text Database Discovery on the Web: Neural Net Based Approach , 2004, Journal of Intelligent Information Systems.

[44]  Antreas D. Athanassopoulos,et al.  A Comparison of Data Envelopment Analysis and Artificial Neural Networks as Tools for Assessing the Efficiency of Decision Making Units , 1996 .

[45]  Stefan Stremersch,et al.  Social Contagion and Income Heterogeneity in New Product Diffusion: A Meta-Analytic Test , 2004 .

[46]  Juan A. Vega-Cervera,et al.  The use of parametric and non-parametric frontier methods to measure the productive efficiency in the industrial sector: A comparative study , 2001 .

[47]  B.B.M. Shao,et al.  Measuring the value of information technology in technical efficiency with stochastic production frontiers , 2001, Inf. Softw. Technol..

[48]  J. Paradi,et al.  Best practice analysis of bank branches: An application of DEA in a large Canadian bank , 1997 .

[49]  Timo Kuosmanen,et al.  Measuring economic efficiency with incomplete price information: With an application to European commercial banks , 2001, Eur. J. Oper. Res..

[50]  Peter Nijkamp,et al.  Relative efficiency of European airports , 1999 .

[51]  Raphael N. Markellos,et al.  Evaluating public transport efficiency with neural network models , 1997 .

[52]  So Young Sohn,et al.  Multi-attribute scoring method for mobile telecommunication subscribers , 2004, Expert Syst. Appl..

[53]  D Nath,et al.  The Technical Efficiency of Hospitals under a Single Payer System: The Case of Ontario Community Hospitals , 2001, Health care management science.

[54]  Ayoe Hoff,et al.  Second stage DEA: Comparison of approaches for modelling the DEA score , 2007, Eur. J. Oper. Res..

[55]  Shawna Grosskopf,et al.  The effects of teaching on hospital productivity , 2001 .

[56]  N. F. F. Ebecken,et al.  DEA Implementation And ClusteringAnalysis Using The K-Means Algorithm , 2005 .

[57]  Mohamed M. Mostafa,et al.  A probabilistic neural network approach for modelling and classifying efficiency of GCC banks , 2009 .

[58]  David Gillen,et al.  DEVELOPING MEASURES OF AIRPORT PRODUCTIVITY AND PERFORMANCE: AN APPLICATION OF DATA ENVELOPMENT ANALYSIS , 1997 .

[59]  Guy Paré,et al.  Information technology sophistication in health care: an instrument validation study among Canadian hospitals , 2001, Int. J. Medical Informatics.

[60]  F. J. Arcelus,et al.  Productivity differences across OECD countries in the presence of environmental constraints , 2005, J. Oper. Res. Soc..

[61]  Laure Latruffe,et al.  Measures of farm business efficiency , 2008, Ind. Manag. Data Syst..

[62]  Mette Asmild,et al.  Measuring overall efficiency and effectiveness using DEA , 2007, Eur. J. Oper. Res..

[63]  J. Hirschberg,et al.  Clustering in a Data Envelopment Analysis Using Bootstrapped Efficiency Scores , 2001 .

[64]  Mark Keil,et al.  Understanding software project risk: a cluster analysis , 2004, Inf. Manag..

[65]  V. Mahajan,et al.  Diffusion of New Products: Empirical Generalizations and Managerial Uses , 1995 .

[66]  Jorge M. A. Santos,et al.  An application of recent developments of Data Envelopment Analysis to the evaluation of secondary schools in Portugal , 2001, Int. J. Serv. Technol. Manag..

[67]  Parag C. Pendharkar,et al.  Technical efficiency-based selection of learning cases to improve forecasting accuracy of neural networks under monotonicity assumption , 2003, Decis. Support Syst..

[68]  Helle Grønli A Comparison of Scandinavian Regulatory Models: Issues and Experience , 2001 .

[69]  Francisco J. Arcelus,et al.  Convergence and productive efficiency in fourteen OECD countries: A non-parametric frontier approach , 2000 .

[70]  Cláudia S. Sarrico,et al.  Pitfalls and protocols in DEA , 2001, Eur. J. Oper. Res..

[71]  Dejan J. Sobajic,et al.  Neural Networks and Knowledge Engineering , 1991, IEEE Trans. Knowl. Data Eng..

[72]  Emmanuel Thanassoulis,et al.  Decomposing school and school-type efficiency , 2001, Eur. J. Oper. Res..

[73]  Ron Shamir,et al.  Clustering Gene Expression Patterns , 1999, J. Comput. Biol..

[74]  Dilay Çelebi,et al.  An integrated neural network and data envelopment analysis for supplier evaluation under incomplete information , 2008, Expert Syst. Appl..

[75]  Desheng Dash Wu,et al.  Supplier selection: A hybrid model using DEA, decision tree and neural network , 2009, Expert Syst. Appl..

[76]  Rodney H. Green,et al.  Comparing products using data envelopment analysis , 1991 .

[77]  Diego Prior,et al.  Measuring Productivity and Quality Changes Using Data Envelopment Analysis: An Application to Catalan Hospitals , 2001 .

[78]  B. W. Jones,et al.  Simple analytical method for evaluating lift performance during an up-peak , 1971 .

[79]  Donald R. Lehmann,et al.  A Meta-Analysis of Applications of Diffusion Models , 1990 .

[80]  Toshiyuki Sueyoshi,et al.  Slack-adjusted DEA for time series analysis: Performance measurement of Japanese electric power generation industry in 1984-1993 , 2001, Eur. J. Oper. Res..

[81]  Zhimin Xu,et al.  Representing Knowledge by Neural Networks for Qualitative Analysis and Reasoning , 1995, IEEE Trans. Knowl. Data Eng..

[82]  S. Grosskopf,et al.  Evaluating performance in Chicago public high schools in the wake of decentralization , 2001 .

[83]  Moutaz Khouja,et al.  The use of data envelopment analysis for technology selection , 1995 .

[84]  Abraham Charnes,et al.  A developmental study of data envelopment analysis in measuring the efficiency of maintenance units in the U.S. air forces , 1984, Ann. Oper. Res..

[85]  Song Jin Yu,et al.  Performance based stratification and clustering for benchmarking of container terminals , 2009, Expert Syst. Appl..

[86]  Bernhard Brümmer,et al.  Impacts of environmental regulations on the efficiency of arable farms in France and Germany , 2001 .

[87]  Daniel Santín,et al.  The measurement of technical efficiency: a neural network approach , 2004 .

[88]  Jesús Martínez-Frías The importance of ICTs for developing countries , 2003 .

[89]  K. Glaister,et al.  Measuring strategic decision making efficiency in different country contexts: a comparison of British and Turkish firms , 2010 .

[90]  James E. Storbeck,et al.  Allocative efficiency in branch banking , 2001, Eur. J. Oper. Res..

[91]  E. Rogers Diffusion of Innovations , 1962 .