Comparing Malmquist and Hicks-Moorsteen productivity indices: Exploring the impact of unbalanced vs. balanced panel data

We explore the effect of balancing unbalanced panel data when estimating primal productivity indices using non-parametric frontier estimators. First, we list a series of pseudo-solutions aimed at making an unbalanced panel balanced. Then, we discuss some intermediate solutions (e.g., balancing 2-years by 2years). Furthermore, we link this problem with a variety of literatures on infeasibilities, statistical inference of non-parametric frontier estimators, and the index theory literature focusing on the dynamics of entry and exit in industries. We then empirically illustrate these issues comparing both Malmquist and Hicks–Moorsteen productivity indices on two data sets. In particular, we test for the differences in distribution when comparing balanced and unbalanced results for a given index and when comparing Malmquist and Hicks–Moorsteen productivity indices for a given type of data set. The latter tests are crucial in answering the question to which extent the Malmquist index can approximate the Hicks–Moorsteen index that has a Total Factor Productivity (TFP) interpretation. Finally, we draw up a list of remaining issues that could benefit from further exploration.

[1]  L. R. Christensen,et al.  THE ECONOMIC THEORY OF INDEX NUMBERS AND THE MEASUREMENT OF INPUT, OUTPUT, AND PRODUCTIVITY , 1982 .

[2]  Christopher J. O'Donnell,et al.  An aggregate quantity-price framework for measuring and Decomposing productivity and profitability change , 2008 .

[3]  Osman Zaim,et al.  Measuring environmental performance of state manufacturing through changes in pollution intensities: a DEA framework , 2004 .

[4]  W. Briec,et al.  Comment: Testing for Inverse Homotheticity: A Nonparametric Approach , 2006 .

[5]  P. Samuelson,et al.  In-variant Economic Index Numbers and Canoni-cal Duality: Survey and Synthesis , 1973 .

[6]  Viet‐Ngu Hoang.  Measuring and decomposing changes in agricultural productivity, nitrogen use efficiency and cumulative exergy efficiency: Application to OECD agriculture , 2011 .

[7]  C. O'Donnell.  An aggregate quantity framework for measuring and decomposing productivity change , 2012 .

[8]  Léopold Simar,et al.  Non-parametric tests of returns to scale , 2002, Eur. J. Oper. Res..

[9]  Gerald W. Scully,et al.  Managerial Efficiency and Survivability in Professional Team Sports , 1994 .

[10]  J. Cummins,et al.  Evidence From the Spanish Insurance Industry By , 2001 .

[11]  W. Briec,et al.  The Hicks–Moorsteen Productivity Index Satisfies the Determinateness Axiom , 2011 .

[12]  Badi H. Baltagi,et al.  Unbalanced panel data: A survey , 2006 .

[13]  Scott E. Atkinson,et al.  Feasible Estimation of Firm-Specific Allocative Inefficiency through Bayesian Numerical Methods , 2009 .

[14]  Kristiaan Kerstens,et al.  Technology-Based Total Factor Productivity and Benchmarking: New Proposals and an Application , 2011 .

[15]  C. Harvie,et al.  An empirical analysis of Iran's banking performance , 2012 .

[16]  L. Drake,et al.  Economies of scale in UK building societies: A re-appraisal using an entry/exit model , 2002 .

[17]  Giannis Karagiannis,et al.  Malmquist productivity index estimation with zero-value variables: The case of Greek prefectural training councils , 2004 .

[18]  Shawna Grosskopf,et al.  Some Remarks on Productivity and its Decompositions , 2003 .

[19]  Kevin J. Fox,et al.  On Measuring the Contribution of Entering and Exiting Firms to Aggregate Productivity Growth , 2005 .

[20]  Kristiaan Kerstens,et al.  Non-convex Technologies and Cost Functions: Definitions, Duality and Nonparametric Tests of Convexity , 2004 .

[21]  M. Farrell.  The Measurement of Productive Efficiency , 1957 .

[22]  Kerstin Vogler,et al.  Longitudinal And Panel Data Analysis And Applications In The Social Sciences , 2016 .

[23]  C. Lovell,et al.  The Decomposition of Malmquist Productivity Indexes , 2003 .

[24]  C. Barros,et al.  An analysis of hospital efficiency and productivity growth using the Luenberger indicator , 2008, Health care management science.

[25]  Pedro Simões,et al.  Influence of regulation on the productivity of waste utilities. What can we learn with the Portuguese experience? , 2012, Waste management.

[26]  Qi Li,et al.  Nonparametric testing of closeness between two unknown distribution functions , 2009 .

[27]  Kristiaan Kerstens,et al.  Infeasibility and Directional Distance Functions with Application to the Determinateness of the Luenberger Productivity Indicator , 2009 .

[28]  Hongliang Yang,et al.  Incorporating Both Undesirable Outputs and Uncontrollable Variables into Dea: the Performance of Chinese Coal-fired Power Plants Incorporating Both Undesirable Outputs and Uncontrollable Variables into Dea: the Performance of Chinese Coal-fired Power Plants , 2007 .

[29]  Yanqin Fan,et al.  On goodness-of-fit tests for weakly dependent processes using kernel method , 1999 .

[30]  Mette Asmild,et al.  Estimating global frontier shifts and global Malmquist indices , 2007 .

[31]  Kristiaan Kerstens,et al.  A Luenberger-Hicks-Moorsteen productivity indicator: its relation to the Hicks-Moorsteen productivity index and the Luenberger productivity indicator , 2004 .

[32]  Pierre Ouellette,et al.  Technological change and efficiency in the presence of quasi-fixed inputs: A DEA application to the hospital sector , 2004, Eur. J. Oper. Res..

[33]  Finn R. Førsund,et al.  Malmquist Indices of Productivity Growth during the Deregulation of Norwegian Banking, 1980-89 , 1992 .

[34]  Mieko Nishimizu.  Total factor productivity growth, technological progress and technical efficiency change : dimensions of productivity change in Yugoslavia, 1965-1978 , 1982 .

[35]  David B. Humphrey,et al.  Bias in Malmquist index and cost function productivity measurement in banking , 2002 .

[36]  Bruce Hollingsworth,et al.  The efficiency of health production: re-estimating the WHO panel data using parametric and non-parametric approaches to provide additional information. , 2003, Health economics.

[37]  C. O'Donnell.  Measuring and Decomposing Agricultural Productivity and Profitability Change , 2010 .

[38]  P. W. Wilson,et al.  TESTING RESTRICTIONS IN NONPARAMETRIC EFFICIENCY MODELS , 2001 .

[39]  David C. Wheelock,et al.  Why do Banks Disappear? The Determinants of U.S. Bank Failures and Acquisitions , 2000, Review of Economics and Statistics.

[40]  R. Färe,et al.  Productivity Growth, Technical Progress, and Efficiency Change in Industrialized Countries , 1994 .

[41]  M. Ivaldi,et al.  Comparing Fourier and Translog Specifications of Multiproduct Technology: Evidence from an Incomplete Panel of French Farmers , 1996 .

[42]  Zvi Griliches,et al.  Firm productivity in Israeli industry 1979-1988 , 1995 .

[43]  David V. Conesa,et al.  Sensitivity analysis of efficiency and Malmquist productivity indices: An application to Spanish savings banks , 2008, Eur. J. Oper. Res..

[44]  Antonio Peyrache,et al.  Hicks-Moorsteen versus Malmquist: a connection by means of a radial productivity index , 2014 .

[45]  J. Warford,et al.  Total Factor Productivity Growth , Technological Progress , and Technical Efficiency Change Dimensions of Productivity Change in Yugoslavia , 1965-78 , 2022 .

[46]  Jan-Egbert Sturm,et al.  Foreign bank entry, deregulation and bank efficiency: Lessons from the Australian experience , 2004 .

[47]  Johannes Van Biesebroeck,et al.  Robustness of Productivity Estimates , 2007 .

[48]  Rolf Färe,et al.  On two definitions of productivity , 1996 .

[49]  C. Lovell,et al.  A note on the Malmquist productivity index , 1995 .

[50]  H. Arora,et al.  Bank productivity measurement using Hicks-Moorsteen indices: evidence from Indian public sector banks , 2012 .

[51]  M. Goto,et al.  Productivity, efficiency, scale economies and technical change: A new decomposition analysis of TFP applied to the Japanese prefectures , 2005 .

[52]  Scott E. Atkinson,et al.  Measuring and Decomposing Productivity Change , 2003 .

[53]  H. Arora,et al.  Measuring and decomposing productivity change using Hicks-Moorsteen index numbers: evidence from Indian banks , 2013 .

[54]  K. Matthews,et al.  Bank productivity in China 1997-2007: Measurement and convergence , 2010 .

[55]  James Odeck,et al.  How efficient and productive are road toll companies?: Evidence from Norway , 2008 .

[56]  Ilke Van Beveren,et al.  TOTAL FACTOR PRODUCTIVITY ESTIMATION: A PRACTICAL REVIEW , 2012 .

[57]  Hans Bjurek.  The Malmquist Total Factor Productivity Index , 1996 .

[58]  C. O'Donnell,et al.  Nonparametric Estimates of the Components of Productivity and Profitability Change in U.S. Agriculture , 2012 .

[59]  Chad Syverson,et al.  Reallocation, Firm Turnover, and Efficiency: Selection on Productivity or Profitability? , 2005 .

[60]  Dimitris Giraleas,et al.  Productivity change using growth accounting and frontier-based approaches - Evidence from a Monte Carlo analysis , 2012, Eur. J. Oper. Res..