Does the Choice of Model or Benchmark Affect Inference in Measuring Mutual Fund Performance?

We address the practical question of whether investors and researchers are likely to make invalid inferences about fund manager performance when using the wrong model and/or benchmark. We consider three well-known models, those of Jensen (1968), Treynor and Mazuy (1966), and Henriksson and Merton (1981), and two commonly used timing benchmarks, the SP (2) but biases in measures of overall performance are economically insignificant; (3) benchmark misspecification results in qualitatively similar difficulties, with the addition that overall performance as well can be biased; and (4) model and benchmark misspecification do not appreciably alter the power to detect ability and distinguish a good fund from a bad fund. These results are robust to alternative asset pricing specifications, alternative simulation schemes, varying length of the return series, and periodicity of the simulated series. The use of daily fund returns amplifies our conclusions about the biases induced by model misspecifications. Moreover, the biases we identify appear to be difficult to correct by using standard model selection criteria and misspecification tests. If the benchmark is known but the timing model is not, investors should use measures of overall performance to evaluate funds and managers.

[1]  Campbell R. Harvey,et al.  Conditional Skewness in Asset Pricing Tests , 1999 .

[2]  L. Pedersen,et al.  Asset Pricing with Liquidity Risk , 2003 .

[3]  E. Fama,et al.  Common risk factors in the returns on stocks and bonds , 1993 .

[4]  Ron Kaniel,et al.  Leaning for the Tape: Evidence of Gaming Behavior in Equity Mutual Funds , 2002 .

[5]  Campbell R. Harvey,et al.  Market Timing Ability and Volatility Implied in Investment Newsletters' Asset Allocation Recommendations , 1994 .

[6]  David Easley,et al.  Is Information Risk a Determinant of Asset Returns , 2002 .

[7]  Sheridan Titman,et al.  A Study of Monthly Mutual Fund Returns and Performance Evaluation Techniques , 1994, Journal of Financial and Quantitative Analysis.

[8]  Glenn Ellison,et al.  Career Concerns of Mutual Fund Managers , 1998 .

[9]  Jeffrey A. Busse Volatility Timing in Mutual Funds: Evidence from Daily Returns , 1999 .

[10]  Wilbur G. Lewellen,et al.  Market Timing and Mutual Fund Investment Performance , 1984 .

[11]  José R. Suay,et al.  On Equilibrium Pricing under Parameter , 1995 .

[12]  Jerold B. Warner,et al.  Evaluating Mutual Fund Performance , 1997 .

[13]  J. MacKinnon,et al.  Several Tests for Model Specication in the Pres-ence of Alternative Hypotheses , 1981 .

[14]  Michael J. Schill,et al.  Conditional Market Timing with Benchmark Investors , 1998 .

[15]  Jonathan B. Berk,et al.  Necessary Conditions for the CAPM , 1997 .

[16]  M. Hashem Pesaran,et al.  Non-nested Hypothesis Testing: An Overview , 1999 .

[17]  Guofu Zhou,et al.  Asset‐pricing Tests under Alternative Distributions , 1993 .

[18]  Richard Roll,et al.  AMBIGUITY WHEN PERFORMANCE IS MEASURED BY THE SECURITIES MARKET LINE , 1978 .

[19]  V. Chernozhukov,et al.  Bayesian Econometrics , 2007 .

[20]  Ravi Jagannathan,et al.  A contingent claim approach to performance evaluation , 1993 .

[21]  Sheridan Titman,et al.  Portfolio Performance Evaluation: Old Issues and New Insights , 1989 .

[22]  Stephen A. Ross,et al.  On Timing and Selectivity , 1986 .

[23]  Don M. Chance,et al.  The performance of professional market timers: daily evidence from executed strategies , 2001 .

[24]  A. Timmermann,et al.  Can Mutual Fund 'Stars' Really Pick Stocks? New Evidence from a Bootstrap Analysis , 2005 .

[25]  R. F. Brown,et al.  PERFORMANCE EVALUATION , 2019, ISO 22301:2019 and business continuity management – Understand how to plan, implement and enhance a business continuity management system (BCMS).

[26]  Sheridan Titman,et al.  On Persistence in Mutual Fund Performance , 1997 .

[27]  William N. Goetzmann,et al.  Monthly Measurement of Daily Timers , 1998, Journal of Financial and Quantitative Analysis.

[28]  Sheridan Titman,et al.  Mutual Fund Performance: An Analysis of Quarterly Portfolio Holdings , 1989 .

[29]  Wayne E. Ferson,et al.  Measuring Fund Strategy and Performance in Changing Economic Conditions , 1996 .

[30]  Anat R. Admati,et al.  Measuring Investment Performance in a Rational Expectations Equilibrium Model , 1985 .

[31]  Roy. Henriksson,et al.  Market Timing and Mutual Fund Performance: An Empirical Investigation , 1984 .

[32]  R. Litzenberger,et al.  SKEWNESS PREFERENCE AND THE VALUATION OF RISK ASSETS , 1976 .

[33]  Jeffrey A. Busse,et al.  On the Timing Ability of Mutual Fund Managers , 2001 .

[34]  Uri Loewenstein,et al.  Equilibrium pricing and portfolio composition in the presence of uncertain parameters , 1988 .

[35]  J. D. Villiers,et al.  Can Mutual Fund “Stars” Really Pick Stocks? New Evidence from a Bootstrap Analysis , 2007 .

[36]  Jeffrey L. Coles,et al.  On Equilibrium Pricing under Parameter Uncertainty , 1995, Journal of Financial and Quantitative Analysis.

[37]  Jeffrey L. Coles,et al.  Fund Advisor Compensation in Closed‐End Funds , 2000 .

[38]  Ravi Jagannathan,et al.  Assessing the Market Timing Performance of Managed Portfolios , 1985 .

[39]  Klaas Baks,et al.  On the performance of mutual fund managers , 2002 .

[40]  R. Cumby,et al.  Evaluating the Performance of International Mutual Funds , 1990 .

[41]  Maureen O'Hara,et al.  Information and the Cost of Capital , 2001 .

[42]  Stephen A. Ross,et al.  Differential Information and Performance Measurement Using a Security Market Line , 1985 .

[43]  Doron Avramov,et al.  Stock Return Predictability and Model Uncertainty , 2001 .

[44]  M. Kenward,et al.  An Introduction to the Bootstrap , 2007 .

[45]  M. C. Jensen The Performance of Mutual Funds in the Period 1945-1964 , 1967 .

[46]  Jeffrey A. Busse,et al.  Short-Term Persistence in Mutual Fund Performance , 2005 .