Quantifying Survey Expectations: A Critical Review and Generalization of the Carlson-Parkin Method

This paper provides a critical review of the popular Carlson–Parkin (CP) quantification method using household-level data from the University of Michigan’s Survey of Consumers. We find strong evidence against the threshold constancy, symmetry, homogeneity, and overall unbiasedness assumptions of the CP method. To address these violations, we generalize the CP method using a hierarchical ordered probit (HOPIT) model. By comparing the quantified inflation expectations with quantitative expectations obtained from the same set of households directly, we show that the generalized model performs better than the CP method. In particular, when the CP unbiasedness assumption is replaced by a time-varying calibration, the resulting quantified series is found to track the quantitative benchmark well, over diverse time periods.

[1]  David A. Hensher,et al.  Ordered Choices and Heterogeneity in Attribute Processing , 2010 .

[2]  J. Carlson.  Are Price Expectations Normally Distributed , 1975 .

[3]  K. Balcombe.  The Carlson-Parkin method applied to NZ price expectations using QSBO survey data , 1996 .

[4]  Christian Müller.  You CAN Carlson–Parkin , 2010 .

[5]  Lin Xia,et al.  Quantification of Qualitative Survey Data and Test of Consistent Expectations: A New Likelihood Approach , 2003 .

[6]  Michael McAleer,et al.  Alternative Procedures for Converting Qualitative Response Data to Quantitative Expectations: An Application to Australian Manufacturing , 1995 .

[7]  K. Lahiri,et al.  Measuring Forecast Uncertainty by Disagreement: The Missing Link , 2008 .

[8]  James Mitchell,et al.  Quantification of Qualitative Firm-Level Survey Data , 2002 .

[9]  M. Hashem Pesaran,et al.  Chapter 14 Survey Expectations , 2006 .

[10]  Roy Batchelor,et al.  Quantitative v. Qualitative Measures of Inflation Expectations , 2009 .

[11]  C. Granger,et al.  Handbook of Economic Forecasting , 2006 .

[12]  Ross A. Williams,et al.  Quantitative versus qualitative measures of price expectations: The evidence from Australian consumer surveys , 1979 .

[13]  James Mitchell,et al.  Forecasting Manufacturing Output Growth Using Firm-Level Survey Data , 2005 .

[14]  Thomas Maag.  On the Accuracy of the Probability Method for Quantifying Beliefs About Inflation , 2009 .

[15]  Henri Theil,et al.  On the Time Shape of Economic Microvariables and the Munich Business Test , 1952 .

[16]  C. Murray,et al.  Enhancing the Validity and Cross-Cultural Comparability of Measurement in Survey Research , 2003, American Political Science Review.

[17]  Michela Nardo,et al.  The Quantification of Qualitative Survey Data: A Critical Assessment , 2003 .

[18]  Akira Terai.  Measurement error in estimating inflation expectations from survey data: An evaluation by Monte Carlo simulations , 2010 .

[19]  K. Lahiri,et al.  On the estimation of inflationary expectations from qualitative responses , 1981 .

[20]  D. Hensher,et al.  A mixed generalized ordered response model for examining pedestrian and bicyclist injury severity level in traffic crashes. , 2008, Accident; analysis and prevention.

[21]  N. Mankiw,et al.  Sticky Information Versus Sticky Prices: A Proposal to Replace the New Keynesian Phillips Curve , 2001 .

[22]  Roy Batchelor,et al.  Inflation Expectations Revisited , 1988 .

[23]  James B. Mitchell,et al.  The Use of Non-Normal Distributions in Quantifying Qualitative Survey Data , 2002 .

[24]  Nicholas S. Souleles.  Expectations, Heterogeneous Forecast Errors, and Consumption: Micro Evidence from the Michigan Consumer Sentiment Surveys , 2004 .

[25]  Steffen R. Henzel,et al.  Quantifying Inflation Expectations with the Carlson-Parkin Method - a Survey-Based Determination of the Just Noticeable Difference , 2005 .

[26]  Helmut Seitz,et al.  The estimation of inflation forecasts from business survey data , 1988 .

[27]  Jörg Breitung,et al.  Quantifying survey expectations: What's wrong with the probability approach? , 2011 .

[28]  R. Curtin.  Consumer Sentiment Surveys: Worldwide Review and Assessment , 2007 .

[29]  Thomas Maag,et al.  Essays on inflation expectation formation , 2010 .

[30]  Gunter Löffler.  Refining the Carlson–Parkin method , 1999 .

[31]  Satoru Kanoh,et al.  A Method of Exploring the Mechanism of Inflationary Expectations Based on Qualitative Survey Data , 1990 .

[32]  G. Kenny,et al.  Survey Expectations, Rationality and the Dynamics of Euro Area Inflation , 2003 .

[33]  M. Weale,et al.  Qualitative business surveys: signal or noise? , 2011 .

[34]  Kajal Lahiri,et al.  A Comparative Study of Alternative Methods of Quantifying Qualitative Survey Responses Using NAPM Data , 1992 .

[35]  Christiana Müller.  The information content of qualitative survey data , 2009 .

[36]  Oscar Claveria,et al.  Business and consumer expectations and macroeconomic forecasts , 2007 .

[37]  Martin Weale,et al.  The utility of expectational data: Firm-level evidence using matched qualitative-quantitative UK surveys , 2011 .

[38]  W. Greene,et al.  Modeling Ordered Choices: A Primer , 2010 .

[39]  Min Wei,et al.  Do Macro Variables, Asset Markets or Surveys Forecast Inflation Better? , 2005 .

[40]  Rolf Scheufele.  Are Qualitative Inflation Expectations Useful to Predict Inflation , 2011 .