How reliable are income data collected with a single question?

Income is an important correlate for numerous phenomena in the social sciences. But many surveys collect data with just a single question covering all forms of income. This raises issues of quality, and these are heightened when individuals are asked about the household total rather than own income alone. Data are typically banded, implying a loss of information. We investigate the reliability of ‘single-question’ data using the ONS Omnibus and British Social Attitudes (BSA) surveys as examples. We first compare the distributions of income in these surveys – individual income in the Omnibus and household income in the BSA – with those in two other much larger UK surveys that measure income in much greater detail. Second, we investigate an implication of restricting the single question to individual income and interviewing only one adult per household: total income in respondents’ households is unobserved. We therefore examine the relationship between individual and household income in one of the comparator surveys. Third, after imposing bands on comparator survey data, we measure the information loss from banding with Generalised Entropy indices. We then assess its impact on the use of income as a covariate. Disaggregation by gender proves fruitful in much of the analysis.

[1]  S. Jenkins,et al.  A comparison of current and annual measures of income in the British Household Panel Survey , 2006 .

[2]  Ben Jann Multinomial Goodness-of-Fit: Large-Sample Tests with Survey Design Correction and Exact Tests for Small Samples , 2008 .

[3]  Population Censuses Surveys Office,et al.  Family Expenditure Survey Handbook , 1980 .

[4]  C. Hsiao REGRESSION ANALYSIS WITH A CATEGORIZED EXPLANATORY VARIABLE , 1983 .

[5]  Edgar K. Browning Inequality and Poverty , 1989 .

[6]  G. Duncan,et al.  Evidence on the Validity of Cross-Sectional and Longitudinal Labor Market Data , 1994, Journal of Labor Economics.

[7]  Ulrich Rendtel,et al.  The 2005 Plenary Meeting on ‘‘Missing Data and Measurement Error’’ , 2006 .

[8]  G. Mayr,et al.  Allgemeines Statistisches Archiv. , 1891 .

[9]  J. Hausman Mismeasured Variables in Econometric Analysis: Problems from the Right and Problems from the Left , 2001 .

[10]  F. Y. Edgeworth On the Probable Errors of Frequency-Constants , 1908 .

[11]  John Bound,et al.  Measurement error in survey data , 2001 .

[12]  Sylke V Schnepf,et al.  Who Gives for Overseas Development? , 2007 .

[13]  Farhad Mehran,et al.  Optimal Grouping of Income Distribution Data , 1981 .

[14]  S. J. Prais,et al.  The Grouping of Observations in Regression Analysis , 1954 .

[15]  J. Davies,et al.  Optimal grouping of income and wealth data , 1989 .

[16]  D. Cox Note on Grouping , 1957 .

[17]  C. Manski,et al.  Inference on Regressions with Interval Data on a Regressor or Outcome , 2002 .

[18]  Thomas M. Stoker,et al.  Estimation with Censored Regressors: Basic Issues , 2007 .

[19]  A. Kapteyn,et al.  Patterns of poverty in Europe , 1998 .

[20]  Anthony B. Atkinson,et al.  On the Reliability of Income Data in the Family Expenditure Survey 1970–1977 , 1983 .