Understanding Society Innovation Panel Wave 2: results from methodological experiments

This paper presents some preliminary findings from the Wave 2 Innovation Panel (IP2) of Understanding Society: The UK Household Longitudinal Study. Understanding Society is a major new panel survey for the UK. In April 2009, the second wave of the Innovation Panel was fielded. This paper describes the design of IP2, the experiments carried and the preliminary findings from early analysis of the data. The main design features of Understanding Society are outlined and the design and conduct of IP2 described. The results of methodological experiments carried at IP2 are reported and the impact of IP2 on the design of the main survey reviewed.

[1]  M. Iacovou,et al.  Yearning, learning, and conceding: reasons men and women change their childbearing intentions. , 2011, Population and development review.

[2]  D. Gorassini,et al.  Does self-perception change explain the foot-in-the-door effect? , 1995 .

[3]  R. Beaglehole,et al.  Underestimation of relative weight by use of self-reported height and weight. , 1987, American journal of epidemiology.

[4]  Jan Pahl,et al.  His money, her money: Recent research on financial organisation in marriage , 1995 .

[5]  C. Kuzawa,et al.  Longitudinal evidence that fatherhood decreases testosterone in human males , 2011, Proceedings of the National Academy of Sciences.

[6]  Aage R. Clausen.  RESPONSE VALIDITY: VOTE REPORT , 1968 .

[7]  Geoffrey Raymond.  Grammar and Social Organization: Yes/No Interrogatives and the Structure of Responding , 2003, American Sociological Review.

[8]  Benedikt Hell,et al.  Are occupational interests hormonally influenced? The 2D:4D-interest nexus. , 2011 .

[9]  A. Todorov.  Context effects in national health surveys: effects of preceding questions on reporting serious difficulty seeing and legal blindness. , 2000, Public opinion quarterly.

[10]  Robert Schoen,et al.  Do fertility intentions affect fertility behavior , 1999 .

[11]  R. Lippa.  Are 2D:4D finger-length ratios related to sexual orientation? Yes for men, no for women. , 2003, Journal of personality and social psychology.

[12]  S. N. Uhrig.  Understanding panel conditioning: an examination of social desirability bias in self-reported height and weight in panel surveys using experimental data , 2011 .

[13]  D. Bem.  Self-Perception Theory , 1972 .

[14]  Jo Blanden,et al.  Educational Inequality and the Expansion of UK Higher Education , 2004 .

[15]  M. Voracek,et al.  2nd to 4th digit ratio (2D:4D) and number of sex partners: Evidence for effects of prenatal testosterone in men , 2006, Psychoneuroendocrinology.

[16]  Aldo Rustichini,et al.  Second-to-fourth digit ratio predicts success among high-frequency financial traders , 2009, Proceedings of the National Academy of Sciences.

[17]  Peter Lynn,et al.  MEASURING CHANGE IN EMPLOYMENT CHARACTERISTICS: THE EFFECTS OF DEPENDENT INTERVIEWING , 2005 .

[18]  Jolene D. Smyth,et al.  Comparing Check-All and Forced-Choice Question Formats in Web Surveys , 2006 .

[19]  E. L. Kelly,et al.  Preferences in Size of Family and Eventual Fertility Twenty Years After , 1957, American Journal of Sociology.

[20]  Jonathan Burton,et al.  Understanding Society. Some preliminary results from the Wave 1 Innovation Panel , 2008 .

[21]  Martin Browning,et al.  Shocks, Stocks and Socks , 2003 .

[22]  B. Ramesh Babu,et al.  a Scientometric Analysis , 2008 .

[23]  Martin Voracek,et al.  Scientometric Analysis and Bibliography of Digit Ratio (2D:4D) Research, 1998–2008 , 2009, Psychological reports.

[24]  R J Glynn,et al.  Role of longitudinal change and secular trend in age differences in male body dimensions. , 1983, Human biology.

[25]  Sven E. Wilson,et al.  Do panel surveys make people sick? US arthritis trends in the Health and Retirement Study. , 2005, Social science & medicine.

[26]  Norbert Schwarz,et al.  Assimilation and Contrast Effects in Part-Whole Question Sequences: A Conversational Logic Analysis , 1991 .

[27]  Johannes Hönekopp,et al.  Meta‐analysis of digit ratio 2D:4D shows greater sex difference in the right hand , 2010, American journal of human biology : the official journal of the Human Biology Council.

[28]  Carolyn M. Vogler.  Cohabiting Couples: Rethinking Money in the Household at the Beginning of the Twenty First Century , 2005 .

[29]  Derek Wanless,et al.  Wanless social care review: securing good care for older people, taking a long-term view , 2006 .

[30]  Jonathan D. Klein,et al.  Merely incidental?: Effects of response format on self-reported behavior , 2006 .

[31]  Johannes Hönekopp,et al.  Second to fourth digit length ratio (2D:4D) and adult sex hormone levels: New data and a meta-analytic review , 2007, Psychoneuroendocrinology.

[32]  J. Pascale,et al.  Exploring Confidentiality Issues Related to Dependent Interviewing: Preliminary Findings , 2004 .

[33]  Carole B. Burgoyne,et al.  The financial practices and perceptions behind separate systems of household financial management , 2009 .

[34]  Life after death: An investigation into how mortality perceptions influence fertility preferences using evidence from an internet-based experiment , 2008 .

[35]  Geert Loosveldt,et al.  Face-to-Face versus Web Surveying in a High-Internet-Coverage Population Differences in Response Quality , 2008 .

[36]  T. Fulmer,et al.  Successful aging. , 2002, The American journal of nursing.

[37]  Jon A. Krosnick,et al.  Comparing Oral Interviewing with Self-Administered Computerized QuestionnairesAn Experiment , 2010 .

[38]  Alan B. Krueger,et al.  Are We Having More Fun Yet? Categorizing and Evaluating Changes in Time Allocation , 2008 .

[39]  Peter Lynn,et al.  Methodology of longitudinal surveys , 2009 .

[40]  J T Manning,et al.  The ratio of 2nd to 4th digit length: a predictor of sperm numbers and concentrations of testosterone, luteinizing hormone and oestrogen. , 1998, Human reproduction.

[41]  Peter Lynn,et al.  Sample Design for Understanding Society , 2009 .

[42]  Robert Turner.  Inter‐Week Variations in Expenditure Recorded During a Two‐Week Survey of Family Expenditure , 1961 .

[43]  W. James,et al.  Finger-length ratios, sexual orientation and offspring sex ratios. , 2001, Journal of theoretical biology.

[44]  R. Porst,et al.  A Description of the German General Social Survey Test-Retest Study and a Report on the Stabilities of the Sociodemographic Variables , 1987 .

[45]  A. Clark.  Job Satisfaction and Gender. Why are Women so Happy at Work , 1997 .

[46]  Scott Menard,et al.  Handbook of longitudinal research : design, measurement, and analysis , 2008 .

[47]  Jeffrey Moore.  Exploiting Computer Automation to Improve the Interview Process and Increase Survey Cooperation , 2002 .

[48]  Justin Wolfers,et al.  The Paradox of Declining Female Happiness , 2009, SSRN Electronic Journal.

[49]  Scott M. Hofer,et al.  Biological Models of Behavior and the Life Course , 2003 .

[50]  C. Finch,et al.  Are We Having Fun Yet? , 2012, Sports Medicine.

[51]  Barbara A. Bailar,et al.  The Effects of Rotation Group Bias on Estimates from Panel Surveys , 1975 .

[52]  J. Krosnick.  Response strategies for coping with the cognitive demands of attitude measures in surveys , 1991 .

[53]  Wendy Visscher,et al.  The Item Count Technique as a Method of Indirect Questioning: A Review of Its Development and a Case Study Application , 2011 .

[54]  Nora Cate Schaeffer,et al.  HARDLY EVER OR CONSTANTLY? GROUP COMPARISONS USING VAGUE QUANTIFIERS , 1991 .

[55]  R. Kraut,et al.  How Being Interviewed Affects Voting: An Experiment , 1973 .

[56]  Steve Smallwood,et al.  Family building intentions in England and Wales: trends, outcomes and interpretations. , 2003, Population trends.

[57]  E. Singer,et al.  Context Effects in Attitude Surveys , 2003 .

[58]  Johannes Hönekopp,et al.  Meta-analysis of the relationship between digit-ratio 2D:4D and aggression , 2011 .

[59]  A. Jäckle.  Dependent Interviewing: A Framework and Application to Current Research , 2009 .

[60]  A. Berrington.  Perpetual postponers? Women's, men's and couple's fertility intentions and subsequent fertility behaviour. , 2004, Population trends.

[61]  I. Hendriksen,et al.  Accuracy of self-reported body weight, height and waist circumference in a Dutch overweight working population , 2008, BMC medical research methodology.

[62]  M. Voracek,et al.  Digit ratio (2D:4D) and sensation seeking: New data and meta-analysis , 2010 .

[63]  Martin Voracek,et al.  Digit ratio (2D:4D) and sex-role orientation: Further evidence and meta-analysis , 2011 .

[64]  M. Hindin,et al.  The effect of husbands’ and wives’ fertility preferences on the likelihood of a subsequent pregnancy, Bangladesh 1998–2003 , 2009, Population studies.

[65]  R. Easterlin.  Will raising the incomes of all increase the happiness of all , 1995 .

[66]  M. Traugott,et al.  Response Validity in Surveysof Voting Behavior , 1979 .

[67]  J. Mortimer,et al.  Handbook of the life course , 2003 .

[68]  C. Ai,et al.  Computing Interaction Effects and Standard Errors in Logit and Probit Models , 2004 .

[69]  R. Ferber.  Observations on a Consumer Panel Operation * , 1953 .

[70]  Richard F. Yalch.  Pre-election Interview Effects on Voter Turnout , 1976 .

[71]  Jonathan Burton,et al.  Lessons from a Randomised Experiment with Mixed- Mode Designs for a Household Panel Survey , 2010 .

[72]  N. Schwarz,et al.  Thinking About Answers: The Application of Cognitive Processes to Survey Methodology , 1995, Quality of Life Research.

[73]  S. Menard,et al.  Data set comparability and short-term trends in crime and delinquency , 1993 .

[74]  Brendan T. O'Connor,et al.  From Tweets to Polls: Linking Text Sentiment to Public Opinion Time Series , 2010, ICWSM.

[75]  A. Petch.  Shaping the Future of Care Together , 2009 .

[76]  R. Easterlin.  Does Economic Growth Improve the Human Lot? Some Empirical Evidence , 1974 .

[77]  R. Freedman,et al.  Do statements about desired family size predict fertility? the case of Taiwan, 1967–1970 , 1975, Demography.

[78]  Plasticity, life history and inclusive fitness: an evolutionary demography perspective on individual variation in fertility and fertility preferences in contemporary Britain , 2012 .

[79]  N. Bates,et al.  Tackling Seam Bias Through Questionnaire Design , 2009 .

[80]  R. Burriss,et al.  Sexual orientation and the second to fourth finger length ratio: a meta-analysis in men and women. , 2010, Behavioral neuroscience.

[81]  S. Pudney.  An Experimental Analysis of the Impact of Survey Design on Measures and Models of Subjective Wellbeing , 2010 .

[82]  ‘‘It Is Time Computers Do Clever Things!’’: The Impact of Dependent Interviewing on Interviewer Burden , 2011 .

[83]  Larry M. Bartels.  Panel Effects in the American National Election Studies , 1999, Political Analysis.

[84]  M. Rowland,et al.  Self-reported weight and height. , 1990, The American journal of clinical nutrition.

[85]  D. Nettle,et al.  Birthweight and paternal involvement predict early reproduction in British women: Evidence from the National Child Development Study , 2009, American journal of human biology : the official journal of the Human Biology Council.

[86]  A. Oswald,et al.  Satisfaction and comparison income , 1996 .

[87]  R. Tourangeau,et al.  The Framing of the Survey Request and Panel Attrition , 2009 .

[88]  J. Neter,et al.  Conditioning Effects from Repeated Household Interviews , 1964 .

[89]  Patrick Sturgis,et al.  Attitudes Over Time: The Psychology of Panel Conditioning , 2009 .

[90]  L. Rips,et al.  The Psychology of Survey Response , 2000 .

[91]  Alexia Prskawetz,et al.  Are Individuals’ Desired Family Sizes Stable? Evidence from West German Panel Data , 2008 .

[92]  R J Prineas,et al.  Comparison of self-reported and measured height and weight. , 1982, American journal of epidemiology.

[93]  L. Toulemon,et al.  Family Formation in France: Individual Preferences and Subsequent Outcomes , 2006 .

[94]  R. Tourangeau,et al.  Sensitive questions in surveys. , 2007, Psychological bulletin.

[95]  S. Cohen,et al.  DATA COLLECTION FREQUENCY EFFECT IN THE NATIONAL MEDICAL CARE UTILIZATION AND EXPENDITURE SURVEY , 2002 .

[96]  S. Breedlove,et al.  Minireview: Organizational hypothesis: instances of the fingerpost. , 2010, Endocrinology.

[97]  P. Aglobitse,et al.  The time dynamics of individual fertility preferences among rural Ghanaian women. , 2010, Studies in family planning.

[98]  Robert M. Groves,et al.  UNDERSTANDING THE DECISION TO PARTICIPATE IN A SURVEY , 1992 .

[99]  W. DeJong,et al.  The effect of a prosocial label on helping behavior. , 1981 .

[100]  Bleddyn P. Davies,et al.  Securing Good Care for Older People: Taking a Long-term View , 2007 .

[101]  David Kjellberg.  Measuring Expectations , 1999, Identification Problems in the Social Sciences.

[102]  S. Pudney,et al.  Survey Design and the Analysis of Satisfaction , 2011, Review of Economics and Statistics.

[103]  S. Gaulin,et al.  Sex hormones and finger length: What does 2D:4D indicate? , 2004 .

[104]  M. Voracek,et al.  Investigating digit ratio (2D:4D) in a highly male-dominated occupation: the case of firefighters. , 2010, Scandinavian journal of psychology.

[105]  Jon A. Krosnick,et al.  Comparisons of Party Identification and Policy Preferences: The Impact of Survey Question Format , 1993 .

[106]  R. Rimal,et al.  Assessing the Perceived Importance of Skin Cancer: How Question-Order Effects Are Influenced by Issue Involvement , 2005, Health education & behavior : the official publication of the Society for Public Health Education.

[107]  A. Berrington,et al.  Stability and change in fertility intentions in Britain, 1991–2007 , 2010, Population trends.

[108]  W. Kemsley.  The Household Expenditure Enquiry of the Ministry of Labour. Variability in the 1953-54 enquiry. , 1961 .

[109]  T. Key,et al.  Validity of self-reported height and weight in 4808 EPIC–Oxford participants , 2002, Public Health Nutrition.

[110]  S. N. Uhrig,et al.  Cognitive testing of Wave 3 Understanding Society questions , 2011 .

[111]  Annette E Jäckle,et al.  Dependent Interviewing: Effects on Respondent Burden and Efficiency of Data Collection , 2008 .