Social-psychological Aspects of Probability-based Online Panel Participation

In this study, we use qualitative research methods to identify, discuss, and investigate the self-reported motivational factors and barriers in all stages of the probability-based online panel lifecycle—recruitment to the panel, wave-by-wave data collection, and voluntary attrition. Our data were gathered with qualitative in-depth interviews (IDIs). Between March 2020 and February 2021, panelists from the Life in Australia™ probability online panel were classified into four groups based on their previous panel response behavior and each was interviewed. The qualitative data were used to link the reported motivation for and barriers against joining and staying active in the panel with theories about survey participation. Evidence from the IDIs shows that motivations and barriers can be directly linked to social-psychological theories that explain panel/longitudinal survey participation, including how theories such as social-exchange theory, leverage-salience theory, and the reasoned action approach, are sufficiently robust to help understand the time dimension of survey participation and behavioral change of panel members. Our findings have practical implications for probability-based online panel management.

[1]  N. Biddle,et al.  The power of online panel paradata to predict unit nonresponse and voluntary attrition in a longitudinal design , 2022, Quality & Quantity.

[2]  Annelies G. Blom,et al.  Recruiting a Probability-Based Online Panel via Postal Mail: Experimental Evidence , 2021, Social Science Computer Review.

[3]  E. Casey,et al.  An Examination of the Sufficiency of Small Qualitative Samples , 2018, Social Work Research.

[4]  Florian Keusch,et al.  Why do people participate in Web surveys? Applying survey participation theory to Internet survey data collection , 2015, Management Review Quarterly.

[5]  P. Lugtig.  Panel Attrition , 2014 .

[6]  Martin Wetzels,et al.  Individual Differences in Motivation to Participate in Online Panels , 2011 .

[7]  Elisabeth Brüggen,et al.  Determinants of Participation and Response Effort in Web Panel Surveys , 2009 .

[8]  James B. Wiley,et al.  Applying theory to structure respondents' stated motivations for participating in web surveys , 2009 .

[9]  M. Crouch,et al.  The logic of small samples in interview-based qualitative research , 2006 .

[10]  Tracy L. Tuten,et al.  Unit (non)response in Web‐based access panel surveys: An extended planned‐behavior approach , 2005 .

[11]  P. Lavrakas,et al.  The Influence of Incremental Increases in Token Cash Incentives on Mail Survey Response Is There an Optimal Amount , 2004 .

[12]  E. Singer,et al.  Leverage-saliency theory of survey participation: description and an illustration. , 2000, Public opinion quarterly.

[13]  Robert M. Groves,et al.  UNDERSTANDING THE DECISION TO PARTICIPATE IN A SURVEY , 1992 .

[14]  J. Krosnick.  Response strategies for coping with the cognitive demands of attitude measures in surveys , 1991 .

[15]  K. Cook,et al.  Social Exchange Theory , 1989, Theoretical Sociology.

[16]  R. G. St. Pierre,et al.  Attrition , 1978, The International Encyclopedia of Higher Education Systems and Institutions.

[17]  D. Bem.  Self-perception: An alternative interpretation of cognitive dissonance phenomena. , 1967, Psychological review.

[18]  J. A. Smiley,et al.  Incentives , 2019, Handbook of Research Methods and Applications in Experimental Economics.

[19]  D. Dillman.  Towards Survey Response Rate Theories That No Longer Pass Each Other Like Strangers in the Night , 2020 .

[20]  Timo Gnambs,et al.  The Interactive Effects of Motivations and Trust in Anonymity on Adolescents ’ Enduring Participation in Web-Based Social Science Research : A Longitudinal Behavioral Analysis , 2012 .

[21]  Scott M. Smith,et al.  Why People Agree to Participate in Surveys , 2012 .

[22]  Adam Kowol.  The theory of cognitive dissonance By , 2008 .

[23]  E. Deci,et al.  Intrinsic and Extrinsic Motivations: Classic Definitions and New Directions. , 2000, Contemporary educational psychology.

[24]  R. Porst,et al.  Wären Sie vielleicht bereit, sich gegebenenfalls noch einmal befragen zu lassen? Oder: Gründe für die Teilnahme an Panelbefragungen , 1995 .