Design, Evaluation, and Analysis of Questionnaires for Survey Research

Preface. Introduction. PART I. THE THREE STEPS PROCEDURE TO DESIGN REQUESTS FOR AN ANSWER. 1. Concepts-by-postulation and concepts-by-intuition. 2. From social science concepts-by-intuition to assertions. 3. The formulation of requests for an answer. PART II. CHOICES INVOLVED IN QUESTIONNAIRE DESIGN. 4. Specific survey research features of requests for an answer. 5. Response alternatives. 6. The structure of open ended and closed survey items. 7. Survey items in batteries. 8. Mode of data collection and other choices. PART III. THE EFFECTS OF SURVEY CHARACTERISTICS ON DATA QUALITY. 9. Criteria for the quality of survey measures. 10. The estimation of reliability, validity and method effects. 11. The split ballot MTMM designs. 12. The estimation of the effects of measurement characteristics on the quality of survey questions. PART IV. APPLICATIONS IN SOCIAL SCIENCE RESEARCH. 13. The prediction and improvement of survey requests by SQP. 14. The quality of measures for concepts-by-postulation. 15. Correction for measurement error in survey data analysis. 16. Coping with measurement error in cross-cultural research. References. Index.

[1]  Willem E. Saris,et al.  Testing Structural Equation Models or Detection of Misspecifications? , 2009 .

[2]  Fábio de Castro,et al.  A question of quality. , 2009, Revista brasileira de cirurgia cardiovascular : orgao oficial da Sociedade Brasileira de Cirurgia Cardiovascular.

[3]  Gerard Delanty.  The Foundations of Social Theory , 2009 .

[4]  Eldad Davidov,et al.  A cross-country and cross-time comparison of the human values measurements with the second round of the European Social Survey , 2008 .

[5]  Willem E. Saris,et al.  Estimation of the effects of measurement characteristics on the quality of survey questions , 2007 .

[6]  L. Pelletier,et al.  Longitudinal Cross-Gender Factorial Invariance of the Academic Motivation Scale , 2006 .

[7]  I. Stoop,et al.  The hunt for the last respondent : nonresponse in sample surveys , 2005 .

[8]  P. Sniderman,et al.  CHAPTER 5: The Structure of Political Argument and the Logic of Issue Framing , 2004 .

[9]  W. Saris,et al.  CHAPTER 2: Separation of Error, Method Effects, Instability, and Attitude Strength , 2004 .

[10]  Willem E. Saris,et al.  Operationalization of Social Science Concepts by Intuition , 2004 .

[11]  Steven Durlauf,et al.  Social Capital , 2004 .

[12]  P. Converse.  The Nature of Belief Systems in Mass Publics , 2004 .

[13]  N. Schwarz,et al.  Thinking About Answers: The Application of Cognitive Processes to Survey Methodology , 1995, Quality of Life Research.

[14]  E. P. W. A Jansen,et al.  Enquêteren : het opstellen en gebruiken van vragenlijsten , 2004 .

[15]  Peter B. Smith.  Values and culture , 2004 .

[16]  W. Saris,et al.  To Participate or Not to Participate: The Link Between Survey Participation, Electoral Participation, and Political Interest , 2003, Political Analysis.

[17]  T. Gonen,et al.  Questions , 1927, Journal of Family Planning and Reproductive Health Care.

[18]  B. Emans.  Interviewen, theorie, techniek, training , 2003 .

[19]  W. M. Veld.  The Survey Response Dissected. A new theory about the surrvey response process , 2003 .

[20]  W. Saris.  Relationship Between a Restricted Correlated Uniqueness Model and a Direct Product Model for Multitrait-Multimethod Data , 2003 .

[21]  V. Hudson.  Foreign Policy Decision Making , 2002 .

[22]  Gary Adamson,et al.  A Monte Carlo Examination of an MTMM Model With Planned Incomplete Data Structures , 2002 .

[23]  Willem E. Saris,et al.  Fit of Different Models for Multitrait-Multimethod Experiments , 2002 .

[24]  M. Larsen,et al.  The Psychology of Survey Response , 2002 .

[25]  K. Newton.  Social trust and political disaffection: social capital and democracy , 2002 .

[26]  M. Couper,et al.  Web Surveys , 2001 .

[27]  Peter Wiemer-Hastings,et al.  THE GOLD STANDARD OF QUESTION QUALITY ON SURVEYS: EXPERTS, COMPUTER TOOLS, , 2001 .

[28]  D. Kaplan.  Structural Equation Modeling: Foundations and Extensions , 2000 .

[29]  Jaak Billiet,et al.  Modeling Acquiescence in Measurement Models for Two Balanced Sets of Items , 2000 .

[30]  Michael Eid,et al.  A multitrait-multimethod model with minimal assumptions , 2000 .

[31]  Willem E. Saris,et al.  Testing Nested Additive, Multiplicative, and General Multitrait-Multimethod Models , 2000 .

[32]  R. Bagozzi,et al.  On the nature and direction of relationships between constructs and measures. , 2000, Psychological methods.

[33]  Arthur C. Graesser,et al.  QUAID: A questionnaire evaluation aid for survey methodologists , 2000, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[34]  J. van der Zouwen,et al.  An assessment of the difficulty of questions used in the ISSP-questionnaires, the clarity of their wording, and the comparability of the responses , 2000 .

[35]  A. Winsor.  Sampling techniques. , 2000, Nursing times.

[36]  D. Dillman.  Mail and internet surveys , 1999 .

[37]  Anuska Ferligoj,et al.  Evaluation of social network measurement instruments , 1999, Soc. Networks.

[38]  George Yule,et al.  Explaining English Grammar , 1999 .

[39]  W. Saris,et al.  Stability of Three-Wave Simplex Estimates of Reliability. , 1999 .

[40]  J. Steenkamp,et al.  Assessing Measurement Invariance in Cross-National Consumer Research , 1998 .

[41]  E. Ziegel,et al.  Nonresponse In Household Interview Surveys , 1998 .

[42]  K. Newton.  Social Capital and Democracy , 1997 .

[43]  J. Hox.  From theoretical concept to survey question , 1997 .

[44]  Jon A. Krosnick,et al.  Designing Rating Scales for Effective Measurement in Surveys , 1997 .

[45]  Roger Tourangeau,et al.  Effects of Interview Mode on Sensitive Questions in a Fertility Survey , 1997 .

[46]  J. L. Esposito,et al.  Evaluating Survey Data: Making the Transition from Pretesting to Quality Assessment , 1997 .

[47]  Hans-Dieter Klingemann.  The left-right self-placement question in face to face and telephone surveys , 1997 .

[48]  W. Saris.  Comparability across mode and country , 1997 .

[49]  J. Lass,et al.  Sizes of the different effects: coverage, mode and nonresponse , 1997 .

[50]  T. Little.  Mean and Covariance Structures (MACS) Analyses of Cross-Cultural Data: Practical and Theoretical Issues. , 1997, Multivariate behavioral research.

[51]  Tom W. Smith,et al.  ASKING SENSITIVE QUESTIONS THE IMPACT OF DATA COLLECTION MODE, QUESTION FORMAT, AND QUESTION CONTEXT , 1996 .

[52]  W. Saris,et al.  Causal direction in a model of life satisfaction: The top-down/bottom-up controversy , 1996 .

[53]  Judith T. Lessler,et al.  A coding system for appraising questionnaires. , 1996 .

[54]  Ole R. Holsti,et al.  Public opinion and American foreign policy , 1996 .

[55]  A. Tesser,et al.  The psychology of evaluation. , 1996 .

[56]  Werner Wothke,et al.  Models for Multitratit-Multimethod Matrix Analysis , 1996 .

[57]  W. Dijkstra,et al.  Trivial and Non-Trivial Question-Answer Sequences; Types, Determinants and Effects on Data Quality , 1996 .

[58]  J. Ginzburg.  Interrogatives: questions, facts and dialogue , 1996 .

[59]  Thomas F. Pettigrew,et al.  Subtle and blatant prejudice in Western Europe , 1995 .

[60]  Willem E. Saris,et al.  Memory effects in MTMM studies , 1995 .

[61]  Knud Lambrecht,et al.  Information structure and sentence form , 1994 .

[62]  Rodney Huddleston,et al.  The contrast between interrogatives and questions , 1994, Journal of Linguistics.

[63]  W. Aquilino.  INTERVIEW MODE EFFECTS IN SURVEYS OF DRUG AND ALCOHOL USE: A FIELD EXPERIMENT , 1994 .

[64]  Arthur C. Graesser,et al.  Question asking and answering. , 1994 .

[65]  D. Rucinski.  The Nature and Origins of Mass Opinion. , 1994 .

[66]  Stanley Presser,et al.  SURVEY PRETESTING: DO DIFFERENT METHODS PRODUCE DIFFERENT RESULTS? , 1994 .

[67]  W. Meredith.  Measurement invariance, factor analysis and factorial invariance , 1993 .

[68]  E. Weber.  Varieties of Questions in English Conversation , 1993 .

[69]  W. Aquilino.  EFFECTS OF SPOUSE PRESENCE DURING THE INTERVIEW ON SURVEY RESPONSES CONCERNING MARRIAGE , 1993 .

[70]  Zdenek Kotásek,et al.  I-path analysis , 1993, Proceedings ETC 93 Third European Test Conference.

[71]  L. Henderson.  On the Social System , 1993 .

[72]  D. A. Kenny,et al.  Analysis of the multitrait^multimethod matrix by confirmatory factor analysis , 1992 .

[73]  Albert Satorra,et al.  Asymptotic robust inferences in the analysis of mean and covariance structures , 1992 .

[74]  Jon A. Krosnick,et al.  The Reliability of Survey Attitude Measurement , 1991 .

[75]  Stuart Macdonald,et al.  New Players in an Old Game , 1991 .

[76]  J. Krosnick.  Response strategies for coping with the cognitive demands of attitude measures in surveys , 1991 .

[77]  Richard P. Bagozzi,et al.  Multitrait-Multimethod Matrices in Consumer Research , 1991 .

[78]  H. Marsh,et al.  Confirmatory Factor Analyses of Multitrait-Multimethod Data: A Comparison of Alternative Models , 1991 .

[79]  Paul M. Sniderman,et al.  Reasoning and Choice: The principle–policy puzzle: the paradox of American racial attitudes , 1991 .

[80]  D. Dillman.  The Design and Administration of Mail Surveys , 1991 .

[81]  Christine E. DeMars,et al.  Item Response Theory , 2010, Assessing Measurement Invariance for Applied Research.

[82]  R. Lennox,et al.  Conventional wisdom on measurement: A structural equation perspective. , 1991 .

[83]  Albert Satorra,et al.  Robustness issues in structural equation modeling: a review of recent developments , 1990 .

[84]  Eric R. Ziegel,et al.  Survey Errors and Survey Costs , 1990 .

[85]  W. Aquilino,et al.  EFFECTS OF INTERVIEW MODE ON SELF-REPORTED DRUG USE , 1990 .

[86]  Michael E. Sobel,et al.  Pseudo-Maximum Likelihood Estimation of Mean and Covariance Structures with Missing Data , 1990 .

[87]  F. J. Fowler,et al.  Standardized Survey Interviewing , 1990 .

[88]  H. Marsh.  Confirmatory Factor Analyses of Multitrait-Multimethod Data: Many Problems and a Few Solutions , 1989 .

[89]  Richard P. Bagozzi,et al.  An investigation of the role of affective and moral evaluations in the purposeful behaviour model of attitude , 1989 .

[90]  B. Byrne,et al.  Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. , 1989 .

[91]  Willem E. Saris.  A measurement model for psychophysical scaling , 1988 .

[92]  D. Francis.  An introduction to structural equation models. , 1988, Journal of clinical and experimental neuropsychology.

[93]  R. Huddleston.  English Grammar: An Outline , 1988 .

[94]  R. Cudeck.  Msultiplicative Models and MTMM Matrices , 1988 .

[95]  J. Krosnick,et al.  Attitude intensity, importance, and certainty and susceptibility to response effects. , 1988 .

[96]  J. Coleman,et al.  Social Capital in the Creation of Human Capital , 1988, American Journal of Sociology.

[97]  J. Rempel,et al.  Attitudes: A new look at an old concept. , 1988 .

[98]  Willem E. Saris,et al.  Variation in response functions : a source of measurement error in attitude research , 1988 .

[99]  Bengt Muthén,et al.  On structural equation modeling with data that are not missing completely at random , 1987 .

[100]  Tom W. Smith.  THE ART OF ASKING QUESTIONS, 1936–1985 , 1987 .

[101]  Norbert Schwarz,et al.  What Response Scales may Tell your Respondents: Informative Functions of Response Alternatives , 1987 .

[102]  Norbert Schwarz,et al.  Response Effects in Surveys , 1987 .

[103]  S. Kiesler,et al.  Response Effects in the Electronic Survey , 1986 .

[104]  S. Presser,et al.  Survey Questions: Handcrafting the Standardized Questionnaire. , 1986 .

[105]  P. Tetlock,et al.  Reflections on American Racism , 1986 .

[106]  Timothy D. Wilson,et al.  Effects of introspection on attitude-behavior consistency: Analyzing reasons versus focusing on feelings , 1986 .

[107]  Thomas J. Page,et al.  Causal modelling in nonexperimental research : an introduction to the LISREL approach , 1985, American Political Science Review.

[108]  Terance D. Miethe.  The Validity and Reliability of Value Measurements , 1985 .

[109]  D. O. Sears,et al.  Whites' Opposition to Busing. On Conceptualizing and Operationalizing Group Conflict , 1985 .

[110]  S. Presser,et al.  Questions and Answers in Attitude Surveys: Experiments on Question Form, Wording, and Context , 1996 .

[111]  M. Browne,et al.  The decomposition of multitrait-multimethod matrices. , 1984, The British journal of mathematical and statistical psychology.

[112]  K. A. Ericsson,et al.  Protocol Analysis: Verbal Reports as Data , 1984 .

[113]  Louis T. Milic,et al.  Interrogativity : a colloquium on the grammar, typology, and pragmatics of questions in seven diverse languages, Cleveland, Ohio, October 5th, 1981-May 3rd, 1982 , 1984 .

[114]  Graham Kalton,et al.  Introduction to Survey Sampling , 1983 .

[115]  J. Horn,et al.  When is invariance not invarient: A practical scientist's look at the ethereal concept of factor invariance. , 1983 .

[116]  J. Conley.  Asking questions: A practical guide to questionnaire design , 1983 .

[117]  秦岭.  Practical English Usage , 1983 .

[118]  Jan Svartvik,et al.  A __ comprehensive grammar of the English language , 1988 .

[119]  W. Belson.  The design and understanding of survey questions , 1982 .

[120]  M. Barker.  The New Racism: Conservatives And The Ideology Of The Tribe , 1981 .

[121]  Eli P. Cox,et al.  The Optimal Number of Response Alternatives for a Scale: A Review , 1980 .

[122]  H. Kelley,et al.  Attribution theory and research. , 1980, Annual review of psychology.

[123]  Willem E. Saris,et al.  Optimal Procedures for Estimation of Factor Scores , 1978 .

[124]  Alan W. Wells.  Contemporary sociological theories , 1978 .

[125]  Zellig Harris.  The Interrogative in a Syntactic Framework , 1978 .

[126]  A. Eagly,et al.  Attitudes and opinions. , 1978, Annual review of psychology.

[127]  Timothy D. Wilson,et al.  Telling more than we can know: Verbal reports on mental processes. , 1977 .

[128]  I. Ajzen,et al.  Belief, Attitude, Intention, and Behavior: An Introduction to Theory and Research , 1977 .

[129]  Arne L. Kalleberg,et al.  Work Values and Job Rewards: A Theory of Job Satisfaction. , 1977 .

[130]  W. Saris,et al.  The use of magnitude estimation in large scale survey research , 1977 .

[131]  D. Cross,et al.  The calibration and cross-modal validation of ratio scales of political opinion in survey research , 1976 .

[132]  D. A. Kenny,et al.  An empirical application of confirmatory factor analysis to the multitrait-multimethod matrix , 1976 .

[133]  P. Hollowell.  Varieties of Work Experience , 1975 .

[134]  A. Kalleberg.  A causal approach to the measurement of job statisfaction , 1974 .

[135]  Robert L. Hamblin,et al.  Social Attitudes: Magnitude Measurement and Theory , 1974 .

[136]  M. Rokeach.  The Nature Of Human Values , 1974 .

[137]  Frans Stokman,et al.  Graven naar macht , 1973 .

[138]  J. P. Wanous,et al.  Measurement and meaning of job satisfaction. , 1972 .

[139]  G. Boynton.  The Individual in Society , 1972 .

[140]  T. Trabasso,et al.  Storage and verification stages in processing concepts. , 1971 .

[141]  R. J. Mokken,et al.  A Theory and Procedure of Scale Analysis: With Applications in Political Research , 1971 .

[142]  J. Fodor.  Psychology and Language. , 1970 .

[143]  David E. Wiley,et al.  The Estimation of Measurement Error in Panel Data , 1970 .

[144]  G. Albee.  White Racism: A Psychohistory. , 1970 .

[145]  David R. Heise,et al.  VALIDITY, INVALIDITY, AND RELIABILITY , 1970 .

[146]  P. Froggatt.  Questionnaire Design and Attitude Measurement , 1969 .

[147]  D. R. Heise.  Separating reliability and stability in test-retest correlation. , 1969 .

[148]  Frank Harary,et al.  Graph Theory , 2016 .

[149]  John P. Robinson,et al.  Measures of Occupational Attitudes and Occupational Characteristics , 1969 .

[150]  M. R. Novick,et al.  Statistical Theories of Mental Test Scores. , 1971 .

[151]  E. Poulton.  The new psychophysics: Six models for magnitude estimation. , 1968 .

[152]  D T Campbell,et al.  Methods Factors In Multitrait-Multimethod Matrices : Multiplicative Rather Than Additive? , 1967, Multivariate behavioral research.

[153]  H. Blalock.  Causal Inferences in Nonexperimental Research , 1966 .

[154]  Verling C. Troldahl,et al.  Random Selection of Respondents within Households in Phone Surveys , 1964 .

[155]  Donald E. Stokes,et al.  Spatial Models of Party Competition , 1963, American Political Science Review.

[156]  A. E. Maxwell,et al.  Factor Analysis as a Statistical Method. , 1964 .

[157]  C. Coombs.  A theory of data. , 1965, Psychological review.

[158]  Angus Campbell,et al.  The American voter , 1960 .

[159]  Robert Blauner.  Work satisfaction and industrial trends in modern society , 1960 .

[160]  Joseph L. Zinnes,et al.  Theory and Methods of Scaling. , 1958 .

[161]  G. A. Miller.  THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[162]  L. Cronbach.  Coefficient alpha and the internal structure of tests , 1951 .

[163]  F. S. C. Northrop,et al.  The logic of the sciences and the humanities , 1948 .

[164]  M. Sherif,et al.  The psychology of attitudes. , 1946, Psychological review.