A Brief Tutorial on the Development of Measures for Use in Survey Questionnaires

The adequate measurement of abstract constructs is perhaps the greatest challenge to understanding the behavior of people in organizations. Problems with the reliability and validity of measures used on survey questionnaires continue to lead to difficulties in interpreting the results of field research. Price and Mueller suggest that measurement problems may be due to the lack of a well-established framework to guide researchers through the various stages of scale development. This article provides a conceptual framework and a straightforward guide for the development of scales in accordance with established psychometric principles for use in field studies.

[1]  Neal Schmitt,et al.  Methodology Review: Analysis of Multitrait-Multimethod Matrices , 1986 .

[2]  Jae-On Kim,et al.  Introduction to Factor Analysis: What It Is and How To Do It , 1978 .

[3]  R. Cattell.  The Scree Test For The Number Of Factors. , 1966, Multivariate behavioral research.

[4]  James C. Anderson,et al.  Predicting the performance of measures in a confirmatory factor analysis with a pretest assessment of their substantive validities. , 1991 .

[5]  R. Harvey,et al.  Confirmatory factor analysis of the Job Diagnostic Survey: Good news and bad news. , 1985 .

[6]  Richard P. Bagozzi,et al.  Assessing Construct Validity in Organizational Research , 1991 .

[7]  E. Carmines,et al.  Analyzing models with unobserved variables: analysis of covariance structures , 1981 .

[8]  E. Prien,et al.  The Experience of Work. , 1985 .

[9]  David W. Gerbing,et al.  An Updated Paradigm for Scale Development Incorporating Unidimensionality and Its Assessment , 1988 .

[10]  Gina J. Medsker,et al.  A Review of Current Practices for Evaluating Causal Models in Organizational Behavior and Human Resources Management Research , 1994 .

[11]  Michael T. Brannick,et al.  Construction of a Job in General scale: A comparison of global, composite, and specific measures. , 1989 .

[12]  David A. Harrison,et al.  EXPLORING THE COGNITIVE PROCESSES UNDERLYING RESPONSES TO SELF-REPORT INSTRUMENTS: EFFECTS OF ITEM CONTEXT ON WORK ATTITUDE MEASURES. , 1991 .

[13]  Kamalesh Kumar,et al.  Construction and validation of an instrument for measuring ingratiatory behaviors in organizational settings. , 1991 .

[14]  R. C. Durfee,et al.  MULTIPLE FACTOR ANALYSIS. , 1967 .

[15]  Neal Schmitt,et al.  Factors Defined by Negatively Keyed Items: The Result of Careless Respondents? , 1985 .

[16]  Gilbert A. Churchill.  A Paradigm for Developing Better Measures of Marketing Constructs , 1979 .

[17]  D A Harrison,et al.  Cognitive processes in self-report responses: tests of item context effects in work attitude measures. , 1993, The Journal of applied psychology.

[18]  D. Kipnis,et al.  Intraorganizational Influence Tactics: Explorations in Getting One's Way , 1980 .

[19]  Scott B. MacKenzie,et al.  Organizational citizenship behavior and objective productivity as determinants of managerial evaluations of salespersons' performance , 1991 .

[20]  Chester A. Schriesheim,et al.  Influence tactics used by subordinates: A theoretical and empirical analysis and refinement of the Kipnis, Schmidt, and Wilkinson subscales. , 1990 .

[21]  S. Grover,et al.  Predicting the perceived fairness of parental leave policies. , 1991 .

[22]  James W. Thacker,et al.  The factor structure of Union Commitment: An application of confirmatory factor analysis. , 1989 .

[23]  R Likert,et al.  A TECHNIQUE FOR THE MEASUREMENT OF ATTITUDE SCALES , 1932 .

[24]  R. Rummel.  Applied Factor Analysis , 1970 .

[25]  Lois E. Tetrick,et al.  A Construct Validity Study of the Survey of Perceived Organizational Support , 1991 .

[26]  R. MacCallum,et al.  THE APPLICATION OF EXPLORATORY FACTOR ANALYSIS IN APPLIED PSYCHOLOGY: A CRITICAL REVIEW AND ANALYSIS , 1986 .

[27]  J. M. Cortina,et al.  What Is Coefficient Alpha? An Examination of Theory and Applications , 1993 .

[28]  Richard J. Klimoski,et al.  Research methods in human resources management , 1991 .

[29]  John R. Hollenbeck,et al.  Investigation of the construct validity of a self-report measure of goal commitment , 1989 .

[30]  John F. Veigal.  The Frequency of Self-Limiting Behavior in Groups: A Measure and an Explanation , 1991 .

[31]  L. Hayduk.  Structural equation modeling with LISREL , 1987 .

[32]  W. W. Daniel.  The Sample Survey: Theory and Practice , 1976 .

[33]  Chester A. Schriesheim,et al.  Development and application of new scales to measure the French and Raven (1959) bases of social power. , 1989 .

[34]  C. Coogler,et al.  Foundations of Behavioral Research 2nd ed , 1974 .

[35]  Rosedith Sitgreaves Bowker.  Measurement Theory for the Behavioral Sciences , 1983 .

[36]  R. Lissitz,et al.  Effect of the number of scale points on reliability: A Monte Carlo approach. , 1975 .

[37]  R. Sitgreaves.  Psychometric theory (2nd ed.). , 1979 .

[38]  Timothy R. Hinkin.  A Brief Tutorial on the Development of Measures for Use in Survey Questionnaires , 1998 .

[39]  Edward G. Carmines,et al.  Reliability and Validity Assessment , 1979 .

[40]  Michael J. Kavanagh,et al.  Issues in managerial performance: Multitrait-multimethod analyses of ratings. , 1971 .

[41]  Karl G. Jöreskog,et al.  LISREL 7: A guide to the program and applications , 1988 .

[42]  Robert J. Vance,et al.  Construct Validity of Three Types of Organizational Citizenship behavior: An Illustration of the Direct Product Model with Refinements , 1993 .

[43]  Wayne F. Cascio,et al.  Magnitude estimations of expressions of frequency and amount. , 1974 .

[44]  W. Velicer,et al.  Relation of sample size to the stability of component patterns. , 1988, Psychological bulletin.

[45]  L. Cronbach,et al.  Construct validity in psychological tests. , 1955, Psychological bulletin.

[46]  Rick H. Hoyle,et al.  Confirmatory Factor Analysis , 1983 .

[47]  John K. Butler.  Toward Understanding and Measuring Conditions of Trust: Evolution of a Conditions of Trust Inventory , 1991 .

[48]  D. Marlowe,et al.  The Approval Motive: Studies in Evaluative Dependence , 1980 .

[49]  Melenie J. Lankau,et al.  Improving Construct Measurement In Management Research: Comments and a Quantitative Approach for Assessing the Theoretical Content Adequacy of Paper-and-Pencil Survey-Type Instruments , 1993 .

[50]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[51]  Frank J. Krzystofiak,et al.  Implicit personality and performance appraisal: The influence of trait inferences on evaluations of behavior. , 1988 .

[52]  Barbara M. Byrne,et al.  A Primer of LISREL , 1989 .