A Brief Tutorial on the Development of Measures for Use in Survey Questionnaires

The adequate measurement of abstract constructs is perhaps the greatest challenge to understanding the behavior of people in organizations. Problems with the reliability and validity of measures used on survey questionnaires continue to lead to difficulties in interpreting the results of field research. Price and Mueller suggest that measurement problems may be due to the lack of a well-established framework to guide researchers through the various stages of scale development. This article provides a conceptual framework and a straightforward guide for the development of scales in accordance with established psychometric principles for use infield studies

[1]  J. Long.  Confirmatory Factor Analysis , 1983 .

[2]  D. Warwick,et al.  The sample survey: theory and practice , 1976 .

[3]  G. Bohrnstedt,et al.  Social Measurement: Current Issues , 1981 .

[4]  Frank J. Krzystofiak,et al.  Implicit personality and performance appraisal: The influence of trait inferences on evaluations of behavior. , 1988 .

[5]  H. Marsh,et al.  A new, more powerful approach to multitrait-multimethod analyses: Application of second-order confirmatory factor analysis. , 1988 .

[6]  Neal Schmitt,et al.  Factors Defined by Negatively Keyed Items: The Result of Careless Respondents? , 1985 .

[7]  Timothy R. Hinkin.  A Review of Scale Development Practices in the Study of Organizations , 1995 .

[8]  J. L. Price.  Handbook of Organizational Measurement , 1975 .

[9]  Wayne F. Cascio,et al.  Magnitude estimations of expressions of frequency and amount. , 1974 .

[10]  L. Hayduk.  Structural equation modeling with LISREL , 1987 .

[11]  James W. Thacker,et al.  The factor structure of Union Commitment: An application of confirmatory factor analysis. , 1989 .

[12]  J. M. Cortina,et al.  What Is Coefficient Alpha? An Examination of Theory and Applications , 1993 .

[13]  J. Tukey,et al.  Multiple-Factor Analysis , 1947 .

[14]  R. MacCallum,et al.  THE APPLICATION OF EXPLORATORY FACTOR ANALYSIS IN APPLIED PSYCHOLOGY: A CRITICAL REVIEW AND ANALYSIS , 1986 .

[15]  Kamalesh Kumar,et al.  Construction and validation of an instrument for measuring ingratiatory behaviors in organizational settings. , 1991 .

[16]  R. Cattell.  The Scree Test For The Number Of Factors. , 1966, Multivariate behavioral research.

[17]  Melenie J. Lankau,et al.  Improving Construct Measurement In Management Research: Comments and a Quantitative Approach for Assessing the Theoretical Content Adequacy of Paper-and-Pencil Survey-Type Instruments , 1993 .

[18]  John F. Veigal.  The Frequency of Self-Limiting Behavior in Groups: A Measure and an Explanation , 1991 .

[19]  R. Harvey,et al.  Confirmatory factor analysis of the Job Diagnostic Survey: Good news and bad news. , 1985 .

[20]  Chester A. Schriesheim,et al.  Development and application of new scales to measure the French and Raven (1959) bases of social power. , 1989 .

[21]  Scott B. MacKenzie,et al.  Organizational citizenship behavior and objective productivity as determinants of managerial evaluations of salespersons' performance , 1991 .

[22]  L. Cronbach,et al.  Construct validity in psychological tests. , 1955, Psychological bulletin.

[23]  R. Rummel.  Applied Factor Analysis , 1970 .

[24]  John P. Campbell,et al.  Measurement Theory for the Behavioral Sciences. , 1983 .

[25]  D. Marlowe,et al.  The Approval Motive: Studies in Evaluative Dependence , 1980 .

[26]  Eugene F. Stone.  Research methods in organizational behavior , 1978 .

[27]  J. L. Price,et al.  Handbook of Organizational Measurement , 1975 .

[28]  Richard J. Klimoski,et al.  Research methods in human resources management , 1991 .

[29]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[30]  Jae-on Kim,et al.  Introduction to Factor Analysis , 1978 .

[31]  Michael J. Kavanagh,et al.  Issues in managerial performance: Multitrait-multimethod analyses of ratings. , 1971 .

[32]  David A. Harrison,et al.  Cognitive processes in self-report responses: tests of item context effects in work attitude measures. , 1993, The Journal of applied psychology.

[33]  David A. Harrison,et al.  Cognitive processes in self-report responses: tests of item context effects in work attitude measures. , 1993, The Journal of applied psychology.

[34]  James C. Anderson,et al.  Predicting the performance of measures in a confirmatory factor analysis with a pretest assessment of their substantive validities. , 1991 .

[35]  Howard B. Lee,et al.  Foundations of Behavioral Research , 1965 .

[36]  Chester A. Schriesheim,et al.  Influence tactics used by subordinates: A theoretical and empirical analysis and refinement of the Kipnis, Schmidt, and Wilkinson subscales. , 1990 .

[37]  Richard P. Bagozzi,et al.  Assessing Construct Validity in Organizational Research , 1991 .

[38]  Timothy R. Hinkin.  Development and application of new social power measures in superior-subordinate relationships , 1985 .

[39]  G. V. Barrett.  RESEARCH MODELS OF THE FUTURE FOR INDUSTRIAL AND ORGANIZATIONAL PSYCHOLOGY , 1972 .

[40]  E. Carmines,et al.  Analyzing models with unobserved variables: analysis of covariance structures , 1981 .

[41]  David W. Gerbing,et al.  An Updated Paradigm for Scale Development Incorporating Unidimensionality and Its Assessment , 1988 .

[42]  J. Hoelter.  The Analysis of Covariance Structures , 1983 .

[43]  Gina J. Medsker,et al.  A Review of Current Practices for Evaluating Causal Models in Organizational Behavior and Human Resources Management Research , 1994 .

[44]  R. Sitgreaves.  Psychometric theory (2nd ed.). , 1979 .

[45]  R Likert,et al.  A TECHNIQUE FOR THE MEASUREMENT OF ATTITUDE SCALES , 1932 .

[46]  R. Lissitz,et al.  Effect of the number of scale points on reliability: A Monte Carlo approach. , 1975 .

[47]  Neal Schmitt,et al.  Methodology Review: Analysis of Multitrait-Multimethod Matrices , 1986 .

[48]  J. R. French,et al.  The bases of social power. , 1959 .

[49]  Jae-On Kim,et al.  Introduction to Factor Analysis: What It Is and How To Do It , 1978 .

[50]  Gilbert A. Churchill.  A Paradigm for Developing Better Measures of Marketing Constructs , 1979 .

[51]  Robert J. Vance,et al.  Construct Validity of Three Types of Organizational Citizenship behavior: An Illustration of the Direct Product Model with Refinements , 1993 .

[52]  Barbara M. Byrne,et al.  A Primer of LISREL , 1989 .

[53]  Edward G. Carmines,et al.  Reliability and Validity Assessment , 1979 .

[54]  Michael T. Brannick,et al.  Construction of a Job in General scale: A comparison of global, composite, and specific measures. , 1989 .

[55]  W. Velicer,et al.  Relation of sample size to the stability of component patterns. , 1988, Psychological bulletin.

[56]  Lois E. Tetrick,et al.  A Construct Validity Study of the Survey of Perceived Organizational Support , 1991 .

[57]  John K. Butler.  Toward Understanding and Measuring Conditions of Trust: Evolution of a Conditions of Trust Inventory , 1991 .

[58]  D. Kipnis,et al.  Intraorganizational Influence Tactics: Explorations in Getting One's Way , 1980 .

[59]  S. Grover,et al.  Predicting the perceived fairness of parental leave policies. , 1991 .

[60]  John R. Hollenbeck,et al.  Investigation of the construct validity of a self-report measure of goal commitment , 1989 .

[61]  Allen L. Edwards,et al.  Techniques Of Attitude Scale Construction , 1958 .