Social and Cognitive Sources of Potential Inaccuracy in Job Analysis

Although it appears that many assume job analysis information is accurate, there is considerable evidence from other fields to suggest that the types of subjective judgments often involved in job analysis may be subject to systematic sources of inaccuracy. Drawing from the social, cognitive, and industrial-organizational psychology literatures, this review develops a framework that delineates 16 potential sources of inaccuracy in job analysis. This includes such social sources as social influence and self-presentation processes as well as cognitive sources such as limited and biased information processing. For each source of inaccuracy, the relevant literature is first reviewed, its potential operation in the job analysis context is described, and propositions for future research are derived. In addition, the likelihood of these sources of inaccuracy across various job analysis facets are described, concluding with recommendations for research and practice. As a process of obtaining information about jobs (McCormick, 1979), job analysis is one of the most widely used organizational data collection techniques. It forms the foundation upon which virtually all other human resource management systems are built (Buffer & Harvey, 1988), including personnel selection, performance appraisal, training, career development, workforce planning, safety, and licensing requirements (Ash, 1988). Its use is mandated to meet legal requirements (Uniform Guidelines, i978), and estimated annual costs for job analyses

[1]  M. Quiñones,et al.  Task frequency rating accuracy : The effect of task engagement and experience , 1996 .

[2]  Paul E. Spector Using self‐report questionnaires in OB research: A comment on the use of a controversial method , 1994 .

[3]  Juan I. Sanchez,et al.  The impact of raters' cognition on judgment accuracy: An extension to the job analysis domain , 1994 .

[4]  M. A. Campion,et al.  The Knowledge, Skill, and Ability Requirements for Teamwork: Implications for Human Resource Management , 1994 .

[5]  Jatinder N. D. Gupta,et al.  The Impact of Decision-Making Methodology on Job Evaluation Outcomes , 1994 .

[6]  Ronald J. Deluga,et al.  The Role of Subordinate Performance and Ingratiation in Leader-Member Exchanges , 1994 .

[7]  Carol T. Kulik,et al.  Heuristic Processing in Organizational Judgments , 1994 .

[8]  Gina J. Medsker,et al.  RELATIONS BETWEEN WORK GROUP CHARACTERISTICS AND EFFECTIVENESS: IMPLICATIONS FOR DESIGNING EFFECTIVE WORK GROUPS , 1993 .

[9]  Byron Anderson,et al.  Dictionary of Occupational Titles , 1993 .

[10]  Carol T. Kulik,et al.  Category‐Based and Feature‐Based Cognitive Processes in Job Impressions , 1993 .

[11]  Nathan Bennett,et al.  Employee Propensity to Withhold Effort: A Conceptual Model to Intersect Three Avenues of Research , 1993 .

[12]  M. A. Campion,et al.  Follow-up and extension of the interdisciplinary costs and benefits of enlarged jobs. , 1993 .

[13]  Steve Williams,et al.  Unanimous versus Majority Influences on Group Polarization in Business Decision Making , 1993 .

[14]  D. R. Ilgen,et al.  Performance Appraisal Process Research in the 1980s: What Has It Contributed to Appraisals in Use? , 1993 .

[15]  Kevin R. Murphy,et al.  Nature and Consequences of Halo Error : A Critical Analysis , 1993 .

[16]  John Cordery,et al.  Responses to the original and revised Job Diagnostic Survey: Is education a factor in responses to negatively worded items? , 1993 .

[17]  Robert W. Rutledge,et al.  The effects of group decisions and group-shifts on use of the anchoring and adjustment heuristic , 1993 .

[18]  R. Hastie,et al.  The common knowledge effect: Information sharing and group judgment. , 1993 .

[19]  J. Shepperd Productivity loss in performance groups: A motivation analysis. , 1993 .

[20]  K. Murphy Personnel Selection in Organizations , 1992 .

[21]  G. Stasser,et al.  Discovery of hidden profiles by decision-making groups: Solving a problem versus making a judgment. , 1992 .

[22]  Kevin R. Murphy,et al.  Is halo error a property of the rater, ratees, or the specific behaviors observed? , 1992 .

[23]  Juan I. Sanchez,et al.  On the choice of scales for task analysis , 1992 .

[24]  S. Kozlowski,et al.  A disagreement about within-group agreement: Disentangling issues of consistency versus consensus. , 1992 .

[25]  J. George Extrinsic and Intrinsic Origins of Perceived Social Loafing in Organizations , 1992 .

[26]  B. B. Gaugler,et al.  THE INFLUENCE OF ASSESSEE PERFORMANCE VARIATION ON ASSESSORS’JUDGMENTS , 1992 .

[27]  札幌学院大学社会情報学部,et al.  社会情報 = Social information , 1992 .

[28]  J. Hackman Group influences on individuals in organizations. , 1992 .

[29]  Eric J. Johnson,et al.  Behavioral decision research: A constructive processing perspective. , 1992 .

[30]  Paul E. Spector A Consideration of the Validity and Meaning of Self-Report Measures of Job Conditions , 1992 .

[31]  Carmen A. Estes,et al.  A Strategy for Examining the Validity of Job Analysis Data , 1991 .

[32]  Michael A. Campion,et al.  Development and Test of a Task Level Model of Motivational Job Design , 1991 .

[33]  Janet A. Sniezek,et al.  Judgment processes in motivation: Anchoring and adjustment effects on judgment and behavior. , 1991 .

[34]  S. Green,et al.  Racial Differences on Job Analysis Questionnaires: An Empirical Study , 1991 .

[35]  M. A. Campion,et al.  Interdisciplinary Examination of the Costs and Benefits of Enlarged Jobs: A Job Design Quasi-Experiment , 1991 .

[36]  Frank J. Landy,et al.  Job analysis: The composition of SME samples. , 1991 .

[37]  K. M. Kacmar,et al.  The effects of impression management on the performance appraisal process , 1991 .

[38]  J. Yoder,et al.  Pygmalion in Management: Productivity as a Self-Fulfilling Prophecy , 1991 .

[39]  Daniel R. Ilgen,et al.  The structure of work: Job design and roles. , 1991 .

[40]  Walter C. Borman,et al.  Job behavior, performance, and effectiveness. , 1991 .

[41]  M. Ronald Buckley,et al.  Measurement Errors in the Behavioral Sciences: The Case of Personality/Attitude Research , 1990 .

[42]  Michael A. Campion,et al.  CONCEPTUAL INTEGRATION AND EMPIRICAL TEST OF JOB DESIGN AND COMPENSATION RELATIONSHIPS , 1990 .

[43]  S. Green,et al.  Evaluation of an index to detect inaccurate respondents to a task analysis inventory , 1990 .

[44]  Jeffrey S. Hornsby,et al.  The effects of job description content on job evaluation judgments , 1990 .

[45]  Mark A. Wilson,et al.  Repeating items to estimate the test-retest reliability of task inventory ratings. , 1990 .

[46]  Patricia M. Fandt,et al.  The management of information and impressions: When employees behave opportunistically , 1990 .

[47]  L. Friedman Degree of redundancy between time, importance, and frequency task ratings , 1990 .

[48]  D. Ilgen,et al.  The Effects of Ratee Prototypicality on Rater Observation and Accuracy1 , 1989 .

[49]  William K. Balzer,et al.  Rater errors and rating accuracy. , 1989 .

[50]  George C. Thornton,et al.  Number of assessment center dimensions as a determinant of assessor accuracy. , 1989 .

[51]  Edward L. Levine,et al.  Determining important tasks within jobs: A policy-capturing approach. , 1989 .

[52]  Carol T. Kulik The Effects of Job Categorization on Judgments of the Motivating Potential of Jobs. , 1989 .

[53]  Jeffrey S. Hornsby,et al.  What is in a name: The impact of job titles on job evaluation results , 1989 .

[54]  N. Schmitt,et al.  Internal analyses of task ratings by job incumbents. , 1989 .

[55]  Rebecca A. Henry,et al.  Accuracy and confidence in group judgment , 1989 .

[56]  C. L. Weber,et al.  Effects of market survey rates, job evaluation, and job gender on job pay , 1989 .

[57]  Robert G. Lord,et al.  Cognitive processes in industrial and organizational psychology. , 1989 .

[58]  Robert J. Harvey,et al.  A comparison of holistic versus decomposed rating of Position Analysis Questionnaire work dimensions. , 1988 .

[59]  T. Naughton Effect of Female-Linked Job Titles on Job Evaluation Ratings , 1988 .

[60]  Wayman C. Mullins,et al.  Group composition as a determinant of job analysis outcomes. , 1988 .

[61]  Edwin T. Cornelius,et al.  Dimensionality of the Job Element Inventory, a simplified worker-oriented job analysis questionnaire. , 1988 .

[62]  E. Levine,et al.  Exemplary job analysis systems in selected organizations: A description of process and outcomes , 1988 .

[63]  Michael A. Campion,et al.  Interdisciplinary Approaches to Job Design: A Constructive Replication With Extensions , 1988 .

[64]  E. Levine,et al.  Delay and distortion: Tacit influences on performance appraisal effectiveness. , 1988 .

[65]  Richard R. Reilly,et al.  Effect of prior performance information on ratings of present performance: Contrast versus assimilation revisited. , 1988 .

[66]  Robert J. Harvey,et al.  Influence of amount of job descriptive information on job analysis rating accuracy. , 1988 .

[67]  Jack M. Feldman,et al.  Self-generated validity and other effects of measurement on belief, attitude, intention, and behavior. , 1988 .

[68]  P. Benson,et al.  The Politics of Pay , 1988 .

[69]  Mark J. Martinko,et al.  Impression Management in Organizations , 1988 .

[70]  R. Tourangeau,et al.  Cognitive Processes Underlying Context Effects in Attitude Measurement , 1988 .

[71]  John Schaubroeck,et al.  A meta-analysis of self-supervisor, self-peer, and peer-supervisor ratings. , 1988 .

[72]  Sidney Gael The Job analysis handbook for business, industry, and government , 1988 .

[73]  Robert L. Dipboye,et al.  Effects of training and information on the accuracy and reliability of job evaluations. , 1988 .

[74]  Michael A. Campion,et al.  Ability requirement implications ofjob design: An interdisciplinary perspective , 1989 .

[75]  Ricky W. Griffin,et al.  Objective and Social Factors as Determinants of Task Perceptions and Responses: An Integrated Perspective and Empirical Investigation , 1987 .

[76]  Charles E. Miller,et al.  Group decision making and normative versus informational influence: Effects of type of issue and assigned decision rule. , 1987 .

[77]  Paul E. Spector Method variance as an artifact in self-reported affect and perceptions at work: Myth or significant problem? , 1987 .

[78]  Paul R. Sackett,et al.  Effects of using high- versus low-performing job incumbents as sources of job-analysis information. , 1987 .

[79]  John G. Veres,et al.  A Practical Rationale for Using Multi-Method Job Analyses , 1987 .

[80]  Y. Fried,et al.  THE VALIDITY OF THE JOB CHARACTERISTICS MODEL: A REVIEW AND META‐ANALYSIS , 1987 .

[81]  A. Denisi,et al.  Further investigation of common knowledge effects on job analysis ratings. , 1987 .

[82]  D. Paulhus,et al.  Socially Desirable Responding in Organizational Behavior: A Reconception , 1987 .

[83]  M. Mount,et al.  INVESTIGATION OF BIAS IN JOB EVALUATION RATINGS OF COMPARABLE WORTH STUDY PARTICIPANTS , 1987 .

[84]  Robert J. Harvey,et al.  CAN RATERS WITH REDUCED JOB DESCRIPTIVE INFORMATION PROVIDE ACCURATE POSITION ANALYSIS QUESTIONNAIRE (PAQ) RATINGS , 1986 .

[85]  William H. Glick,et al.  Method Versus Substance: How Strong are Underlying Relationships Between Job Characteristics and Attitudinal Outcomes? , 1986 .

[86]  Thomas M. Stutzman,et al.  AN EVALUATION OF METHODS TO SELECT RESPONDENTS TO STRUCTURED JOB‐ANALYSIS QUESTIONNAIRES , 1986 .

[87]  Gerald R. Ferris,et al.  The Dimensionality of Job Characteristics. Some Neglected Issues , 1986 .

[88]  P. Kline Models of man , 1986, Nature.

[89]  Robert J. Harvey,et al.  QUANTITATIVE APPROACHES TO JOB CLASSIFICATION: A REVIEW AND CRITIQUE , 1986 .

[90]  Donald P. Schwab,et al.  Assessment of a consensus-based multiple information source job evaluation system. , 1986 .

[91]  William K. Balzer,et al.  Systematic distortions in memory-based behavior ratings and performance evaluations: Consequences for rating accuracy. , 1986 .

[92]  Michael P. Kirsch,et al.  Job Knowledge, Ratee Familiarity, Conceptual Similarity, and Halo Error: An Exploration. , 1986 .

[93]  C. Cooper,et al.  International review of industrial and organizational psychology , 1986 .

[94]  H. J. Arnold,et al.  The Role of Social-Desirability Response Bias in Turnover Research , 1985 .

[95]  Neal Schmitt,et al.  Factors Defined by Negatively Keyed Items: The Result of Careless Respondents? , 1985 .

[96]  E. Weldon,et al.  Cognitive effort in additive task groups: The effects of shared responsibility on the quality of multiattribute judgments , 1985 .

[97]  R. Arvey,et al.  Reliability artifacts in comparable worth procedures. , 1985 .

[98]  R. Grams,et al.  Sex-Related Errors in Job Evaluation: A "Real-World" Test , 1985 .

[99]  R. Grams,et al.  An Investigation of Systematic Gender-Related Error in Job Evaluation , 1985 .

[100]  Kevin R. Murphy,et al.  Toward Narrowing the Research-Practice Gap in Performance Appraisal. , 1985 .

[101]  Hal G. Gueutal,et al.  An Empirical Derivation of the Dimensions Along Which Characteristics of Jobs are Perceived , 1985 .

[102]  G. Stasser,et al.  Pooling of Unshared Information in Group Decision Making: Biased Information Sampling During Discussion , 1985 .

[103]  T. Mitchell An Evaluation of the Validity of Correlational Research Conducted in Organizations , 1985 .

[104]  Robert Albanese,et al.  Rational Behavior in Groups: The Free-Riding Tendency , 1985 .

[105]  Seymour Adler,et al.  Job characteristics and job satisfaction: When cause becomes consequence , 1985 .

[106]  R. Madigan Comparable worth judgments: A measurement properties analysis. , 1985 .

[107]  R. L. Dipboye Some Neglected Variables in Research on Discrimination in Appraisals , 1985 .

[108]  P. Tetlock Accountability: The neglected social context of judgment and choice. , 1985 .

[109]  J. L. Warner,et al.  Inflation bias in self-assessment examinations: Implications for valid employee selection. , 1984 .

[110]  Gareth R. Jones Task Visibility, Free Riding, and Shirking: Explaining the Effect of Structure and Technology on Employee Behavior , 1984 .

[111]  S. Silverman,et al.  The Effects of Age and Job Experience on Employee Responses to a Structured Job Analysis Questionnaire , 1984 .

[112]  Angelo S. DeNisi,et al.  EXPERT AND NAIVE RATERS USING THE PAQ: DOES IT MATTER? , 1984 .

[113]  J. G. Adair,et al.  The Hawthorne effect: A reconsideration of the methodological artifact. , 1984 .

[114]  H. John Bernardin,et al.  Performance appraisal : assessing human behavior at work , 1984 .

[115]  N. Kerr Motivation losses in small groups: a social dilemma analysis , 1983 .

[116]  Ricky W. Griffin,et al.  The Social Information Processing Model of Task Design: A Review of the Literature , 1983 .

[117]  Thomas M. Stutzman Within Classification Job Differences. , 1983 .

[118]  Ronald A. Ash,et al.  Evaluation Of Job Analysis Methods By Experienced Job Analysts , 1983 .

[119]  Ricky W. Griffin,et al.  Objective and social sources of information in task redesign: A field experiment. , 1983 .

[120]  J. Algera "Objective" and perceived task characteristics as a determinant of reactions by task performers. , 1983 .

[121]  Paul E. Spector,et al.  A note on item order as an artifact in organizational surveys , 1983 .

[122]  N. Kerr,et al.  Dispensability of member effort and group motivation losses: Free-rider effects , 1983 .

[123]  Jack M. Feldman,et al.  Performance appraisal: A process focus. , 1983 .

[124]  John P. Campbell,et al.  Editorial: Some Remarks From the Outgoing Editor. , 1982 .

[125]  Allan P. Jones,et al.  Narrative Job Descriptions as Potential Sources of Job Analysis Ratings. , 1982 .

[126]  Gregory A. Davis,et al.  Potential Sources of Bias in Job Analytic Processes1 , 1982 .

[127]  James S. Phillips,et al.  Schematic information processing and perceptions of leadership in problem-solving groups. , 1982 .

[128]  D. Caldwell,et al.  Task perceptions and job satisfaction: A question of causality. , 1982 .

[129]  Stephen G. West,et al.  Validity of self-evaluation of ability: A review and meta-analysis , 1982 .

[130]  G. W. Hill Group versus individual performance: are n + 1 heads better than one?" psychological bulletin , 1982 .

[131]  G. A. Miller,et al.  Book Review Nisbett, R. , & Ross, L.Human inference: Strategies and shortcomings of social judgment.Englewood Cliffs, N.J.: Prentice-Hall, 1980. , 1982 .

[132]  Mark A. Wilson,et al.  Factors affecting the consensus judgment process in managerial assessment centers. , 1982 .

[133]  H. J. Arnold,et al.  Social desirability response bias in self-report choice situations. , 1981 .

[134]  D. Treiman,et al.  The Dictionary of Occupational Titles as a Source of Occupational Data. , 1981 .

[135]  Jack M. Feldman,et al.  Beyond Attribution Theory: Cognitive Processes in Performance Appraisal , 1981 .

[136]  H. John Bernardin,et al.  Strategies in Rater Training , 1981 .

[137]  J. Tedeschi Impression Management Theory and Social Psychological Research , 1981 .

[138]  William H. Glick,et al.  The job characteristics approach to task design: A critical review. , 1981 .

[139]  K. Williams,et al.  Identifiability as a deterrant to social loafing: Two cheering experiments. , 1981 .

[140]  Monte M. Page,et al.  4 – Demand Compliance in Laboratory Experiments , 1981 .

[141]  T. K. Srull,et al.  Category accessibility: Some theoretical and empirical issues concerning the processing of social stimulus information , 1981 .

[142]  L. Ross,et al.  Human Inference: Strategies and Shortcomings of Social Judgment. , 1981 .

[143]  B. R. Schlenker Impression Management: The Self-Concept, Social Identity, and Interpersonal Relations , 1980 .

[144]  Donal E. Carlston,et al.  A closer examination of subject roles. , 1980 .

[145]  Edwin T. Cornelius,et al.  A comparison of holistic and decomposed judgment strategies in job analyses by job incumbents. , 1980 .

[146]  H. John Bernardin,et al.  Effects of rater training: Creating new response sets and decreasing accuracy. , 1980 .

[147]  Robert S. Wyer,et al.  The processing of social stimulus information: A conceptual integration , 1980 .

[148]  R. Hastie Person memory : the cognitive basis of social perception , 1980 .

[149]  Milton D. Hakel,et al.  CONVERGENCE AMONG DATA SOURCES, RESPONSE BIAS, AND RELIABILITY AND VALIDITY OF A STRUCTURED JOB ANALYSIS QUESTIONNAIRE , 1979 .

[150]  E. Rosch,et al.  Cognition and Categorization , 1980 .

[151]  J. B. Shaw,et al.  Social influences on judgments about tasks , 1979 .

[152]  E. J. Mccormick,et al.  Job Analysis: Methods and Applications , 1979 .

[153]  Charles A. O'Reilly,et al.  Informational influence as a determinant of perceived task characteristics and job satisfaction. , 1979 .

[154]  B Walton,et al.  Job and Task Analysis. , 1979 .

[155]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[156]  T. Mitchell,et al.  Job Enrichment Versus Social Cues: A Comparison and Competitive Test , 1979 .

[157]  K. Williams,et al.  Many Hands Make Light the Work: The Causes and Consequences of Social Loafing , 1979 .

[158]  G. Leopold The Federal Register. , 1979, Journal of clinical ultrasound : JCU.

[159]  Kenneth N. Wexley,et al.  An examination of differences between managerial effectiveness and response patterns on a structured job analysis questionnaire. , 1978 .

[160]  J. Pfeffer,et al.  A social information processing approach to job attitudes and task design. , 1978, Administrative science quarterly.

[161]  Eleanor Rosch,et al.  Principles of Categorization , 1978 .

[162]  W C Borman,et al.  Consistency of rating accuracy and rating errors in the judgment of human performance. , 1977, Organizational behavior and human performance.

[163]  J. Pfeffer,et al.  An examination of need-satisfaction models of job attitudes. , 1977 .

[164]  E. Prien,et al.  The function of job analysis in content validation. , 1977 .

[165]  N. Schmitt Interrater agreement in dimensionality and combination of assessment center judgments. , 1977 .

[166]  W. Mischel,et al.  Traits as prototypes: Effects on recognition memory. , 1977 .

[167]  John W. Lounsbury,et al.  Job analysis results as influenced by sex of incumbent and sex of analyst. , 1977 .

[168]  Walter Schneider,et al.  Controlled and Automatic Human Information Processing: 1. Detection, Search, and Attention. , 1977 .

[169]  D. Myers,et al.  The group polarization phenomenon. , 1976 .

[170]  D. Kipnis,et al.  Untangling the performance appraisal dilemma: The influence of perceived organizational context on evaluative processes. , 1976 .

[171]  N. Schmitt Social and Situational Determinants of Interview Decisions: Implications for the Employment Interview. , 1976 .

[172]  R. Kilmann,et al.  The Social Desirability Variable in Organizational Research: An Alternative Explanation for Reported Findings , 1975 .

[173]  Gary P. Latham,et al.  Training managers to minimize rating errors in the observation of behavior. , 1975 .

[174]  Walter C. Borman,et al.  Effects of instructions to avoid halo error on reliability and validity of performance evaluation ratings. , 1975 .

[175]  Barry M. Staw,et al.  Attribution of the "causes" of performance: A general alternative interpretation of cross-sectional research on organizations. , 1975 .

[176]  William J. Haga,et al.  A vertical dyad linkage approach to leadership within formal organizations: A longitudinal investigation of the role making process , 1975 .

[177]  Ronald A. Ash,et al.  A note on the readability on the Position Analysis Questionnaire (PAQ). , 1975 .

[178]  J. Hackman,et al.  Development of the Job Diagnostic Survey , 1975 .

[179]  M. Snyder Self-monitoring of expressive behavior. , 1974 .

[180]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[181]  Albert S. King,et al.  Expectation Effects in Organizational Change. , 1974 .

[182]  E. Ramsden Group Process and Productivity , 1973 .

[183]  K. N. Wexley,et al.  Training interviewers to eliminate contrast effects in employment interviews. , 1973 .

[184]  J. Farr Response requirements and primacy-recency effects in a simulated selection interview. , 1973 .

[185]  Robert C. Mecham,et al.  A study of job characteristics and job dimensions as based on the Position Analysis Questionnaire (PAQ). , 1972 .

[186]  Thomas D. Cook,et al.  Subject effects in laboratory research: An examination of subject roles, demand characteristics, and valid inference. , 1972 .

[187]  Raymond E. Sanders,et al.  Importance of Contrast Effects in Employment Interviews. , 1972 .

[188]  C. C. Leek,et al.  Job Analysis , 1970 .

[189]  R. Carlson Effect of applicant sample on ratings of valid information in an employment setting. , 1970 .

[190]  S. Moscovici,et al.  The group as a polarizer of attitudes. , 1969 .

[191]  Louis C. Midgley,et al.  The Logic of Collective Action: Public Goods and the Theory of Groups , 1969 .

[192]  K. Weick The social psychology of organizing , 1969 .

[193]  R. Rosenthal,et al.  Artifact in behavioral research , 1969 .

[194]  C. Argyris,et al.  Some unintended consequences of rigorous research. , 1968, Psychological bulletin.

[195]  John P. Campbell,et al.  Individual versus group problem solving in an industrial sample. , 1968, The Journal of applied psychology.

[196]  W. Bennis,et al.  The Social Psychology of Organizations , 1966 .

[197]  M. Olson,et al.  The Logic of Collective Action: Public Goods and the Theory of Groups , 1969 .

[198]  L. Wiley,et al.  Method for measuring bias in raters who estimate job qualifications. , 1963 .

[199]  M. Orne On the social psychology of the psychological experiment: With particular reference to demand characteristics and their implications. , 1962 .

[200]  J. Madden The effect of varying the degree of rater familiarity in job evaluation. , 1962 .

[201]  D. Marlowe,et al.  Social desirability and response to perceived situational demands. , 1961, Journal of consulting psychology.

[202]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[203]  H. Simon,et al.  Models of Man. , 1957 .

[204]  B. Bass Reducing Leniency in Merit Ratings , 1956 .

[205]  S. Asch Opinions and Social Pressure , 1955, Nature.

[206]  M. Deutsch,et al.  A study of normative and informational social influences upon individual judgement. , 1955, Journal of abnormal psychology.

[207]  H. Guetzkow,et al.  Groups, Leadership, and Men , 1952 .

[208]  S. Asch Effects of Group Pressure Upon the Modification and Distortion of Judgments , 1951 .

[209]  E. Mayo The Human Problems of an Industrial Civilization , 1934, Nature.

[210]  E. Thorndike A constant error in psychological ratings. , 1920 .