The impact of performance cues on leader-behavior ratings: the role of selective information availability and probabilistic response bias

Abstract Previous research has demonstrated that performance cues can significantly influence raters' responses on leader-behavior rating questionnaires. The purpose of the present study was to explore the cognitive mechanisms that mediate this influence. Subjects watched a videotape of a problem-solving group and later rated the group leader's behavior. Perceptions of the group's performance were manipulated both before (preobservation) and after (postobservation) subjects watched the tape. Both manipulations affected the leader-behavior ratings. Analytic procedures borrowed from signal detection theory suggest that the preobservation performances cue effects were mediated by selective encoding of leader-behavior information in memory, while the postobservation effects were mediated by probabilistic response biases. Selective memory retrieval, on the other hand, did not seem to play a role. The implications of these results for developing strategies to overcome the confounding influence of performance cues on leader-behavior ratings are discussed.

[1]  John T. E. Richardson,et al.  Nonparametric indexes of sensitivity and response bias. , 1972 .

[2]  Kevin R. Murphy,et al.  Difficulties in the statistical control of halo. , 1982 .

[3]  David G. Bowers,et al.  Predicting Organizational Effectiveness with a Four-Factor Theory of Leadership , 1966 .

[4]  C. Hulin.  Some reflections on general performance dimensions and halo rating error. , 1982 .

[5]  Jack M. Feldman,et al.  Beyond Attribution Theory: Cognitive Processes in Performance Appraisal , 1981 .

[6]  James P. Egan,et al.  Recognition memory and the operating characteristic. , 1958 .

[7]  Frank J. Landy,et al.  Statistical control of halo error in performance ratings. , 1980 .

[8]  Donald A. Norman,et al.  An efficient non-parametric analysis of recognition memory , 1964 .

[9]  J. S. Phillips,et al.  Causal attributions and perceptions of leadership , 1981 .

[10]  Endel Tulving,et al.  Encoding specificity and retrieval processes in episodic memory. , 1973 .

[11]  A. Upmeyer.  Perceptual And Judgmental Processes In Social Contexts1 , 1981 .

[12]  Lynn Hasher,et al.  Reconstructive and reproductive processes in memory. , 1978 .

[13]  J. Swets.  The Relative Operating Characteristic in Psychology , 1973, Science.

[14]  William P. Banks,et al.  Signal detection theory and human memory. , 1970 .

[15]  Robert G. Lord,et al.  The effect of performance cues and leader behavior on questionnaire ratings of leadership behavior , 1978 .

[16]  J. S. Phillips,et al.  Effects of a temporal delay in rating on leader behavior descriptions: A laboratory investigation. , 1981 .

[17]  Darren Newtson,et al.  Selective perception of events. , 1979 .

[18]  R. Lord,et al.  Implicit leadership theory: A potential threat to the internal validity of leader behavior questionnaires , 1977 .

[19]  R H Price,et al.  Signal-detection methods in personality and perception. , 1966, Psychological bulletin.

[20]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[21]  J. M. Grossberg,et al.  Clinical psychophysics: applications of ratio scaling and signal detection methods to research on pain, fear, drugs, and medical decision making. , 1978, Psychological bulletin.

[22]  G. Powell,et al.  Effect of group performance, leader sex, and rater sex on ratings of leader behavior. , 1981 .

[23]  S. Fulero,et al.  Recall for confirming events: Memory processes and the maintenance of social stereotypes ☆ , 1979 .

[24]  D. A. Kenny,et al.  Statistical approaches to the correction of correlational bias , 1980 .

[25]  W. Martin,et al.  Signal Detection Theory , 1981 .

[26]  John H. Lingle.  Thematic Effects of Person Judgments on Impression Organization. , 1979 .

[27]  James S. Phillips,et al.  Schematic information processing and perceptions of leadership in problem-solving groups. , 1982 .

[28]  R. E. Pastore,et al.  SIGNAL DETECTION THEORY: CONSIDERATIONS FOR GENERAL APPLICATION , 1974 .

[29]  Robert L. Holzbach,et al.  Rater bias in performance ratings: Superior, self-, and peer ratings. , 1978 .

[30]  Laura L. Beauvais,et al.  A critical analysis of format-induced versus subject-imposed bias in leadership ratings. , 1981 .

[31]  E. Loftus,et al.  Reconstruction of automobile destruction: An example of the interaction between language and memory , 1974 .

[32]  J. R. Larson,et al.  Leader behavior, situational moderators, and group performance: An attributional analysis. , 1977 .

[33]  J. Grier,et al.  Nonparametric indexes for sensitivity and bias: computing formulas. , 1971, Psychological bulletin.

[34]  Gordon H. Bower,et al.  Person stereotypes and memory for people. , 1981 .

[35]  J. R. Larson.  Cognitive mechanisms mediating the impact of implicit theories of leader behavior on leader behavior ratings , 1982 .

[36]  Fred Luthans,et al.  7 – Toward an Observation System for Measuring Leader Behavior in Natural Settings* , 1984 .

[37]  R. Harvey.  The future of partial correlation as a means to reduce halo in performance ratings. , 1982 .

[38]  Don McNicol,et al.  A Primer of Signal Detection Theory , 1976 .

[39]  Jr. James R. Larson.  The Limited Utility of Factor Analytic Techniques for the Study of Implicit Theories in Student Ratings of Teacher Behavior , 1979 .

[40]  J. Hartwick.  Memory for trait information: A signal detection analysis ☆ , 1979 .

[41]  Ralph M. Stogdill,et al.  Manual for the leader behavior description questionnaire - Form XII , 1963 .