Retrospective reports of strategic‐level managers: Guidelines for increasing their accuracy

Strategic management studies frequently involve obtaining retrospective data from strategic-level managers. The use of this data acquisition methodology has received relatively little codification and little critical review or comment. This seems unfortunate, as discussion and codification of the methodology could be useful for those academic researchers and corporate staff who study strategic decisions and organizational processes and for those managers who may be asked to provide the retrospective data. This paper is an attempt to remedy the current state of affairs. In particular, the paper reviews several sources of the data inaccuracies that commonly affect retrospective data and offers guidelines for reducing the occurrence or magnitude of these inaccuracies.

[1]  D. Campbell The Informant in Quantitative Research , 1955, American Journal of Sociology.

[2]  Interviewing the Business Elite , 1957, American Journal of Sociology.

[3]  A. Cohen,et al.  Upward Communication in Experimentally Created Hierarchies , 1958 .

[4]  H. Simon,et al.  Selective perception: A note on the departmental identifications of executives. , 1958 .

[5]  William H. Read,et al.  Upward Communication in Industrial Hierarchies , 1962 .

[6]  Conflicting Group Norms and the "Third" Person in the Interview , 1962, American Journal of Sociology.

[7]  H. Schuman,et al.  The random probe: a technique for evaluating the validity of closed questions. , 1966, American sociological review.

[8]  M. Driver,et al.  Integrative Complexity: An Approach to Individuals and Groups as Information-Processing Systems. , 1969 .

[9]  A. Tversky,et al.  BELIEF IN THE LAW OF SMALL NUMBERS , 1971, Pediatrics.

[10]  John C. Athanassiades The Distortion of Upward Communication in Hierarchical Organizations , 1973 .

[11]  A. Pettigrew The politics of organizational decision-making , 1973 .

[12]  Henry Mintzberg The Nature of Managerial Work , 1974, Operational Research Quarterly (1970-1977).

[13]  John Seidler,et al.  On Using Informants: A Technique for Collecting Quantitative Data and Controlling Measurement Error in Organization Analysis , 1974 .

[14]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[15]  Seymour Sudman,et al.  A methodological assessment of the use of key informants , 1975 .

[16]  B. Fischhoff,et al.  I knew it would happen: Remembered probabilities of once—future things , 1975 .

[17]  Elizabeth F Loftus,et al.  Leading questions and the eyewitness report , 1975, Cognitive Psychology.

[18]  Acquisition Strategy or Acquisition Anarchy? , 1976 .

[19]  Henry Mintzberg,et al.  The Structure of "Unstructured" Decision Processes , 1976 .

[20]  Kathy Riley,et al.  Recall of Television Weather Reports , 1978 .

[21]  C. O'Reilly The Intentional Distortion of Information in Organizational Communication: A Laboratory and Field Investigation , 1978 .

[22]  The politics of decision-making : strategy, cooperation, and conflict , 1978 .

[23]  Robert Willis,et al.  Documentary Sources And Strategic Management Research , 1979 .

[24]  K. A. Ericsson,et al.  Verbal reports as data. , 1980 .

[25]  Marjorie A. Lyles,et al.  Organizational Problem Formulation: An Empirical Study. , 1980 .

[26]  Andrew P. Sage,et al.  Behavioral and Organizational Considerations in the Design of Information Systems and Processes for Planning and Decision Support , 1981, IEEE Transactions on Systems, Man, and Cybernetics.

[27]  J. March,et al.  Information in Organizations as Signal and Symbol. , 1981 .

[28]  R. Mazzolini Strategic Decisions in Government-Controlled Enterprises , 1981 .

[29]  L. Phillips Assessing Measurement Error in Key Informant Reports: A Methodological Note on Organizational Analysis in Marketing , 1981 .

[30]  A. Tversky,et al.  The framing of decisions and the psychology of choice. , 1981, Science.

[31]  Baruch Fischhoff,et al.  Judgment under uncertainty: For those condemned to study the past: Heuristics and biases in hindsight , 1982 .

[32]  G. A. Miller,et al.  Book Review Nisbett, R. , & Ross, L.Human inference: Strategies and shortcomings of social judgment.Englewood Cliffs, N.J.: Prentice-Hall, 1980. , 1982 .

[33]  George P. Huber,et al.  Organizational Information Systems: Determinants of Their Performance and Behavior , 1982 .

[34]  Barton A. Weitz,et al.  Attributions in the Board Room: Causal Reasoning in Corporate Annual Reports , 1983 .