Informants in Organizational Marketing Research: Why Use Multiple Informants and how to Aggregate Responses

Organizational research frequently involves seeking judgmental response data from informants within organizations. This article discusses why using multiple informants improves the quality of response data and thereby the validity of research findings. The authors show that when there are multiple informants who disagree, responses aggregated with confidence- or competence-based weights outperform those with response data-based weights, which in turn provide significant gains in estimation accuracy over simply averaging informant reports. The proposed methods are effective, inexpensive, and easy to use in organizational marketing research.

[1]  John Seidler,et al.  On Using Informants: A Technique for Collecting Quantitative Data and Controlling Measurement Error in Organization Analysis , 1974 .

[2]  R. Hogarth,et al.  Unit weighting schemes for decision making , 1975 .

[3]  Peter A. Morris,et al.  Combining Expert Judgments: A Bayesian Approach , 1977 .

[4]  Robin M. Hogarth,et al.  Quality of Group Judgment , 1977 .

[5]  Roger K. Blashfield,et al.  Performance of a composite as a function of the number of judges , 1978 .

[6]  Robin M. Hogarth,et al.  A note on aggregating opinions , 1978 .

[7]  J. Paul Peter,et al.  Construct Validity: A Review of Basic Issues and Marketing Practices , 1981 .

[8]  R. L. Winkler.  Combining Probability Distributions from Dependent Information Sources , 1981 .

[9]  J. P. Peter.  Construct Validity: A Review of Basic Issues and Marketing Practices , 1981 .

[10]  L. Phillips.  Assessing Measurement Error in Key Informant Reports: A Methodological Note on Organizational Analysis in Marketing , 1981 .

[11]  Alvin J. Silk,et al.  Measuring Influence in Organizational Purchase Decisions , 1982 .

[12]  L. James.  Aggregation Bias in Estimates of Perceptual Agreement. , 1982 .

[13]  G. John,et al.  The Reliability and Validity of Key Informant Data from Dyadic Relationships in Marketing Channels , 1982 .

[14]  G. W. Hill.  Group versus individual performance: are n + 1 heads better than one?" psychological bulletin , 1982 .

[15]  Reza Moinpour,et al.  Managerial Judgment in Marketing: The Concept of Expertise , 1983 .

[16]  D. Rousseau.  Issues of level in organizational research: Multi-level and cross-level perspectives. , 1985 .

[17]  William R. Ferrell,et al.  Combining Individual Judgments , 1985 .

[18]  James C. Anderson.  A Measurement Model to Assess Measure-Specific Factors in Multiple-Informant Research , 1985 .

[19]  C. E. Agnew.  Multiple Probability Assessments by Dependent Experts , 1985 .

[20]  Robert H. Ashton,et al.  Aggregating Subjective Forecasts: Some Empirical Results , 1985 .

[21]  J. Armstrong,et al.  The Ombudsman: Research on Forecasting: A Quarter-Century Review, 1960--1984 , 1986 .

[22]  D. Schwab,et al.  Assessment of a consensus-based multiple information source job evaluation system. , 1986 .

[23]  Joseph A. Cote,et al.  Estimating Trait, Method, and Error Variance: Generalizing across 70 Construct Validation Studies , 1987 .

[24]  James C. Anderson,et al.  An approach for confirmatory measurement and structural equation modeling of organizational properties , 1987 .

[25]  M. Ronald Buckley,et al.  Measurement Error and Theory Testing in Consumer Research: An Illustration of the Importance of Construct Validation , 1988 .

[26]  Rebecca A. Henry,et al.  Accuracy and confidence in group judgment , 1989 .

[27]  R. Clemen.  Combining forecasts: A review and annotated bibliography , 1989 .

[28]  Russell S. Winer,et al.  Locally Rational Decision Making: The Distracting Effect of Information on Managerial Performance , 1992 .

[29]  Jayashree Mahajan.  The Overconfidence Effect in Marketing Management Predictions , 1992 .

[30]  Gene Rowe,et al.  Perspectives on Expertise in the Aggregation of Judgments , 1992 .

[31]  L. Stern,et al.  Conducting Interorganizational Research Using Key Informants , 1993 .

[32]  Robert L. Winkler,et al.  Aggregating Point Estimates: A Flexible Modeling Approach , 1993 .

[33]  Nirmalya Kumar,et al.  Interdependence, Punitive Capability, and the Reciprocation of Punitive Actions in Channel Relationships , 1998 .

[34]  Giovanni Parmigiani,et al.  Combining Expert Judgment by Hierarchical Modeling: An Application to Physician Staffing , 1998 .

[35]  R. Chandy,et al.  Organizing for Radical Product Innovation: The Overlooked Role of Willingness to Cannibalize , 1998 .

[36]  J. W. Hutchinson,et al.  Knowledge Calibration: What Consumers Know and What They Think They Know , 2000 .

[37]  Christian Homburg,et al.  A Multiple-Layer Model of Market-Oriented Organizational Culture: Measurement Issues and Performance Outcomes , 2000 .