Exploring Qualitative Differences in Knowledge Sources: A Study of Hierarchical Effects of Judgmental Confidence and Accuracy Performance

Focusing on knowledge management (KM) and strategic decision making in service businesses through the constructs of strategic capital and knowledge sharing, the study investigates qualitative differences in domain-specific knowledge of frontline employees and executives. The study draws on cognitive theory and investigates the extent to which the knowledge of these subject groups is correct with respect to incorporating intuitive judgments by various employee groups into forecasting and following strategic decision making. The authors carried out this investigation through an exploratory study of the subject groups’ confidence and accuracy (CA) performance in a constructed knowledge-based forecasting setting. The groups’ intuitive judgmental performances were examined when predicting uncertain business and industry-related outcomes. The authors surveyed 39 executives and 38 frontline employees in 12 hotels. The analysis is based on a between-participants design. The results from this setting do not fully confirm findings in earlier CA studies. Their results indicate that there are no significant differences in the accuracy of executives (as experts) and frontline employees (as novices). Although executives demonstrate overconfidence in their judgments and frontline employees demonstrate under confidence, in line with earlier CA theory of experts and novices, the differences we find are not significant. Similarly, the CA calibration performance difference between the two groups is not significant. They suggest, among other reasons, that our findings differ from earlier CA studies because of organizational politics and culture by power distance, social capital, misuse of knowledge and the size of the business.

[1]  K. Takemura,et al.  The influence of decision heuristics and overconfidence on multiattribute choice: A process-tracing study , 2006 .

[2]  Robert J. Sternberg,et al.  Practical intelligence in real-world pursuits: The role of tacit knowledge. , 1985 .

[3]  R. Leenders,et al.  CSC: The Structure of Advantage and Disadvantage , 1999 .

[4]  Derek J. Koehler,et al.  Modeling patterns of probability calibration with random support theory: Diagnosing case-based judgment ☆ , 2005 .

[5]  R. Bennett,et al.  The importance of tacit knowledge in strategic deliberations and decisions , 1998 .

[6]  T. Bastick,et al.  Intuition--how we think and act , 1982 .

[7]  P. Goodwin,et al.  Judgmental forecasting: A review of progress over the last 25 years , 2006 .

[8]  W. Edwards.  Behavioral decision theory. , 1961, Annual review of psychology.

[9]  Alton Yeow-Kuan Chua,et al.  Center for Army Lessons Learned: Knowledge Application Process in the Military , 2006, Int. J. Knowl. Manag..

[10]  Adel Ismail Al-Alawi,et al.  Organizational culture and knowledge sharing: critical success factors , 2007, J. Knowl. Manag..

[11]  A. H. Murphy,et al.  Probability Forecasting in Meteorology , 1984 .

[12]  E. Schein.  Organizational Culture and Leadership , 1991 .

[13]  Peter Hall,et al.  Improving coverage accuracy of nonparametric prediction intervals , 2001 .

[14]  Michael K. Mauws,et al.  The Politics of Organizational Learning: Integrating Power into the 4I Framework , 2005 .

[15]  D. Kahneman,et al.  Aspects of Investor Psychology , 1998 .

[16]  M. W. Nelson,et al.  Knowledge structure and the estimation of conditional probabilities in audit planning , 1995 .

[17]  Kenneth A. Deffenbacher,et al.  Correlation of eyewitness accuracy and confidence: Optimality hypothesis revisited. , 1987 .

[18]  N. Weinstein.  Unrealistic optimism about future life events , 1980 .

[19]  R. H. Edmundson,et al.  The accuracy of combining judgemental and statistical forecasts , 1986 .

[20]  Ron Summers,et al.  Clinical Knowledge Management: The Role of an Integrated Drug Delivery , 2005 .

[21]  Wayne W. Wakeland,et al.  Using Agent Based Simulation and Game Theory Analysis to Study Knowledge Flow in Organizations: The KMscape , 2009, Int. J. Knowl. Manag..

[22]  A. Tversky,et al.  The weighing of evidence and the determinants of confidence , 1992, Cognitive Psychology.

[23]  Lorne Olfman,et al.  Organizational Memory , 1998, Proceedings of the Thirty-First Hawaii International Conference on System Sciences.

[24]  W. Edwards,et al.  Decision Analysis and Behavioral Research , 1986 .

[25]  Patric Andersson,et al.  Predicting the World Cup 2002 in soccer: Performance and confidence of experts and non-experts☆ , 2005 .

[26]  Paul P. Wang,et al.  Intelligent system to support judgmental business forecasting: the case of estimating hotel room demand , 2000, IEEE Trans. Fuzzy Syst..

[27]  G. Monroe,et al.  The effects of experience and task difficulty on accuracy and confidence assessments of auditors , 2000 .

[28]  Dilek Önkal-Atay,et al.  The influence of trend strength on directional probabilistic currency , 2003 .

[29]  Peter Smith.  Enhancing strategic capital , 2006 .

[30]  W. Edwards,et al.  Conservatism in a simple probability inference task. , 1966, Journal of experimental psychology.

[31]  Y. Malhotra.  Knowledge Management and Virtual Organizations , 2000 .

[32]  Mark Srite,et al.  Organizational Culture for Knowledge Management Systems: A Study of Corporate Users , 2008, Int. J. Knowl. Manag..

[33]  Michael Gibbins,et al.  PROPOSITIONS ABOUT THE PSYCHOLOGY OF PROFESSIONAL JUDGMENT IN PUBLIC ACCOUNTING , 1984 .

[34]  Dilek Önkal,et al.  Professional vs Amateur Judgment Accuracy: The Case of Foreign Exchange Rates , 2003 .

[35]  Spyros Makridakis,et al.  Forecasting and Planning: An Evaluation , 1981 .

[36]  A. Reber.  Implicit learning and tacit knowledge , 1993 .

[37]  Philip Calvert,et al.  Encyclopedia of Knowledge Management , 2008 .

[38]  Neil Brewer,et al.  Confidence-accuracy calibration in absolute and relative face recognition judgments. , 2004, Journal of experimental psychology. Applied.

[39]  W. Ziemba,et al.  Efficiency of the Market for Racetrack Betting , 1981 .

[40]  Gideon Keren,et al.  Facing uncertainty in the game of bridge: A calibration study , 1987 .

[41]  I. Nonaka,et al.  The Knowledge Creating Company , 2008 .

[42]  Timothy D. Wilson,et al.  Telling more than we can know: Verbal reports on mental processes. , 1977 .

[43]  Cade Massey,et al.  Detecting Regime Shifts: The Causes of Under- and Over-Reaction , 2004, Manag. Sci..

[44]  R. Ireland,et al.  Intuition in strategic decision making: Friend or foe in the fast-paced 21st century? , 2005 .

[45]  Dorothy E. Leidner,et al.  Review: Knowledge Management and Knowledge Management Systems: Conceptual Foundations and Research Issues , 2001, MIS Q..

[46]  Jill Fitzgerald,et al.  Towards Knowledge in Writing , 1992 .

[47]  Janice Langan-Fox,et al.  Intuition: A Review of the Literature , 1996 .

[48]  Petter Gottschalk,et al.  Knowledge Management Systems in Law Enforcement: Technologies and Techniques , 2006 .

[49]  Pattarawan Prasarnphanich,et al.  Understanding the Antecedents of Effective Knowledge Management: The Importance of a Knowledge-Centered Culture , 2003, Decis. Sci..

[50]  D. Kahneman,et al.  Heuristics and Biases: The Psychology of Intuitive Judgment , 2002 .

[51]  Albert H. Segars,et al.  Knowledge Management: An Organizational Capabilities Perspective , 2001, J. Manag. Inf. Syst..

[52]  Christopher Hertzog,et al.  Distinguishing age differences in knowledge, strategy use, and confidence during strategic skill acquisition. , 2004, Psychology and aging.

[53]  Peter B. Smith,et al.  In search of Nordic management styles , 2003 .

[54]  J. Metcalfe,et al.  Metacognition : knowing about knowing , 1994 .

[55]  R I Benjamin,et al.  Critical IT (information technology) issues: the next ten years. , 1992, Sloan management review.

[56]  Dilek Önkal,et al.  An exploratory analysis of portfolio managers' probabilistic forecasts of stock prices , 1994 .

[57]  Patrick Cohendet,et al.  Geographies of Knowledge Formation in Firms , 2005 .

[58]  A. Tversky,et al.  Subjective Probability: A Judgment of Representativeness , 1972 .

[59]  J. Baranski,et al.  Individual differences in decision processing and confidence judgments in comparative judgment tasks: The role of cognitive styles , 2005 .

[60]  Elizabeth C. Hirschman,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[61]  Karma Sherif,et al.  Social capital, knowledge management, and sustained superior performance , 2005, J. Knowl. Manag..

[62]  Robert Neumann,et al.  Interorganizational Knowledge Management: Some Perspectives for Knowledge Oriented Strategic Management in Virtual Organizations , 2000 .

[63]  Robert G. Lord,et al.  Leadership and Information Processing: Linking Perceptions and Performance , 2002 .

[64]  Ingi Runar Edvardsson,et al.  Outsourcing in Knowledge-Based Service Firms , 2011, Int. J. Knowl. Based Organ..

[65]  John T. Nosek,et al.  Group cognition as a basis for supporting group knowledge creation and sharing , 2004, J. Knowl. Manag..

[66]  Robert Libby,et al.  Judgment and decision-making research in accounting and auditing: The role of knowledge and memory in audit judgment , 1995 .

[67]  Ángel L. Meroño-Cerdán,et al.  Information technology and learning: Their relationship and impact on organisational performance in small businesses , 2006, Int. J. Inf. Manag..

[68]  R. M. Griffith,et al.  Odds adjustments by American horse-race bettors. , 1949, The American journal of psychology.

[69]  Murray E. Jennex.  Ubiquitous Developments in Knowledge Management: Integrations and Trends , 2010 .

[70]  Stacey M. Whitecotton.  The effects of experience and a decision aid on the slope, scatter, and bias of earnings forecasts , 1996 .

[71]  M. Polanyi.  Chapter 7 – The Tacit Dimension , 1997 .

[72]  A. Tversky,et al.  On the psychology of prediction , 1973 .

[73]  M. Zanna,et al.  Attitudinal qualities relating to the strength of the attitude-behavior relationship☆ , 1978 .

[74]  R. Morgan,et al.  A resource-advantage perspective of product–market strategy performance & strategic capital in high technology firms , 2007 .

[75]  Jill Fitzgerald,et al.  Towards knowledge in writing : illustrations from revision studies , 1992 .

[76]  Murray E. Jennex.  Knowledge Management: Concepts, Methodologies, Tools and Applications , 2007 .

[77]  Cristina Sampaio,et al.  Processes leading to confidence and accuracy in sentence recognition: A metamemory approach , 2006, Memory.

[78]  Peter A. C. Smith,et al.  Knowledge sharing and strategic capital , 2005 .

[79]  Hazel Hall,et al.  KM, culture and compromise: interventions to promote knowledge sharing supported by technology in corporate environments , 2007, J. Inf. Sci..