The role of decision makers’ use of visualizations in project portfolio decision making

Abstract Visualizations are increasingly used to display data for project portfolio decision making. Such decisions support the delivery of organizational strategy and aim to enhance the overall outcome from project investments. While some studies show that visualizations help data interpretation, others suggest they might bias decisions. To better understand whether and how visualizations affect project portfolio decisions, we develop and test a conceptual model that emphasizes the role of the decision maker in interpreting and using visual data. Using a dual-informant sample of 138 firms, we show a positive relationship between decision makers’ use of visualizations and project portfolio success that is mediated by decision-making success. We draw upon theories of cognitive fit and cognitive load to explain how the relationship between the use of visualizations and decision-making success is influenced by both the decision maker's tendency to use heuristics and their familiarity with visualizations.

[1]  Jacques Bertin,et al.  Semiology of Graphics - Diagrams, Networks, Maps , 2010 .

[2]  Hans-Georg Gemünden,et al.  Business Case Control in Project Portfolios—An Empirical Investigation of Performance Consequences and Moderating Effects , 2015, IEEE Transactions on Engineering Management.

[3]  H. Gemünden,et al.  Formalization of project portfolio management: The moderating role of project portfolio complexity , 2012 .

[4]  Steven E. Kaplan,et al.  The effect of CEO reputation and explanations for poor performance on investors' judgments about the company's future performance and management , 2010 .

[5]  Regina C. McNally,et al.  Exploring New Product Portfolio Management decisions: The role of managers' dispositional traits , 2009 .

[6]  J. Mikkola.  Portfolio management of R&D projects: implications for innovation management , 2001 .

[7]  Rainer Kolisch,et al.  Human Behavior in Project Portfolio Selection: Insights from an Experimental Study , 2018, Decis. Sci..

[8]  Catherine P. Killen,et al.  Managing portfolio interdependencies: The effects of visual data representations on project portfolio decision making , 2017 .

[9]  N. Berg.  Success from satisficing and imitation: Entrepreneurs' location choice and implications of heuristics for local economic development , 2014 .

[10]  Charlotte H. Mason,et al.  Visual Representation: Implications for Decision Making , 2007 .

[11]  Sirkka L. Jarvenpaa,et al.  The effect of task demands and graphical format on information processing strategies , 1989 .

[12]  C. Killen,et al.  Dynamic capability through project portfolio management in service and manufacturing industries , 2010 .

[13]  Regina C. McNally,et al.  From the Special Issue Editors: An Introduction to the Special Issue on Decision Making in New Product Development and Innovation , 2011 .

[14]  H. Gemünden,et al.  How Ideation Portfolio Management Influences Front-End Success , 2015 .

[15]  Sirkka L. Jarvenpaa,et al.  Graphics and managerial decision making: research-based guidelines , 1988, CACM.

[16]  H. Ernst,et al.  What Keeps Managers Away from a Losing Course of Action? Go/Stop Decisions in New Product Development , 2014 .

[17]  Gerd Gigerenzer,et al.  Ecological Rationality: Fast-and-Frugal Heuristics for Managerial Decision Making under Uncertainty , 2019, Academy of Management Journal.

[18]  Colin Ware,et al.  Information Visualization: Perception for Design , 2000 .

[19]  Judy Behrens.  A Lack of Insight: An Experimental Analysis of R&D Managers’ Decision Making in Innovation Portfolio Management , 2016 .

[20]  R. Cooper,et al.  New Product Portfolio Management: Practices and Performance , 1999 .

[21]  M. Martinsuo,et al.  Role of single-project management in achieving portfolio management efficiency , 2007 .

[22]  D. Kahneman,et al.  Conditions for intuitive expertise: a failure to disagree. , 2009, The American psychologist.

[23]  Sam MacAulay,et al.  Five Rules for Managing Large, Complex Projects , 2017 .

[24]  P. Fayers,et al.  The Visual Display of Quantitative Information , 1990 .

[25]  Catherine P. Killen,et al.  Understanding project interdependencies: The role of visual representation, culture and process , 2012 .

[26]  H. Gemünden,et al.  Enforcing strategic fit of project portfolios by project termination: An empirical study on senior management involvement , 2012 .

[27]  Hui-Chun Chu,et al.  Potential Negative Effects of Mobile Learning on Students' Learning Achievement and Cognitive Load - A Format Assessment Perspective , 2014, J. Educ. Technol. Soc..

[28]  Renate E. Meyer,et al.  The Visual Dimension in Organizing, Organization, and Organization Research: Core Ideas, Current Developments, and Promising Avenues , 2013 .

[29]  Jay R. Galbraith.  Organization Design: An Information Processing View , 1974 .

[30]  R. Müller,et al.  Modeling Organizational Project Management , 2019, Project Management Journal.

[31]  F. Paas,et al.  Cognitive Load Theory and Instructional Design: Recent Developments , 2003 .

[32]  Catherine P. Killen,et al.  Three dimensions of learning: experiential activity for engineering innovation education and research , 2015 .

[33]  A. Griffin,et al.  Exploring Portfolio Decision‐Making Processes* , 2011 .

[34]  Baruch Fischhoff.  Visualizing your vulnerabilities. , 2006, Harvard business review.

[35]  P. Bentler,et al.  Fit indices in covariance structure modeling : Sensitivity to underparameterized model misspecification , 1998 .

[36]  Eugene Hendrie MacNiece.  Production forecasting, planning, and control , 1952 .

[37]  K. Eisenhardt,et al.  Strategic decision processes in high velocity environments: four cases in the microcomputer industry , 1988 .

[38]  M. Magnusson,et al.  Dealing with legitimacy: A key challenge for Project Portfolio Management decision makers , 2014 .

[39]  H. Gemünden,et al.  Project Lineage Management and Project Portfolio Success , 2019, Project Management Journal.

[40]  Ulrike de Brentani,et al.  How Formal Control Influences Decision‐Making Clarity and Innovation Performance , 2013 .

[41]  Andrew Davies,et al.  Innovation in Megaprojects: Systems Integration at London Heathrow Terminal 5 , 2009 .

[42]  H. Gemünden,et al.  Antecedents to decision-making quality and agility in innovation portfolio management , 2016 .

[43]  Robert A Hunt,et al.  Project portfolio management for product innovation , 2008 .

[44]  H. Gemünden,et al.  The role of project portfolio management in fostering both deliberate and emergent strategy , 2017 .

[45]  Sheldon J. Chow.  Many Meanings of ‘Heuristic’ , 2015, The British Journal for the Philosophy of Science.

[46]  Herbert A. Simon,et al.  Why a Diagram is (Sometimes) Worth Ten Thousand Words , 1987 .

[47]  Martin J. Eppler,et al.  The Pitfalls of Visual Representations , 2015 .

[48]  Regina C. McNally,et al.  New Product Portfolio Management Decisions: Antecedents and Consequences , 2013 .

[49]  A. Griffin,et al.  An Empirical Investigation of the Antecedents and Outcomes of NPD Portfolio Success , 2014 .

[50]  Christopher D. Allport,et al.  The Impact of Disclosing Management's Past Forecast Accuracy on Nonprofessional Investors' Heuristic Decision-Making , 2015 .

[51]  H. Simon,et al.  A Behavioral Model of Rational Choice , 1955 .

[52]  Gerd Gigerenzer,et al.  Heuristic decision making. , 2011, Annual review of psychology.

[53]  Hans-Georg Gemünden,et al.  Predicting Project Portfolio Success by Measuring Management Quality—A Longitudinal Study , 2013, IEEE Transactions on Engineering Management.

[54]  Christopher B. Bingham,et al.  Rational heuristics: the ‘simple rules’ that strategists learn from process experience , 2011 .

[55]  N. Luhmann.  Familiarity, Confidence, Trust: Problems and Alternatives , 2000 .

[56]  Erran Carmel,et al.  The Effectiveness of Different Representations for Managerial Problem Solving: Comparing Tables and Maps , 1997 .

[57]  D. Kahneman.  Thinking, Fast and Slow , 2011 .

[58]  John H. Humphreys,et al.  Cuán bajos estamos dispuestos a llegar , 2006 .

[59]  Luc Pauwels.  A theoretical framework for assessing visual representational practices in knowledge building and science communications , 2006 .

[60]  The Psychology of Rhetorical Images , 2012 .

[61]  H. Gemünden,et al.  A Contingency Approach on the Impact of Front-End Success on Project Portfolio Success , 2016 .

[62]  Martin Voss,et al.  Impact of Relationship Value on Project Portfolio Success - Investigating the Moderating Effects of Portfolio Characteristics and External Turbulence , 2013 .

[63]  H. Ernst,et al.  The Decision to Exploit an R&D Project: Divergent Thinking across Middle and Senior Managers† , 2014 .

[64]  R. Daft,et al.  Toward a Model of Organizations as Interpretation Systems , 1984 .

[65]  Harald Störrle,et al.  How do modelers read UML diagrams?: preliminary results from an eye-tracking study , 2018, ICSE.