Behavioural Analytics: Exploring judgments and choices in large data sets

Abstract The ever-increasing availability of large data-sets that store users’ judgements (such as forecasts and preferences) and choices (such as acquisitions of goods and services) provides a fertile ground for Behavioural Operational Research (BOR). In this paper, we review the streams of Behavioural Decision Research that might be useful for BOR researchers and practitioners to analyse such behavioural data-sets. We then suggest ways that concepts from these streams can be employed in exploring behavioural data-sets for (i) detecting behavioural patterns, (ii) exploiting behavioural findings and (iii) improving judgements and decisions of consumers and citizens. We also illustrate how this taxonomy for behavioural analytics might be utilised in practice, in three real-world studies with behavioural data-sets generated by websites and online user activity.

[1]  Ralph L. Keeney,et al.  A theorem for Bayesian group decisions , 2011 .

[2]  Michael Lawrence,et al.  Wisdom of group forecasts: Does role-playing play a role? , 2012 .

[3]  R. Hogarth,et al.  The size and distribution of donations: Effects of number of recipients , 2011, Judgment and Decision Making.

[4]  D. Winterfeldt,et al.  Cognitive and Motivational Biases in Decision and Risk Analysis , 2015, Risk analysis : an official publication of the Society for Risk Analysis.

[5]  Marcus O'Connor,et al.  Exploring judgemental forecasting , 1992 .

[6]  P. Wakker.  Prospect Theory: For Risk and Ambiguity , 2010 .

[7]  G. Gigerenzer.  On Narrow Norms and Vague Heuristics: A Reply to Kahneman and Tversky (1996) , 1996 .

[8]  D. Winterfeldt.  On the Relevance of Behavioral Decision Research for Decision Analysis , 1999 .

[9]  R. L. Winkler,et al.  Unanimity and compromise among probability forecasters , 1990 .

[10]  David Martens,et al.  Loyal to your city? A data mining analysis of a public service loyalty program , 2015, Decis. Support Syst..

[11]  Richard P. Larrick,et al.  Intuitions About Combining Opinions: Misappreciation of the Averaging Principle , 2006, Manag. Sci..

[12]  Hersh Shefrin,et al.  Behavioral aspects of the design and marketing of financial products , 1993 .

[13]  Marcus O'Connor,et al.  The anchor and adjustment heuristic in time‐series forecasting , 1995 .

[14]  A. O'Hagan,et al.  Statistical Methods for Eliciting Probability Distributions , 2005 .

[15]  A. Tversky,et al.  The hot hand in basketball: On the misperception of random sequences , 1985, Cognitive Psychology.

[16]  Stewart Robinson,et al.  Addressing the sample size problem in behavioural operational research: simulating the newsvendor problem , 2017, J. Oper. Res. Soc..

[17]  Raimo P. Hämäläinen,et al.  Behavioural operational research: Returning to the roots of the OR profession , 2016, Eur. J. Oper. Res..

[18]  H. Arkes.  Costs and benefits of judgment errors: Implications for debiasing. , 1991 .

[19]  Prospect Theory by Peter P. Wakker , 2010 .

[20]  R. L. Winkler,et al.  Advances in Decision Analysis: Aggregating Probability Distributions , 2007 .

[21]  Mike Wright,et al.  OR analysis of sporting rules - A survey , 2014, Eur. J. Oper. Res..

[22]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[23]  Raimo P. Hämäläinen,et al.  On the importance of behavioral operational research: The case of understanding and communicating about dynamic systems , 2013, Eur. J. Oper. Res..

[24]  Chris Arney.  Nudge: Improving Decisions about Health, Wealth, and Happiness , 2015 .

[25]  H. Pashler,et al.  Measuring the Crowd Within , 2008, Psychological science.

[26]  M. Bazerman.  Judgment in Managerial Decision Making , 1990 .

[27]  Nigel Harvey,et al.  Blackwell Handbook of Judgment and Decision Making , 2004 .

[28]  Applying Behavioural Insights to Organ Donation: preliminary results from a randomised controlled trial , 2013 .

[29]  George Loewenstein,et al.  The fall and rise of psychological explanations in the economics of intertemporal choice. , 1992 .

[30]  Detlof von Winterfeldt,et al.  Testing Best Practices to Reduce the Overconfidence Bias in Multi-criteria Decision Analysis , 2016, 2016 49th Hawaii International Conference on System Sciences (HICSS).

[31]  Neil F. Doherty,et al.  Operational research from Taylorism to Terabytes: A research agenda for the analytics age , 2015, Eur. J. Oper. Res..

[32]  Lisa Werner,et al.  Principles of forecasting: A handbook for researchers and practitioners , 2002 .

[33]  Philippe Delquié,et al.  Bi-Matching: A New Preference Assessment Method to Reduce Compatibility Effects , 1997 .

[34]  Ralph L. Keeney,et al.  Personal Decisions Are the Leading Cause of Death , 2008, Oper. Res..

[35]  Robert Sugden,et al.  On Nudging: A Review of Nudge: Improving Decisions About Health, Wealth and Happiness by Richard H. Thaler and Cass R. Sunstein , 2009 .

[36]  D. Winterfeldt,et al.  Individual and Group Biases in Value and Uncertainty Judgments , 2018 .

[37]  Behavioral Aspects. , 2017, Studies in Health Technology and Informatics.

[38]  Kurt A. Carlson,et al.  Improving Preference Assessment: Limiting the Effect of Context Through Pre-exposure to Attribute Levels , 2006, Manag. Sci..

[39]  Yaozhong Wu,et al.  Social Preferences and Supply Chain Performance: An Experimental Study , 2008, Manag. Sci..

[40]  Carl-Axel S. Staël von Holstein,et al.  Exceptional Paper---Probability Encoding in Decision Analysis , 1975 .

[41]  P. Delfabbro.  The Stubborn Logic of Regular Gamblers: Obstacles and Dilemmas in Cognitive Gambling Research , 2004, Journal of Gambling Studies.

[42]  Anindya Ghose,et al.  An Empirical Examination of the Antecedents and Consequences of Contribution Patterns in Crowd-Funded Markets , 2013, Inf. Syst. Res..

[43]  Paul M. Biner,et al.  Illusory Control as a Function of Motivation for a Specific Outcome in a Chance-Based Situation , 1998 .

[44]  Alan Murray,et al.  Finding Similar Mobile Consumers with a Privacy-Friendly Geosocial Design , 2015, Inf. Syst. Res..

[45]  W. Gaertner.  A Primer in Social Choice Theory , 2006 .

[46]  B. Jullien,et al.  Estimating Preferences under Risk: The Case of Racetrack Bettors , 2000, Journal of Political Economy.

[47]  Gordon Miller,et al.  Decision Making: Descriptive, Normative, and Prescriptive Interactions , 1990 .

[48]  Martin Kunc,et al.  Behavioral operational research theory, methodology and practice , 2016 .

[49]  Jeanne G. Harris,et al.  Competing on Analytics: The New Science of Winning , 2007 .

[50]  Khim-Yong Goh,et al.  Social Media Brand Community and Consumer Behavior: Quantifying the Relative Impact of User- and Marketer-Generated Content , 2013, Inf. Syst. Res..

[51]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[52]  Gerd Gigerenzer,et al.  Chapter 107 The Recognition Heuristic: A Fast and Frugal Way to Investment Choice? , 2008 .

[53]  Gerd Gigerenzer,et al.  Heuristic decision making. , 2011, Annual review of psychology.

[54]  Matthias Sutter,et al.  Psychological Pressure in Competitive Environments: New Evidence from Randomized Natural Experiments , 2012, Manag. Sci..

[55]  Selin A. Malkoc,et al.  Discounting Time and Time Discounting: Subjective Time Perception and Intertemporal Preferences , 2008 .

[56]  V. Smith,et al.  Preferences, Property Rights, and Anonymity in Bargaining Games , 1994 .

[57]  P. Wakker.  Prospect Theory: Frontmatter , 2010 .

[58]  G. Gigerenzer.  How to Make Cognitive Illusions Disappear: Beyond “Heuristics and Biases” , 1991 .

[59]  A. Tsoukiàs,et al.  Policy analytics: an agenda for research and practice , 2013 .

[60]  Framing Effects in Intertemporal Choice Tasks and Financial Implications , 2015 .

[61]  Michael Vitale,et al.  The Wisdom of Crowds , 2015, Cell.

[62]  J. Stevens.  Intertemporal Choice , 2013 .

[63]  Timothy D. Wilson,et al.  Affective Forecasting , 2005 .

[64]  Florian von Wangenheim,et al.  Instant Customer Base Analysis: Managerial Heuristics Often “Get it Right”: , 2008 .

[65]  M. Bar-eli,et al.  Twenty years of “hot hand” research: Review and critique , 2006 .

[66]  David P. Kraines,et al.  Learning to cooperate with Pavlov an adaptive strategy for the iterated Prisoner's Dilemma with noise , 1993 .

[67]  V. Smith,et al.  Social distance and other-regarding behavior in dictator games , 2000 .

[68]  Elena Katok,et al.  Contracting in Supply Chains: A Laboratory Investigation , 2009, Manag. Sci..

[69]  A. Tversky,et al.  Advances in prospect theory: Cumulative representation of uncertainty , 1992 .

[70]  S. Peart,et al.  Galton's Two Papers on Voting as Robust Estimation , 2002 .

[71]  J. Marshall.  This is psychology? , 1981, Nature.

[72]  W. Edwards,et al.  Conservatism in a simple probability inference task. , 1966, Journal of experimental psychology.

[73]  Niall M. Adams,et al.  Mining for classes and patterns in behavioural data , 2001, J. Oper. Res. Soc..

[74]  W. Edwards.  Behavioral decision theory. , 1961, Annual review of psychology.

[75]  R. Hämäläinen,et al.  Engaging with behavioural OR: On methods, actors, and praxis , 2016 .

[76]  John H. Miller,et al.  Rational Cooperation in the Finitely Repeated Prisoner's Dilemma: Experimental Evidence , 1993 .

[77]  David M. Messick,et al.  Individual Heuristics and the Dynamics of Cooperation in Large Groups. , 1995 .

[78]  Daniel G. Goldstein,et al.  Beyond nudges: Tools of a choice architecture , 2012 .

[79]  Arthur E. Attema,et al.  Developments in time preference and their implications for medical decision making , 2012, J. Oper. Res. Soc..

[80]  A. Tversky,et al.  Prospect theory: analysis of decision under risk , 1979 .

[81]  D. Read,et al.  The Psychology of Intertemporal Tradeoffs , 2009, Psychological review.

[82]  W. Hamilton,et al.  The evolution of cooperation. , 1984, Science.

[83]  A. Tversky,et al.  The framing of decisions and the psychology of choice. , 1981, Science.

[84]  B. Fischhoff,et al.  Judgment under uncertainty: Debiasing , 1982 .

[85]  P. Todd,et al.  Chapter 110 Social Heuristics , 2008 .

[86]  B. Majolo,et al.  Human friendship favours cooperation in the Iterated Prisoner's Dilemma , 2006 .

[87]  Sungjune Park,et al.  A free gift card alternative to price discounts in the newsvendor problem , 2013 .

[88]  Gerd Gigerenzer,et al.  How to Make Cognitive Illusions Disappear , 2002 .

[89]  J. Armstrong,et al.  PRINCIPLES OF FORECASTING 1 Principles of Forecasting : A Handbook for Researchers and Practitioners , 2006 .

[90]  P. Wakker,et al.  Eliciting von Neumann-Morgenstern Utilities When Probabilities Are Distorted or Unknown , 1996 .

[91]  Johnnie E. V. Johnson,et al.  Calibration of Subjective Probability Judgments in a Naturalistic Setting. , 2001, Organizational behavior and human decision processes.

[92]  F. Galton.  Vox Populi , 1907, Nature.

[93]  M. Bazerman.  Consumer Research for Consumers , 2001 .

[94]  Alec Morton,et al.  Behavioural decision theory for multi-criteria decision analysis: a guided tour , 2009, J. Oper. Res. Soc..

[95]  Victoria Ateca-Amestoy,et al.  Forecasting accuracy of behavioural models for participation in the arts , 2013, Eur. J. Oper. Res..

[96]  Richard Ormerod,et al.  Writing practitioner case studies to help behavioural OR researchers ground their theories: application of the mangle perspective , 2017, J. Oper. Res. Soc..

[97]  Thomas H. Davenport,et al.  Analytics at Work: Smarter Decisions, Better Results , 2010 .

[98]  William Remus,et al.  Judgemental forecasting in times of change , 1993 .

[99]  S. Lichtenstein,et al.  Do those who know more also know more about how much they know?*1 , 1977 .

[100]  A. Tversky,et al.  Choices, Values, and Frames , 2000 .

[101]  E. Elisabet Rutström,et al.  Entitlements and fairness:: an experimental study of distributive preferences , 2000 .

[102]  Nicholas Bardsley,et al.  Experimental economics and the artificiality of alteration , 2005 .

[103]  N. Kerr,et al.  Group-based forecasting?: A social psychological analysis , 2011 .