Human Decision Making and Artificial Intelligence: A Comparison in the Domain of Sports Prediction

Artificial intelligence (AI) research has become prominent in both academia and industry. With this, an interest in AI's ability to make sound decisions when compared to human decision making has grown. Predicting the outcome of sporting events has traditionally been seen as a difficult task, due to the complex relationships between variables of interest. Attempts to make accurate predictions are fraught with biases owing to the bounded rationality within which human decision making functions. This study puts forward the position that an AI approach using machine learning will yield a comparable level of accuracy. A random forest classification algorithm was employed to predict match outcomes in the 2015 Rugby World Cup. The performance of this model was compared to aggregate results from Super-Bru and OddsPortal. The machine learning based system achieved an accuracy of 89.58% with 95%-CI (77.83, 95.47) vs. 85.42% with 95%-CI (72.83, 92.75) for the platforms. These results indicate that for rugby, over the limited period of a specific tournament, the evidence was not strong enough to suggest that a human agent is superior in terms of accuracy when predicting match outcomes compared to a machine learning approach, at a significance level α = 0.05. However, the model was better able to estimate probabilities as measured by monetary winnings from betting rounds compared to the two platforms.

[1]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[2]  L. Breiman.  OUT-OF-BAG ESTIMATION , 1996 .

[3]  Mark J. Dixon,et al.  The value of statistical forecasts in the UK association football betting market , 2004 .

[4]  Pierre Geurts,et al.  Extremely randomized trees , 2006, Machine Learning.

[5]  John Goddard,et al.  Regression models for forecasting goals and match results in association football , 2005 .

[6]  Patric Andersson,et al.  Predicting the World Cup 2002 in soccer: Performance and confidence of experts and non-experts☆ , 2005 .

[7]  Frank Richard Cowell,et al.  Everyday Life in Ancient Rome , 1961 .

[8]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[9]  R. Selten,et al.  Bounded rationality: The adaptive toolbox , 2000 .

[10]  Christian Frings,et al.  Who will win Wimbledon? The recognition heuristic in predicting sports events , 2006 .

[11]  M. Stone.  Cross‐Validatory Choice and Assessment of Statistical Predictions , 1976 .

[12]  Steven Salaga,et al.  Betting lines and college football television ratings , 2015 .

[13]  Paul Halpern,et al.  The Pursuit Of Destiny: A History Of Prediction , 2000 .

[14]  John L. Kelly,et al.  A new interpretation of information rate , 1956, IRE Trans. Inf. Theory.

[15]  Simon Kasif,et al.  Induction of Oblique Decision Trees , 1993, IJCAI.

[16]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[17]  A. Tversky,et al.  On the psychology of prediction , 1973 .

[18]  Weiqiang Dong.  On Bias , Variance , 0 / 1-Loss , and the Curse of Dimensionality RK April 13 , 2014 .

[19]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[20]  L. Ryd,et al.  On bias. , 1994, Acta orthopaedica Scandinavica.

[21]  Dimitrios I. Fotiadis,et al.  Modifications of the construction and voting mechanisms of the Random Forests Algorithm , 2013, Data Knowl. Eng..

[22]  Ullrich Köthe,et al.  On Oblique Random Forests , 2011, ECML/PKDD.

[23]  Gerd Gigerenzer,et al.  Fast and frugal forecasting , 2009 .

[24]  James G. March,et al.  A primer on decision making : how decisions happen , 1994 .

[25]  Rodney J. Paul,et al.  Bettor Misperceptions in the NBA , 2005 .

[26]  E. Thorp.  The Kelly Criterion in Blackjack Sports Betting, and the Stock Market , 2008 .

[27]  J. Wolfers,et al.  including © notice, is given to the source. Prediction Markets for Economic Forecasting , 2012 .

[28]  Bogdan E. Popescu,et al.  PREDICTIVE LEARNING VIA RULE ENSEMBLES , 2008, 0811.1679.

[29]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[30]  A. Tversky,et al.  Intuitive Prediction: Biases and Corrective Procedures , 1982 .

[31]  Bogdan E. Popescu,et al.  Importance Sampled Learning Ensembles , 2003 .

[32]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[33]  Eric R. Ziegel,et al.  The Elements of Statistical Learning , 2003, Technometrics.

[34]  Robert Simmons,et al.  Forecasting sport: the behaviour and performance of football tipsters , 2000 .

[35]  Herman Stekler,et al.  Issues in Sports Forecasting , 2010 .

[36]  G. V. Kass.  An Exploratory Technique for Investigating Large Quantities of Categorical Data , 1980 .

[37]  Koleman S. Strumpf,et al.  Illegal Sports Bookmakers , 2003 .

[38]  A. Bröder,et al.  Predicting Wimbledon 2005 tennis results by mere player name recognition , 2007 .

[39]  Gerd Gigerenzer,et al.  Models of ecological rationality: the recognition heuristic. , 2002, Psychological review.

[40]  Martin Spann,et al.  Sports forecasting: a comparison of the forecast accuracy of prediction markets, betting odds and tipsters , 2009 .

[41]  A. Tversky,et al.  The hot hand in basketball: On the misperception of random sequences , 1985, Cognitive Psychology.