Choice modelling in the age of machine learning

Since its inception, the choice modelling field has been dominated by theory-driven modelling approaches. Machine learning offers an alternative data-driven approach for modelling choice behaviour and is increasingly drawing interest in our field. Cross-pollination of machine learning models, techniques and practices could help overcome problems and limitations encountered in the current theory-driven modelling paradigm, such as subjective labour-intensive search processes for model selection, the inability to work with text and image data. However, despite the potential benefits of using the advances of machine learning to improve choice modelling practices, the choice modelling field has been hesitant to embrace machine learning. This discussion paper aims to consolidate knowledge on the use of machine learning models, techniques and practices for choice modelling, and discuss their potential. Thereby, we hope not only to make the case that further integration of machine learning in choice modelling is beneficial, but also to further facilitate it. To this end, we clarify the similarities and differences between the two modelling paradigms; we review the use of machine learning for choice modelling; and we explore areas of opportunities for embracing machine learning models and techniques to improve our practices. To conclude this discussion paper, we put forward a set of research questions which must be addressed to better understand if and how machine learning can benefit choice modelling.

[1]  Yunlong Zhang,et al.  Travel Mode Choice Modeling with Support Vector Machines , 2008 .

[2]  Michiel C.J. Bliemer,et al.  Constructing Efficient Stated Choice Experimental Designs , 2009 .

[3]  Andrew Daly,et al.  Revisiting consistency with random utility maximisation: theory and implications for practical work , 2018, Theory and decision.

[4]  Junyi Shen.  Latent class model or mixed logit model? A comparison by transport mode choice data , 2009 .

[5]  Stephane Hess,et al.  Comparing hundreds of machine learning classifiers and discrete choice models in predicting travel behavior: an empirical benchmark , 2021, ArXiv.

[6]  Qiang Meng,et al.  Exploratory data analysis for the cancellation of slot booking in intercontinental container liner shipping: A case study of Asia to US West Coast Service , 2019, Transportation Research Part C: Emerging Technologies.

[7]  Sander van Cranenburgh,et al.  An artificial neural network based approach to investigate travellers’ decision rules , 2019, Transportation Research Part C: Emerging Technologies.

[8]  F. Wolak,et al.  Structural Econometric Modeling: Rationales and Examples from Industrial Organization , 2004 .

[9]  Marco F. Huber,et al.  A Survey on the Explainability of Supervised Machine Learning , 2020, J. Artif. Intell. Res..

[10]  Michel Bierlaire,et al.  PandasBiogeme: a short introduction , 2018 .

[11]  Etienne Côme,et al.  Short & long term forecasting of multimodal transport passenger flows with machine learning methods , 2017, 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC).

[12]  Mathilde Pryds Loft,et al.  Deep survival modelling for shared mobility , 2020, Transportation Research Part C: Emerging Technologies.

[13]  John Riedl,et al.  Item-based collaborative filtering recommendation algorithms , 2001, WWW '01.

[14]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[15]  Laurie A. Garrow,et al.  Stacked Hybrid Discrete Choice Models for Airline Itinerary Choice , 2020 .

[16]  C. Cirillo,et al.  Generalized behavioral framework for choice models of social influence: Behavioral and data concerns in travel behavior , 2015 .

[17]  Jean-Philippe Thiran,et al.  Discrete Choice Models for Static Facial Expression Recognition , 2006, ACIVS.

[18]  Gonçalo Homem de Almeida Correia,et al.  On the impact of vehicle automation on the value of travel time while performing work and leisure activities in a car: Theoretical insights and results from a stated preference survey , 2019, Transportation Research Part A: Policy and Practice.

[19]  T. Fowkes,et al.  New appraisal values of travel time saving and reliability in Great Britain , 2019 .

[20]  Greg Linden,et al.  Amazon . com Recommendations Item-to-Item Collaborative Filtering , 2001 .

[21]  渡邊 澄夫.  Algebraic geometry and statistical learning theory , 2009 .

[22]  Sebastian Ruder,et al.  An overview of gradient descent optimization algorithms , 2016, Vestnik komp'iuternykh i informatsionnykh tekhnologii.

[23]  P. Samuelson,et al.  Foundations of Economic Analysis. , 1948 .

[24]  Chi Xie,et al.  WORK TRAVEL MODE CHOICE MODELING USING DATA MINING: DECISION TREES AND NEURAL NETWORKS , 2002 .

[25]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[26]  Shlomo Bekhor,et al.  Data-driven choice set generation and estimation of route choice models , 2020 .

[27]  Satish V. Ukkusuri,et al.  A novel transit rider satisfaction metric: Rider sentiments measured from online social media data , 2013 .

[28]  A. Daly,et al.  Handbook of Choice Modelling , 2014 .

[29]  Lancelot F. James,et al.  Bayesian nonparametric estimation and consistency of mixed multinomial logit choice models , 2010, 1102.5008.

[30]  William A. Brock,et al.  Discrete Choice with Social Interactions , 2001 .

[31]  Ying Jin,et al.  Recreating passenger mode choice-sets for transport simulation: A case study of London, UK , 2018 .

[32]  Bernd Bischl,et al.  Interpretable Machine Learning - A Brief History, State-of-the-Art and Challenges , 2020, PKDD/ECML Workshops.

[33]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[34]  Timothy Brathwaite,et al.  Asymmetric, closed-form, finite-parameter models of multinomial choice , 2016, Journal of Choice Modelling.

[35]  Caspar G. Chorus,et al.  Is your dataset big enough? Sample size requirements when using artificial neural networks for discrete choice analysis , 2018, Journal of Choice Modelling.

[36]  Stefan Wager,et al.  Estimation and Inference of Heterogeneous Treatment Effects using Random Forests , 2015, Journal of the American Statistical Association.

[37]  Rico Krueger,et al.  Random taste heterogeneity in discrete choice models: Flexible nonparametric finite mixture distributions , 2017 .

[38]  Steven R. Lerman,et al.  The Estimation of Choice Probabilities from Choice Based Samples , 1977 .

[39]  Rodrigo Acuna-Agost,et al.  Airline itinerary choice modeling using machine learning , 2019, Journal of Choice Modelling.

[40]  Danilo Bzdok,et al.  Points of Significance: Statistics versus machine learning , 2018, Nature Methods.

[41]  T. Hoorn,et al.  The logsum as an evaluation measure - review of the literature and new results , 2007 .

[42]  Akshay Vij,et al.  Machine Learning Meets Microeconomics: The Case of Decision Trees and Discrete Choice , 2017, 1711.04826.

[43]  Michel Bierlaire,et al.  A practical test for the choice of mixing distribution in discrete choice models , 2005 .

[44]  M. Harding,et al.  A Bayesian mixed logit-probit model for multinomial choice , 2008 .

[45]  Bilal Farooq,et al.  Virtual Immersive Reality for Stated Preference Travel Behavior Experiments: A Case Study of Autonomous Vehicles on Urban Roads , 2018, Transportation Research Record: Journal of the Transportation Research Board.

[46]  Sumio Watanabe.  Algebraic Geometry and Statistical Learning Theory , 2009 .

[47]  David Palma,et al.  Apollo: A flexible, powerful and customisable freeware package for choice model estimation and application , 2019, Journal of Choice Modelling.

[48]  K. Lancaster.  A New Approach to Consumer Theory , 1966, Journal of Political Economy.

[49]  Jonas Eliasson,et al.  Transport appraisal revisited , 2014 .

[50]  Benoît Frénay,et al.  Legal requirements on explainability in machine learning , 2020, Artificial Intelligence and Law.

[51]  Holger H. Hoos,et al.  A survey on semi-supervised learning , 2019, Machine Learning.

[52]  R. Sugden,et al.  Regret Theory: An alternative theory of rational choice under uncertainty Review of Economic Studies , 1982 .

[53]  Tom White,et al.  Generative Adversarial Networks: An Overview , 2017, IEEE Signal Processing Magazine.

[54]  Anjali Awasthi,et al.  Prediction of Individual Travel Mode with Evidential Neural Network Model , 2013 .

[55]  Francisco C. Pereira,et al.  A Neural-embedded Choice Model: TasteNet-MNL Modeling Taste Heterogeneity with Flexibility and Interpretability , 2020, ArXiv.

[56]  Kevin P. Murphy,et al.  Machine learning - a probabilistic perspective , 2012, Adaptive computation and machine learning series.

[57]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[58]  Sumio Watanabe,et al.  Asymptotic Equivalence of Bayes Cross Validation and Widely Applicable Information Criterion in Singular Learning Theory , 2010, J. Mach. Learn. Res..

[59]  G. Yin,et al.  Boosting conditional logit model , 2017 .

[60]  Scott Lundberg,et al.  A Unified Approach to Interpreting Model Predictions , 2017, NIPS.

[61]  Kenneth A. Small,et al.  Valuation of Travel Time , 2012 .

[62]  D. Mehler,et al.  Open science challenges, benefits and tips in early career and beyond , 2018, PLoS biology.

[63]  Marco Kouwenhoven,et al.  Using Artificial Neural Networks for Recovering the Value-of-Travel-Time Distribution , 2019, IWANN.

[64]  Greg Linden,et al.  Two Decades of Recommender Systems at Amazon.com , 2017, IEEE Internet Computing.

[65]  Ganesh Chandra Deka,et al.  Handbook of Research on Cloud Infrastructures for Big Data Analytics , 2014 .

[66]  A. Tversky,et al.  Advances in prospect theory: Cumulative representation of uncertainty , 1992 .

[67]  Michel Bierlaire,et al.  Using semi-open questions to integrate perceptions in choice models , 2014 .

[68]  Nadir Yayla,et al.  The modeling of mode choices of intercity freight transportation with the artificial neural networks and adaptive neuro-fuzzy inference system , 2009, Expert Syst. Appl..

[69]  Caspar G. Chorus,et al.  Random Regret Minimization: An Overview of Model Properties and Empirical Evidence , 2012 .

[70]  Alexandre Alahi,et al.  Enhancing discrete choice models with representation learning , 2020, Transportation Research Part B: Methodological.

[71]  Michel Bierlaire,et al.  A systematic review of machine learning classification methodologies for modelling passenger mode choice , 2021 .

[72]  Satish V. Ukkusuri,et al.  Urban activity pattern classification using topic models from online geo-location data , 2014 .

[73]  Gary J. Russell,et al.  A Probabilistic Choice Model for Market Segmentation and Elasticity Structure , 1989 .

[74]  Cynthia Rudin,et al.  Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead , 2018, Nature Machine Intelligence.

[75]  Francisco C. Pereira,et al.  Opening Up the Conversation: Topic Modeling for Automated Text Analysis in Travel Surveys , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[76]  Konstadinos G. Goulias,et al.  LONGITUDINAL ANALYSIS OF ACTIVITY AND TRAVEL PATTERN DYNAMICS USING GENERALIZED MIXED MARKOV LATENT CLASS MODELS , 1999 .

[77]  Bilal Farooq,et al.  A bi-partite generative model framework for analyzing and simulating large scale multiple discrete-continuous travel behaviour data , 2019, Transportation Research Part C: Emerging Technologies.

[78]  Francisco C. Pereira,et al.  Prediction of rare feature combinations in population synthesis: Application of deep generative modelling , 2019, Transportation Research Part C: Emerging Technologies.

[79]  Teck-Hua Ho,et al.  Theory-Driven Choice Models , 2005 .

[80]  Michel Bierlaire,et al.  Variational Bayesian Inference for Mixed Logit Models with Unobserved Inter- and Intra-Individual Heterogeneity , 2019, 1905.00419.

[81]  Leo Breiman,et al.  Statistical Modeling: The Two Cultures (with comments and a rejoinder by the author) , 2001 .

[82]  T. Rothenberg.  Identification in Parametric Models , 1971 .

[83]  A. Rivlin,et al.  Economic Choices , 2001 .

[84]  R. Duncan Luce,et al.  Individual Choice Behavior: A Theoretical Analysis , 1979 .

[85]  Philippe L. Toint,et al.  Estimating Nonparametric Random Utility Models with an Application to the Value of Time in Heterogeneous Populations , 2010, Transp. Sci..

[86]  Ricardo A. Daziano,et al.  Multinomial Logit Models with Continuous and Discrete Individual Heterogeneity in R: The gmnl Package , 2017 .

[87]  Bilal Farooq,et al.  Semi-supervised GANs to Infer Travel Modes in GPS Trajectories , 2021, Journal of Big Data Analytics in Transportation.

[88]  Francisco C. Pereira.  Rethinking travel behavior modeling representations through embeddings , 2019, ArXiv.

[89]  Feras El Zarwi,et al.  Modeling and Forecasting the Evolution of Preferences over Time: A Hidden Markov Model of Travel Behavior , 2017, 1707.09133.

[90]  Wei Guo,et al.  The analysis of dynamic travel mode choice: a heterogeneous hidden Markov approach , 2015 .

[91]  Majid Sarvi,et al.  Crowd behaviour and motion: Empirical methods , 2018 .

[92]  John M. Rose,et al.  Hypothetical bias in Stated Choice Experiments: Is it a problem? And if so, how do we deal with it? , 2014 .

[93]  Dongwoo Lee,et al.  Comparison of Four Types of Artificial Neural Network and a Multinomial Logit Model for Travel Mode Choice Modeling , 2018, Transportation Research Record: Journal of the Transportation Research Board.

[94]  P. Goos,et al.  Flexible Mixture-Amount Models Using Multivariate Gaussian Processes , 2018, Journal of Business & Economic Statistics.

[95]  Carlos Guestrin,et al.  "Why Should I Trust You?": Explaining the Predictions of Any Classifier , 2016, ArXiv.

[96]  S. Hess.  Conditional parameter estimates from Mixed Logit models: distributional assumptions and a free software tool , 2010 .

[97]  Rico Krueger,et al.  A Dirichlet Process Mixture Model of Discrete Choice , 2018, 1801.06296.

[98]  N. lossesQuaderno.  Shift of reference point and implications on behavioral reaction to gains and losses , 2010 .

[99]  Yang Li,et al.  A Bayesian Semiparametric Approach for Endogeneity and Heterogeneity in Choice Models , 2014, Manag. Sci..

[100]  Dongwoo Lee,et al.  Attitudes on Autonomous Vehicle Adoption using Interpretable Gradient Boosting Machine , 2019, Transportation Research Record: Journal of the Transportation Research Board.

[101]  Michel Bierlaire,et al.  Bayesian Automatic Relevance Determination for Utility Function Specification in Discrete Choice Models , 2019, IEEE Transactions on Intelligent Transportation Systems.

[102]  T. Kuhn,et al.  The Structure of Scientific Revolutions. , 1964 .

[103]  Caspar G. Chorus,et al.  Why did you predict that? Towards explainable artificial neural networks for travel demand analysis , 2021, Transportation Research Part C: Emerging Technologies.

[104]  Andrew T. Collins,et al.  New software tools for creating stated choice experimental designs efficient for regret minimisation and utility maximisation decision rules , 2019, Journal of Choice Modelling.

[105]  S. Hess,et al.  Heterogeneous preferences toward landscape externalities of wind turbines – combining choices and attitudes in a hybrid model , 2015 .

[106]  Feng Chen,et al.  From Twitter to detector: real-time traffic incident detection using social media data , 2016 .

[107]  Bruno De Borger,et al.  The trade-off between money and travel time: A test of the theory of reference-dependent preferences , 2008 .

[108]  Alexander Binder,et al.  On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation , 2015, PloS one.

[109]  M. Bierlaire,et al.  ESTIMATION OF VALUE OF TRAVEL-TIME SAVINGS USING MIXED LOGIT MODELS , 2005 .

[110]  Jörg Firnkorn,et al.  Free-floating electric carsharing-fleets in smart cities: The dawning of a post-private car era in urban environments? , 2015 .

[111]  Elisabetta Cherchi,et al.  Workshop Synthesis: Stated Preference Surveys and Experimental Design, an Audit of the Journey so far and Future Research Perspectives , 2015 .

[112]  Moshe Ben-Akiva,et al.  Dynamic latent plan models , 2010 .

[113]  Zhi-Yong Ran,et al.  Parameter Identifiability in Statistical Machine Learning: A Review , 2017, Neural Computation.

[114]  A.S.A. Alwosheel.  Trustworthy and Explainable Artificial Neural Networks for Choice Behaviour Analysis , 2020 .

[115]  Eric J. Miller,et al.  Nested Logit Models and Artificial Neural Networks for Predicting Household Automobile Choices: Comparison of Performance , 2002 .

[116]  Offer Grembek,et al.  A behavioral modeling approach to bicycle level of service , 2018, Transportation Research Part A: Policy and Practice.

[117]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[118]  Michiel C.J. Bliemer,et al.  Information theoretic-based sampling of observations , 2019, Journal of Choice Modelling.

[119]  Hai Yang,et al.  Integrating probabilistic tensor factorization with Bayesian supervised learning for dynamic ridesharing pattern analysis , 2021 .

[120]  José Ángel Martín-Baos,et al.  Revisiting kernel logistic regression under the random utility models perspective. An interpretable machine-learning approach , 2021 .

[121]  Kristina Lerman,et al.  A Survey on Bias and Fairness in Machine Learning , 2019, ACM Comput. Surv..

[122]  Andrew Daly,et al.  Choice Modelling: The State-of-the-art and the State-of-practice: Proceedings from the Inaugural International Choice Modelling Conference , 2010 .

[123]  R. Ready,et al.  How Do Visual Representations Influence Survey Responses? Evidence from a Choice Experiment on Landscape Attributes of Green Infrastructure , 2019, Ecological Economics.

[124]  R. Luce,et al.  Individual Choice Behavior: A Theoretical Analysis. , 1960 .

[125]  Radford M. Neal.  Markov Chain Sampling Methods for Dirichlet Process Mixture Models , 2000 .

[126]  Ta Theo Arentze,et al.  Parametric Action Decision Trees: Incorporating Continuous Attribute Variables Into Rule-Based Models of Discrete Choice , 2007 .

[127]  Marco Kouwenhoven,et al.  An artificial neural network based method to uncover the value-of-travel-time distribution , 2020, Transportation.

[128]  David A. Hensher,et al.  A comparison of the predictive potential of artificial neural networks and nested logit models for commuter mode choice , 1997 .

[129]  Juergen Meyerhoff,et al.  Do turbines in the vicinity of respondents' residences influence choices among programmes for future wind power generation? , 2013 .

[130]  Rich Caruana,et al.  InterpretML: A Unified Framework for Machine Learning Interpretability , 2019, ArXiv.

[131]  Ricardo Hurtubia,et al.  Explaining subjective perceptions of public spaces as a function of the built environment: A massive data approach , 2019, Landscape and Urban Planning.

[132]  Timothy Brathwaite,et al.  The Holy Trinity: Blending Statistics, Machine Learning and Discrete Choice, with Applications to Strategic Bicycle Planning , 2018 .

[133]  Kazuya Kawamura,et al.  Data-Mining Approach to Work Trip Mode Choice Analysis in Chicago, Illinois, Area , 2010 .

[134]  S. V. Cranenburgh.  Blending computer vision into discrete choice models , 2020 .

[135]  Caspar G. Chorus,et al.  ‘Computer says no’ is not enough: Using prototypical examples to diagnose artificial neural networks for discrete choice analysis , 2019 .

[136]  Nada Wasi,et al.  COMPARING ALTERNATIVE MODELS OF HETEROGENEITY IN CONSUMER CHOICE BEHAVIOR , 2012 .

[137]  Zhibin Jiang,et al.  Analyzing high speed rail passengers’ train choices based on new online booking data in China , 2018, Transportation Research Part C: Emerging Technologies.

[138]  Ankur Taly,et al.  Explainable machine learning in deployment , 2020, FAT*.

[139]  Joelle Pineau,et al.  Improving Reproducibility in Machine Learning Research (A Report from the NeurIPS 2019 Reproducibility Program) , 2020, J. Mach. Learn. Res..

[140]  Michel Bierlaire,et al.  Estimation of discrete choice models with hybrid stochastic adaptive batch size algorithms , 2020, 2012.12155.

[141]  Bilal Farooq,et al.  A Differentially Private Multi-Output Deep Generative Networks Approach For Activity Diary Synthesis , 2020, ArXiv.

[142]  Bilal Farooq,et al.  ResLogit: A residual neural network logit model for data-driven choice modelling , 2021 .

[143]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[144]  Daniel McFadden,et al.  Sociality, Rationality, and the Ecology of Choice , 2009 .

[145]  Pascal Vincent,et al.  Visualizing Higher-Layer Features of a Deep Network , 2009 .

[146]  Hjp Harry Timmermans,et al.  A learning-based transportation oriented simulation system , 2004 .

[147]  Moshe Ben-Akiva,et al.  Discrete Choice Analysis: Theory and Application to Travel Demand , 1985 .

[148]  David M Levinson,et al.  Post-Construction Evaluation of Traffic Forecast Accuracy , 2009 .

[149]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[150]  David A. Hensher,et al.  Handbook of Transport Modelling , 2000 .

[151]  Cristian Arteaga,et al.  Specification of mixed logit models assisted by an optimization framework , 2019, Journal of Choice Modelling.

[152]  Murtaza Haider,et al.  Beyond the hype: Big data concepts, methods, and analytics , 2015, Int. J. Inf. Manag..

[153]  Bilge Atasoy,et al.  Online discrete choice models: Applications in personalized recommendations , 2019, Decis. Support Syst..

[154]  D. McFadden.  Econometric Models for Probabilistic Choice Among Products , 1980 .

[155]  B. Wee,et al.  An empirical assessment of Dutch citizens' preferences for spatial equality in the context of a national transport investment plan , 2017 .

[156]  Prognoses van het Landelijk Model Systeem: komen ze uit? , 2008 .

[157]  Caspar G. Chorus,et al.  Does The Decision Rule Matter For Large-Scale Transport Models? , 2017 .

[158]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[159]  Bilal Farooq,et al.  Ubiquitous monitoring of pedestrian dynamics: Exploring wireless ad hoc network of multi-sensor technologies , 2015, 2015 IEEE SENSORS.

[160]  M. B. Blake,et al.  Two Decades of Recommender Systems at Amazon.com , 2017 .

[161]  Klaus-Robert Müller,et al.  Software for Dataset-wide XAI: From Local Explanations to Global Insights with Zennit, CoRelAy, and ViRelAy , 2021, ArXiv.

[162]  Joan L. Walker,et al.  The overreliance on statistical goodness-of-fit and under-reliance on model validation in discrete choice models: A review of validation practices in the transportation academic literature , 2021 .

[163]  Julian Hagenauer,et al.  A comparative study of machine learning classifiers for modeling travel mode choice , 2017, Expert Syst. Appl..

[164]  Robert L. Hicks,et al.  Combining Discrete and Continuous Representations of Preference Heterogeneity: A Latent Class Approach , 2010 .

[165]  D. Kahneman,et al.  Anomalies: The Endowment Effect, Loss Aversion, and Status Quo Bias , 1991 .

[166]  C. Manski.  Identification of Endogenous Social Effects: The Reflection Problem , 1993 .

[167]  D. McFadden.  Conditional logit analysis of qualitative choice behavior , 1972 .

[168]  Catherine L. Ross,et al.  Machine Learning Travel Mode Choices: Comparing the Performance of an Extreme Gradient Boosting Model with a Multinomial Logit Model , 2018 .

[169]  James Fox,et al.  Pivot-Point Procedures in Practical Travel Demand Forecasting , 2005 .

[170]  Peter Nijkamp,et al.  Modelling inter-urban transport flows in Italy: A comparison between neural network analysis and logit analysis , 1996 .

[171]  D. Hensher,et al.  Stated Choice Methods: Analysis and Applications , 2000 .

[172]  Yoshua Bengio,et al.  Towards Causal Representation Learning , 2021, ArXiv.

[173]  Takayuki Osogami,et al.  A Deep Choice Model , 2016, AAAI.

[174]  Bernd Bischl,et al.  iml: An R package for Interpretable Machine Learning , 2018, J. Open Source Softw..

[175]  Guillaume-Alexandre Bilodeau,et al.  Discriminative conditional restricted Boltzmann machine for discrete choice and latent variable modelling , 2017, ArXiv.

[176]  Michel Bierlaire,et al.  Acceptance of modal innovation: the case of the SwissMetro , 2001 .