Modern Machine Learning: Partition & Vote

We present modern machine learning, focusing on the state-of-the-art classification methods of decision forests and deep networks, as partition and vote schemes. This illustrative presentation allows for both a unified basic understanding of how these methods work from the perspective of classical statistical pattern recognition as well as useful basic insight into their relationship with each other … and potentially with brain functioning.

[1]  Andreas Ziegler,et al.  ranger: A Fast Implementation of Random Forests for High Dimensional Data in C++ and R , 2015, 1508.04409.

[2]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[3]  Alex Krizhevsky,et al.  Learning Multiple Layers of Features from Tiny Images , 2009 .

[4]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[5]  V. Mountcastle.  The columnar organization of the neocortex. , 1997, Brain : a journal of neurology.

[6]  Eric W. Bridgeford,et al.  Connectal coding: discovering the structures linking cognitive phenotypes to individual histories , 2019, Current Opinion in Neurobiology.

[7]  Carey E. Priebe,et al.  Sparse Projection Oblique Randomer Forests , 2015, J. Mach. Learn. Res..

[8]  Razvan Pascanu,et al.  On the Number of Linear Regions of Deep Neural Networks , 2014, NIPS.

[9]  László Györfi,et al.  A Probabilistic Theory of Pattern Recognition , 1996, Stochastic Modelling and Applied Probability.

[10]  Ranulfo Romo,et al.  Flexible Control of Mutual Inhibition: A Neural Model of Two-Interval Discrimination , 2005, Science.

[11]  Antonio Criminisi,et al.  Decision Forests for Computer Vision and Medical Image Analysis , 2013, Advances in Computer Vision and Pattern Recognition.

[12]  Mikhail Belkin,et al.  Reconciling modern machine-learning practice and the classical bias–variance trade-off , 2018, Proceedings of the National Academy of Sciences.

[13]  Vivienne Sze,et al.  Efficient Processing of Deep Neural Networks: A Tutorial and Survey , 2017, Proceedings of the IEEE.

[14]  C. J. Stone,et al.  Consistent Nonparametric Regression , 1977 .

[15]  Leonhard Held,et al.  Spatio-Temporal Analysis of Epidemic Phenomena Using the R Package surveillance , 2014, ArXiv.

[16]  Jaime G. Carbonell,et al.  Nonparametric Neural Networks , 2017, ICLR.

[17]  Haim Sompolinsky,et al.  From Whole-Brain Data to Functional Circuit Models: The Zebrafish Optomotor Response , 2016, Cell.

[18]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[19]  S. Athey,et al.  Generalized random forests , 2016, The Annals of Statistics.