A Statistician Teaches Deep Learning

[1]  Zoubin Ghahramani,et al.  Deep Bayesian Active Learning with Image Data , 2017, ICML.

[2]  Mikhail Belkin,et al.  Reconciling modern machine learning and the bias-variance trade-off , 2018, ArXiv.

[3]  Wojciech M. Czarnecki,et al.  Grandmaster level in StarCraft II using multi-agent reinforcement learning , 2019, Nature.

[4]  Allan Pinkus,et al.  Multilayer Feedforward Networks with a Non-Polynomial Activation Function Can Approximate Any Function , 1991, Neural Networks.

[5]  Vladimir Koltchinskii,et al.  Rademacher penalties and structural risk minimization , 2001, IEEE Trans. Inf. Theory.

[6]  Md. Zakirul Alam Bhuiyan,et al.  A Survey on Deep Learning in Big Data , 2017, 22017 IEEE International Conference on Computational Science and Engineering (CSE) and IEEE International Conference on Embedded and Ubiquitous Computing (EUC).

[7]  Allen B. Downey,et al.  How to think like a computer scientist: Learning with Python , 2002 .

[8]  Andrew H. Beck,et al.  Diagnostic Assessment of Deep Learning Algorithms for Detection of Lymph Node Metastases in Women With Breast Cancer , 2017, JAMA.

[9]  Roi Naveiro,et al.  Adversarial classification: An adversarial risk analysis approach , 2018, Int. J. Approx. Reason..

[10]  Quoc V. Le,et al.  GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism , 2018, ArXiv.

[11]  Sandeep Paul,et al.  A review on advances in deep learning , 2015, 2015 IEEE Workshop on Computational Intelligence: Theories, Applications and Future Directions (WCI).

[12]  Christopher D. Manning,et al.  Effective Approaches to Attention-based Neural Machine Translation , 2015, EMNLP.

[13]  B. C. Loh,et al.  Deep learning for cardiac computer-aided diagnosis: benefits, issues & solutions. , 2017, mHealth.

[14]  Cynthia Rudin,et al.  This Looks Like That: Deep Learning for Interpretable Image Recognition , 2018 .

[15]  Peter L. Bartlett,et al.  Model Selection and Error Estimation , 2000, Machine Learning.

[16]  André Longtin,et al.  Learning to generalize , 2019, eLife.

[17]  Matus Telgarsky,et al.  Spectrally-normalized margin bounds for neural networks , 2017, NIPS.

[18]  Paris Perdikaris,et al.  Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Data , 2019, J. Comput. Phys..

[19]  Yuan Xie,et al.  Applications of Deep Learning to Neuro-Imaging Techniques , 2019, Front. Neurol..

[20]  Robert B. Gramacy,et al.  Surrogates: Gaussian Process Modeling, Design, and Optimization for the Applied Sciences , 2020 .

[21]  Christopher D. Manning,et al.  Compression of Neural Machine Translation Models via Pruning , 2016, CoNLL.

[22]  M. Opper.  Statistical Mechanics of Learning : Generalization , 2002 .

[23]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[24]  David S. Melnick,et al.  International evaluation of an AI system for breast cancer screening , 2020, Nature.

[25]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[26]  Xiangru Li,et al.  Some optimizations on detecting gravitational wave using convolutional neural network , 2017 .

[27]  Shai Ben-David,et al.  Understanding Machine Learning: From Theory to Algorithms , 2014 .

[28]  Xiao Wang,et al.  Understanding Weight Normalized Deep Neural Networks with Rectified Linear Units , 2018, NeurIPS.

[29]  Li Wang,et al.  Deep Learning Algorithms with Applications to Video Analytics for A Smart City: A Survey , 2015, ArXiv.

[30]  Christopher J. Shallue,et al.  Identifying Exoplanets with Deep Learning: A Five-planet Resonant Chain around Kepler-80 and an Eighth Planet around Kepler-90 , 2017, 1712.05044.

[31]  J. Doug Tygar,et al.  Adversarial machine learning , 2019, AISec '11.

[32]  Jeffrey Dean,et al.  Scalable and accurate deep learning with electronic health records , 2018, npj Digital Medicine.

[33]  Cenk Bircanoglu,et al.  RecycleNet: Intelligent Waste Sorting Using Deep Neural Networks , 2018, 2018 Innovations in Intelligent Systems and Applications (INISTA).

[34]  Zhizheng Wu,et al.  A study of speaker adaptation for DNN-based speech synthesis , 2015, INTERSPEECH.

[35]  Seyed-Mohsen Moosavi-Dezfooli,et al.  Universal Adversarial Perturbations , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  G. Corrado,et al.  End-to-end lung cancer screening with three-dimensional deep learning on low-dose chest computed tomography , 2019, Nature Medicine.

[37]  Levent Sagun,et al.  A jamming transition from under- to over-parametrization affects generalization in deep learning , 2018, Journal of Physics A: Mathematical and Theoretical.

[38]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1989, Math. Control. Signals Syst..

[39]  D. Ruppert.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2004 .

[40]  V. Koltchinskii,et al.  Rademacher Processes and Bounding the Risk of Function Learning , 2004, math/0405338.

[41]  Tetsuya Ogata,et al.  Audio-visual speech recognition using deep learning , 2014, Applied Intelligence.

[42]  Michael I. Jordan,et al.  On Symplectic Optimization , 2018, 1802.03653.

[43]  Peter L. Bartlett,et al.  Rademacher and Gaussian Complexities: Risk Bounds and Structural Results , 2003, J. Mach. Learn. Res..

[44]  Philip S. Yu,et al.  An Introduction to Image Synthesis with Generative Adversarial Nets , 2018, ArXiv.

[45]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[46]  Amit Patel,et al.  Real Time Strategy Games: A Reinforcement Learning Approach , 2015 .

[47]  Nikhil Ketkar,et al.  Deep Learning with Python , 2017 .

[48]  Diego Giuliani,et al.  Deep-neural network approaches for speech recognition with heterogeneous groups of speakers including children† , 2016, Natural Language Engineering.

[49]  Ohad Shamir,et al.  Size-Independent Sample Complexity of Neural Networks , 2017, COLT.

[50]  Kouichi Sakurai,et al.  One Pixel Attack for Fooling Deep Neural Networks , 2017, IEEE Transactions on Evolutionary Computation.

[51]  Levent Sagun,et al.  The jamming transition as a paradigm to understand the loss landscape of deep neural networks , 2018, Physical review. E.

[52]  Guojun Wang,et al.  A deep inference learning framework for healthcare , 2018, Pattern Recognit. Lett..

[53]  Daniel George,et al.  Deep Neural Networks to Enable Real-time Multimessenger Astrophysics , 2016, ArXiv.

[54]  Ying Wah Teh,et al.  Deep learning algorithms for human activity recognition using mobile and wearable sensor networks: State of the art and research challenges , 2018, Expert Syst. Appl..

[55]  Andrey Ignatov,et al.  Real-time human activity recognition from accelerometer data using Convolutional Neural Networks , 2018, Appl. Soft Comput..

[56]  Boaz Barak,et al.  Deep double descent: where bigger models and more data hurt , 2019, ICLR.

[57]  Subhashini Venugopalan,et al.  Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. , 2016, JAMA.

[58]  Ilias Bilionis,et al.  Deep UQ: Learning deep neural network surrogate models for high dimensional uncertainty quantification , 2018, J. Comput. Phys..

[59]  Lawrence Carin,et al.  Bridging Maximum Likelihood and Adversarial Learning via α-Divergence , 2020, AAAI.

[60]  Fengqi You,et al.  Data Analytics and Machine Learning for Smart Process Manufacturing: Recent Advances and Perspectives in the Big Data Era , 2019, Engineering.

[61]  George E. Sakr,et al.  Comparing deep learning and support vector machines for autonomous waste sorting , 2016, 2016 IEEE International Multidisciplinary Conference on Engineering Technology (IMCET).

[62]  Atul Prakash,et al.  Robust Physical-World Attacks on Deep Learning Visual Classification , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[63]  Pierre Baldi,et al.  Development and Validation of a Deep Neural Network Model for Prediction of Postoperative In-hospital Mortality , 2018, Anesthesiology.

[64]  Mikhail Belkin,et al.  Reconciling modern machine-learning practice and the classical bias–variance trade-off , 2018, Proceedings of the National Academy of Sciences.

[65]  ImageNet Classification with Deep Convolutional Neural , 2013 .

[66]  Aurélien Géron,et al.  Hands-On Machine Learning with Scikit-Learn and TensorFlow: Concepts, Tools, and Techniques to Build Intelligent Systems , 2017 .

[67]  Al Sweigart,et al.  Automate the Boring Stuff with Python: Practical Programming for Total Beginners , 2015 .

[68]  Muhammad Imran Razzak,et al.  Deep Learning for Medical Image Processing: Overview, Challenges and Future , 2017, ArXiv.

[69]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[70]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[71]  Daniel Sonntag,et al.  A Survey on Deep Learning Toolkits and Libraries for Intelligent User Interfaces , 2018, ArXiv.

[72]  Zeeshan Ahmed,et al.  Artificial intelligence with multi-functional machine learning platform development for better healthcare and precision medicine , 2020, Database J. Biol. Databases Curation.

[73]  N. Razavian,et al.  Classification and mutation prediction from non–small cell lung cancer histopathology images using deep learning , 2018, Nature Medicine.

[74]  Suman V. Ravuri,et al.  A Clinically Applicable Approach to Continuous Prediction of Future Acute Kidney Injury , 2019, Nature.

[75]  Andrew M. Saxe,et al.  High-dimensional dynamics of generalization error in neural networks , 2017, Neural Networks.

[76]  Manisha Kaushal,et al.  Soft Computing based object detection and tracking approaches: State-of-the-Art survey , 2018, Appl. Soft Comput..

[77]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[78]  Qaisar Abbas,et al.  A comprehensive review of recent advances on deep vision systems , 2018, Artificial Intelligence Review.

[79]  Yunpeng Wang,et al.  Large-Scale Transportation Network Congestion Evolution Prediction Using Deep Learning Theory , 2015, PloS one.

[80]  YevgeniyVorobeychik,et al.  Adversarial Machine Learning , 2018 .

[81]  Sorin Grigorescu,et al.  A Survey of Deep Learning Techniques for Autonomous Driving , 2020, J. Field Robotics.

[82]  Guojie Li,et al.  An Algorithm for Power System Fault Analysis based on Convolutional Deep Learning Neural Networks , 2012 .

[83]  Seyed-Mohsen Moosavi-Dezfooli,et al.  SparseFool: A Few Pixels Make a Big Difference , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[84]  Xin Sun,et al.  Evaluation and accurate diagnoses of pediatric diseases using artificial intelligence , 2019, Nature Medicine.

[85]  Luís C. Neves,et al.  Application of machine learning for fuel consumption modelling of trucks , 2017, 2017 IEEE International Conference on Big Data (Big Data).

[86]  Tengyu Ma,et al.  Optimal Regularization Can Mitigate Double Descent , 2021, ICLR.

[87]  André Luckow,et al.  Deep learning in the automotive industry: Applications and tools , 2016, 2016 IEEE International Conference on Big Data (Big Data).

[88]  H. Robbins.  A Stochastic Approximation Method , 1951 .

[89]  Klaus-Robert Müller,et al.  Explainable Artificial Intelligence: Understanding, Visualizing and Interpreting Deep Learning Models , 2017, ArXiv.

[90]  Christopher D. Manning,et al.  Achieving Open Vocabulary Neural Machine Translation with Hybrid Word-Character Models , 2016, ACL.

[91]  Laurence T. Yang,et al.  A survey on deep learning for big data , 2018, Inf. Fusion.

[92]  Lao Juan,et al.  Development and Validation of a Scale for Measuring Instructors' Attitudes toward Concept-Based or Reform-Oriented Teaching of Introductory Statistics in the Health and Behavioral Sciences , 2010, 1007.3219.