Distributed Deep Learning Using Volunteer Computing-Like Paradigm
暂无分享,去创建一个
[1] Stephen J. Wright,et al. Hogwild: A Lock-Free Approach to Parallelizing Stochastic Gradient Descent , 2011, NIPS.
[2] Yijun Huang,et al. Asynchronous Parallel Stochastic Gradient for Nonconvex Optimization , 2015, NIPS.
[3] Alexander Sergeev,et al. Horovod: fast and easy distributed deep learning in TensorFlow , 2018, ArXiv.
[4] Nenghai Yu,et al. Asynchronous Stochastic Gradient Descent with Delay Compensation , 2016, ICML.
[5] Marc'Aurelio Ranzato,et al. Large Scale Distributed Deep Networks , 2012, NIPS.
[6] Xiang Zhang,et al. OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks , 2013, ICLR.
[7] Yoram Singer,et al. Train faster, generalize better: Stability of stochastic gradient descent , 2015, ICML.
[8] Noam Shazeer,et al. Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity , 2021, ArXiv.
[9] Ekasit Kijsipongse,et al. A hybrid GPU cluster and volunteer computing platform for scalable deep learning , 2018, The Journal of Supercomputing.
[10] Franck Cappello,et al. Cost-benefit analysis of Cloud Computing versus desktop grids , 2009, 2009 IEEE International Symposium on Parallel & Distributed Processing.
[11] John D. Chodera,et al. SARS-CoV-2 Simulations Go Exascale to Capture Spike Opening and Reveal Cryptic Pockets Across the Proteome , 2020, bioRxiv.
[12] Travis Desell,et al. Developing a Volunteer Computing Project to Evolve Convolutional Neural Networks and Their Hyperparameters , 2017, 2017 IEEE 13th International Conference on e-Science (e-Science).
[13] Seetharami R. Seelam,et al. IBM Deep Learning Service , 2017, IBM J. Res. Dev..
[14] Ali Farhadi,et al. Defending Against Neural Fake News , 2019, NeurIPS.
[15] Seunghak Lee,et al. More Effective Distributed ML via a Stale Synchronous Parallel Parameter Server , 2013, NIPS.
[16] David P. Anderson,et al. BOINC: a system for public-resource computing and storage , 2004, Fifth IEEE/ACM International Workshop on Grid Computing.
[17] Yang Wang,et al. BigDL: A Distributed Deep Learning Framework for Big Data , 2018, SoCC.
[18] Enrique Alba,et al. JSDoop and TensorFlow.js: Volunteer Distributed Web Browser-Based Neural Network Training , 2019, IEEE Access.
[19] Max Ryabinin,et al. Towards Crowdsourced Training of Large Neural Networks using Decentralized Mixture-of-Experts , 2020, NeurIPS.
[20] Yaoliang Yu,et al. Petuum: A New Platform for Distributed Machine Learning on Big Data , 2013, IEEE Transactions on Big Data.
[21] Li Fei-Fei,et al. ImageNet: A large-scale hierarchical image database , 2009, CVPR.
[22] Jian Sun,et al. Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
[23] Alexander J. Smola,et al. Scaling Distributed Machine Learning with the Parameter Server , 2014, OSDI.
[24] Qiang Yang,et al. A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.
[25] Yann LeCun,et al. Deep learning with Elastic Averaging SGD , 2014, NIPS.
[26] Trishul M. Chilimbi,et al. Project Adam: Building an Efficient and Scalable Deep Learning Training System , 2014, OSDI.
[27] Jorge Nocedal,et al. Optimization Methods for Large-Scale Machine Learning , 2016, SIAM Rev..