Deep Learning with Dense Random Neural Networks

We exploit the dense structure of nuclei to postulate that in such clusters, the neuronal cells will communicate via soma-to-soma interactions, aswell as through synapses. Using the mathematical structure of the spiking Random Neural Network, we construct a multi-layer architecture for Deep Learning. An efficient training procedure is proposed for this architecture. It is then specialized to multi-channel datasets, and applied to images and sensor-based data.

[1]  Gerardo Rubino,et al.  A new approach for the prediction of end-to-end performance of multimedia streams , 2004, First International Conference on the Quantitative Evaluation of Systems, 2004. QEST 2004. Proceedings..

[2]  A. Gutierrez-Galvez,et al.  Signal and Data Processing for Machine Olfaction and Chemical Sensing: A Review , 2012, IEEE Sensors Journal.

[3]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[4]  Dipankar Das,et al.  Enhanced SenticNet with Affective Labels for Concept-Based Opinion Mining , 2013, IEEE Intelligent Systems.

[5]  Hadi Larijani,et al.  Evaluating perceived voice quality on packet networks using different random neural network architectures , 2011, Perform. Evaluation.

[6]  Luca Maria Gambardella,et al.  Deep Big Simple Neural Nets Excel on Handwritten Digit Recognition , 2010, ArXiv.

[7]  Guang-Bin Huang,et al.  Extreme Learning Machine for Multilayer Perceptron , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[8]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[9]  Erol Gelenbe,et al.  Random Neural Networks with Synchronized Interactions , 2008, Neural Computation.

[10]  Erol Gelenbe,et al.  Random Neural Networks with Multiple Classes of Signals , 1999, Neural Computation.

[11]  Matthew D. Zeiler.  ADADELTA: An Adaptive Learning Rate Method , 2012, ArXiv.

[12]  Andreas Stafylopatis,et al.  Pictorial Information Retrieval Using the Random Neural Network , 1992, IEEE Trans. Software Eng..

[13]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[14]  Gerardo Rubino,et al.  A GRASP Algorithm Using RNN for Solving Dynamics in a P2P Live Video Streaming Network , 2008, 2008 Eighth International Conference on Hybrid Intelligent Systems.

[15]  Erol Gelenbe,et al.  Stability of the Random Neural Network Model , 1990, Neural Computation.

[16]  Stelios Timotheou,et al.  The Random Neural Network: A Survey , 2010, Comput. J..

[17]  L. C. Kasun,et al.  Representational Learning with Extreme Learning Machine for Big Data Liyanaarachchi , 2022 .

[18]  Y. LeCun,et al.  Learning methods for generic object recognition with invariance to pose and lighting , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[19]  E. Gelenbe,et al.  A queue with server of walking type (autonomous service) , 1978, Advances in Applied Probability.

[20]  Erol Gelenbe,et al.  Large scale simulation for human evacuation and rescue , 2012, Comput. Math. Appl..

[21]  Luca Maria Gambardella,et al.  Deep, Big, Simple Neural Nets for Handwritten Digit Recognition , 2010, Neural Computation.

[22]  John Salvatier,et al.  Theano: A Python framework for fast computation of mathematical expressions , 2016, ArXiv.

[23]  Hadi Larijani,et al.  Voice Quality in VoIP Networks Based on Random Neural Networks , 2010, 2010 Ninth International Conference on Networks.

[24]  Gerardo Rubino,et al.  A study of real-time packet video quality using random neural networks , 2002, IEEE Trans. Circuits Syst. Video Technol..

[25]  Ferhan Pekergin,et al.  Dynamical random neural network approach to the traveling salesman problem , 1993, Proceedings of IEEE Systems Man and Cybernetics Conference - SMC.

[26]  Dongsheng Guo,et al.  Cross-validation based weights and structure determination of Chebyshev-polynomial neural networks for pattern classification , 2014, Pattern Recognit..

[27]  Gabriel Alfredo Baum,et al.  A new approach for the prediction of end-to-end performance of multimedia streams , 2004 .

[28]  Erol Gelenbe,et al.  Video quality and traffic QoS in learning-based subsampled and receiver-interpolated video sequences , 2000, IEEE Journal on Selected Areas in Communications.

[29]  Erol Gelenbe,et al.  Autonomous smart routing for network QoS , 2004 .

[30]  Erol Gelenbe,et al.  Deep learning with random neural networks , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[31]  Erol Gelenbe,et al.  Random Neural Networks with Negative and Positive Signals and Product Form Solution , 1989, Neural Computation.

[32]  Hadi Larijani,et al.  Non-intrusive method for video quality prediction over LTE using random neural networks (RNN) , 2014, 2014 9th International Symposium on Communication Systems, Networks & Digital Sign (CSNDSP).

[33]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[34]  Léon Bottou,et al.  The Tradeoffs of Large Scale Learning , 2007, NIPS.

[35]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[36]  Nicolas Brunel,et al.  Lapicque’s 1907 paper: from frogs to integrate-and-fire , 2007, Biological Cybernetics.

[37]  Erol Gelenbe,et al.  Learning in the multiple class random neural network , 2002, IEEE Trans. Neural Networks.

[38]  Yunong Zhang,et al.  Pruning-included weights and structure determination of 2-input neuronet using Chebyshev polynomials of Class 1 , 2012, Proceedings of the 10th World Congress on Intelligent Control and Automation.

[39]  Erol Gelenbe,et al.  Synchronized Interactions in Spiked Neuronal Networks , 2008, Comput. J..

[40]  Erol Gelenbe,et al.  Steps toward self-aware networks , 2009, CACM.

[41]  Zhang Yunong.  Weights and structure determination of Chebyshev-polynomial neural networks for pattern classification , 2012 .

[42]  Jason Gait.  Optimizing Unix database file operations , 1994, IEEE Software.

[43]  Erol Gelenbe,et al.  Area-based results for mine detection , 2000, IEEE Trans. Geosci. Remote. Sens..

[44]  R. Huerta,et al.  Calibration transfer and drift counteraction in chemical sensor arrays using Direct Standardization , 2016 .