Web Classification Using Deep Belief Networks

In recent years, deep learning approaches have gained significant interest as a way of building hierarchical representations from unlabeled data. These deep learning approaches have been applied to image recognition, voice recognition and text processing. However, to our knowledge, the deep learning approaches have not been extensively studied for web data. In this paper, we apply deep belief networks to web data and evaluate the algorithm on various classification experiments by comparing its performance with that of the SVM classification algorithm. In addition, the experiments show good performance of the deep belief networks for various classification tasks.

[1]  Honglak Lee,et al.  An Analysis of Single-Layer Networks in Unsupervised Feature Learning , 2011, AISTATS.

[2]  Yongyi Yang,et al.  Improving SVM classifier with prior knowledge in microcalcification detection1 , 2012, 2012 19th IEEE International Conference on Image Processing.

[3]  S. Sitharama Iyengar,et al.  Adaptive neural network clustering of Web users , 2004, Computer.

[4]  Honglak Lee,et al.  Unsupervised feature learning for audio classification using convolutional deep belief networks , 2009, NIPS.

[5]  Honglak Lee,et al.  Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations , 2009, ICML '09.

[6]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[7]  Ali Selamat,et al.  Web page feature selection and classification using neural networks , 2004, Inf. Sci..

[8]  Tara N. Sainath,et al.  Deep Belief Networks using discriminative features for phone recognition , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[9]  Nicolas Le Roux,et al.  Representational Power of Restricted Boltzmann Machines and Deep Belief Networks , 2008, Neural Computation.

[10]  Juhan Nam,et al.  Multimodal Deep Learning , 2011, ICML.

[11]  Ee-Peng Lim,et al.  Web classification using support vector machine , 2002, WIDM '02.

[12]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[13]  Geoffrey E. Hinton.  Learning multiple layers of representation , 2007, Trends in Cognitive Sciences.

[14]  Marc'Aurelio Ranzato,et al.  Building high-level features using large scale unsupervised learning , 2011, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[15]  David McG. Squire,et al.  Local Adaptive SVM for Object Recognition , 2010, 2010 International Conference on Digital Image Computing: Techniques and Applications.

[16]  Xuegong Zhang,et al.  Multiclass feature selection algorithms base on R-SVM , 2014, 2014 IEEE China Summit & International Conference on Signal and Information Processing (ChinaSIP).

[17]  Honglak Lee,et al.  Sparse deep belief net model for visual area V2 , 2007, NIPS.

[18]  Geoffrey E. Hinton.  A Practical Guide to Training Restricted Boltzmann Machines , 2012, Neural Networks: Tricks of the Trade.

[19]  Andrew W. Moore,et al.  Bayesian Neural Networks for Internet Traffic Classification , 2007, IEEE Transactions on Neural Networks.

[20]  Jing Yang,et al.  A parallel SVM training algorithm on large-scale classification problems , 2005, 2005 International Conference on Machine Learning and Cybernetics.