A modified and fast to converge Perceptron learning rule algorithm is proposed as a general classification algorithm for linearly separable data. The strategy of the algorithm takes advantage of training errors to successively refine an initial Perceptron Classifier.
Original Perceptron learning rule uses training errors along with a parameter α (learning rate parameter that has to be determined) to define a better classifier. The proposed modification does not need such a parameter (in fact it is automatically determined during execution of the algorithm).
Experimental evaluation of the proposed algorithm on standard text classification collections, show that results compared favorably to those from state of the art algorithms such as SVMs. Experiments also show a significant improvement of the convergence rate of the proposed Perceptron algorithm compared to the original one.
Seeing the problem of this year's Discovery Challenge (Tag Recommendation), as an automatic text classification problem, where tags play the role of categories and posts play the role of text documents, we applied the proposed algorithm on the datasets for Task 2. In this paper we briefly present the proposed algorithm and its experimental results when applied on the Challenge's data.
[1]
Anestis Gkanogiannis,et al.
A novel supervised learning algorithm and its use for Spam Detection in Social Bookmarking Systems
,
2008
.
[2]
F ROSENBLATT,et al.
The perceptron: a probabilistic model for information storage and organization in the brain.
,
1958,
Psychological review.
[3]
Yiming Yang,et al.
A study of thresholding strategies for text categorization
,
2001,
SIGIR '01.
[4]
George Karypis,et al.
Weight Adjustment Schemes for a Centroid Based Classifier
,
2000
.
[5]
Anestis Gkanogiannis,et al.
An algorithm for text categorization
,
2008,
SIGIR '08.
[6]
Gerard Salton,et al.
Optimization of relevance feedback weights
,
1995,
SIGIR '95.
[7]
Donna K. Harman,et al.
Relevance Feedback and Other Query Modification Techniques
,
1992,
Information retrieval (Boston).
[8]
Martin F. Porter,et al.
An algorithm for suffix stripping
,
1997,
Program.
[9]
Albert B Novikoff,et al.
ON CONVERGENCE PROOFS FOR PERCEPTRONS
,
1963
.