User Evaluation of a System for Classifying and Displaying Political Viewpoints of Weblogs

This paper presents a Web-based user evaluation of a system for classifying and presenting political viewpoints of blog posts. The system is based on a classification model trained using a supervised learning algorithm, and the data set consists of recent posts from blogs that are self-identified as a liberal or a conservative viewpoint. We first discuss the classification process. Then, with a prototype system for retrieving and classifying political blogs, we look at how the classification results can be presented to users in order to improve the blog search experience. We describe an online user study with 15 users, and the study shows that users preferred the search results page that clearly shows the political viewpoint classification.

[1]  Wei-Hao Lin,et al.  Identifying Perspectives at the Document and Sentence Levels Using Statistical Models , 2006, NAACL.

[2]  Rob Malouf,et al.  Taking sides: user classification for informal online political discourse , 2008, Internet Res..

[3]  Christopher D. Manning,et al.  Introduction to Information Retrieval , 2010, J. Assoc. Inf. Sci. Technol..

[4]  G. A. Mishne,et al.  Information Access Challenges in the Blogspace , 2006 .

[5]  Shlomo Argamon,et al.  Exploiting subjectivity analysis in blogs to improve political leaning categorization , 2008, SIGIR '08.

[6]  Gilad Mishne,et al.  A Study of Blog Search , 2006, ECIR.

[7]  Michelle L. Gregory,et al.  Visual Analysis of Weblog Content , 2007, ICWSM.

[8]  K. Fujimura,et al.  BLOGRANGER – A Multi-faceted Blog Search Engine , 2006 .

[9]  Chih-Jen Lin,et al.  Working Set Selection Using Second Order Information for Training Support Vector Machines , 2005, J. Mach. Learn. Res..

[10]  Timothy W. Finin,et al.  Modeling Trust and Influence in the Blogosphere Using Link Polarity , 2007, ICWSM.

[11]  Sergey Brin,et al.  The Anatomy of a Large-Scale Hypertextual Web Search Engine , 1998, Comput. Networks.

[12]  Wei-Hao Lin,et al.  A Joint Topic and Perspective Model for Ideological Discourse , 2008, ECML/PKDD.

[13]  Andrea Esuli,et al.  SENTIWORDNET: A Publicly Available Lexical Resource for Opinion Mining , 2006, LREC.

[14]  Lillian Lee,et al.  Opinion Mining and Sentiment Analysis , 2008, Found. Trends Inf. Retr..

[15]  Hong Yu,et al.  Towards Answering Opinion Questions: Separating Facts from Opinions and Identifying the Polarity of Opinion Sentences , 2003, EMNLP.

[16]  Rohini K. Srihari,et al.  Using Verbs and Adjectives to Automatically Classify Blog Sentiment , 2006, AAAI Spring Symposium: Computational Approaches to Analyzing Weblogs.

[17]  William W. Cohen,et al.  The MultiRank Bootstrap Algorithm: Self-Supervised Political Blog Classification and Ranking Using Semi-Supervised Link Classification , 2021, ICWSM.

[18]  Susan T. Dumais,et al.  What should blog search look like? , 2008, SSM '08.

[19]  Andrei Broder,et al.  A taxonomy of web search , 2002, SIGF.