Presentation Styles on User Perceived Usefulness in Opinion Summarization

This study systematically compared perceived usefulness of different types of opinion summarization techniques in two phases of experiments. In the first crowd-sourced experiment, we recruited 46 Amazon turkers to first read 50 reviews from Amazon.com, and then completed a survey in order to generate high quality summary information. This first phase generated four presentation styles of summaries, namely, Tag Clouds, Aspect-Oriented Sentiments, Paragraph Summary and Group Sample. In the second, follow-up lab experiment, 34 participants evaluated the four styles in a card sorting experiment. Each participant was given 32 cards (8 cards each presentation style) and grouped the cards into five categories based on the usefulness of the cards. Results indicate that presentation styles have a significant impact on user perceived usefulness in making decisions in a product review task. Participants perceived Aspect-Oriented Sentiments as the most useful presentation style. System implications and recommendations were discussed.

[1]  Arjun Mukherjee,et al.  Aspect Extraction through Semi-Supervised Modeling , 2012, ACL.

[2]  Marti A. Hearst,et al.  Reexamining the cluster hypothesis: scatter/gather on retrieval results , 1996, SIGIR '96.

[3]  Fred D. Davis,et al.  A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies , 2000, Management Science.

[4]  Ross Wilkinson,et al.  Using clustering and classification approaches in interactive retrieval , 2001, Inf. Process. Manag..

[5]  Koji Yatani,et al.  Review spotlight: a user interface for summarizing user-generated reviews using adjective-noun word pairs , 2011, CHI.

[6]  Jorgen P. Bansler,et al.  Corporate Intranet Implementation: Managing Emergent Technologies and Organizational Practices , 2000, J. Assoc. Inf. Syst..

[7]  Manuel de Buenaga,et al.  Multidocument summarization: An added value to clustering in interactive retrieval , 2004 .

[8]  Chaomei Chen,et al.  Visual Analysis of Conflicting Opinions , 2006, 2006 IEEE Symposium On Visual Analytics Science And Technology.

[9]  Detmar W. Straub,et al.  The Relative Importance of Perceived Ease of Use in IS Adoption: A Study of E-Commerce Adoption , 2000, J. Assoc. Inf. Syst..

[10]  Xiaojun Yuan,et al.  What Users Prefer and Why: A User Study on Effective Presentation Styles of Opinion Summarization , 2015, INTERACT.

[11]  Eduard H. Hovy,et al.  Automated Text Summarization and the SUMMARIST System , 1998, TIPSTER.

[12]  Inderjeet Mani,et al.  The Tipster Summac Text Summarization Evaluation , 1999, EACL.

[13]  Carl Gutwin,et al.  Seeing things in the clouds: the effect of visual features on tag cloud selections , 2008, Hypertext.

[14]  Yue Lu,et al.  Rated aspect summarization of short comments , 2009, WWW '09.

[15]  Navneet Kaur,et al.  Opinion mining and sentiment analysis , 2016, 2016 3rd International Conference on Computing for Sustainable Global Development (INDIACom).

[16]  Christopher H. Brooks,et al.  Improved annotation of the blogosphere via autotagging and hierarchical clustering , 2006, WWW '06.

[17]  Michael McGill,et al.  Introduction to Modern Information Retrieval , 1983 .

[18]  Alice H. Oh,et al.  Aspect and sentiment unification model for online review analysis , 2011, WSDM '11.

[19]  Dragomir R. Radev,et al.  LexRank: Graph-based Lexical Centrality as Salience in Text Summarization , 2004, J. Artif. Intell. Res..

[20]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[21]  Sasha Blair-Goldensohn,et al.  Sentiment Summarization: Evaluating and Learning User Preferences , 2009, EACL.

[22]  Anton Leuski,et al.  Evaluating document clustering for interactive information retrieval , 2001, CIKM '01.

[23]  Nicholas J. Belkin,et al.  Personalizing information retrieval for multi-session tasks: the roles of task stage and task type , 2010, SIGIR '10.

[24]  Hsin-Hsi Chen,et al.  Opinion Extraction, Summarization and Tracking in News and Blog Corpora , 2006, AAAI Spring Symposium: Computational Approaches to Analyzing Weblogs.

[25]  R. G. Raj,et al.  A Preliminary Investigation of User Perception and Behavioral Intention for Different Review Types: Customers and Designers Perspective , 2014, TheScientificWorldJournal.

[26]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .

[27]  Giuseppe Carenini,et al.  Interactive multimedia summaries of evaluative text , 2006, IUI '06.

[28]  Manuel J. Maña López,et al.  Multidocument summarization: An added value to clustering in interactive retrieval , 2004, TOIS.

[29]  Xu Ling,et al.  Topic sentiment mixture: modeling facets and opinions in weblogs , 2007, WWW '07.

[30]  Dragomir R. Radev,et al.  Generating Natural Language Summaries from Multiple On-Line Sources , 1998, CL.

[31]  Yue Lu,et al.  Opinion integration through semi-supervised topic modeling , 2008, WWW.

[32]  Jackie Chi Kit Cheung,et al.  Multi-Document Summarization of Evaluative Text , 2013, EACL.

[33]  Bing Liu,et al.  Mining and summarizing customer reviews , 2004, KDD.

[34]  Mary S. Neff,et al.  Multi-document Summarization by Visualizing Topical Content , 2000 .

[35]  Steffen Becker,et al.  Opinion Summarization of Web Comments , 2010, ECIR.