Software Usability Evaluation Using Opinion Mining

Usability is critical for any system, but in software it is one of the most important features.  In fact, one of the main reasons for  software failure  is the system lacking to achieve users specified goals and satisfaction.  For this reason, usability evaluation is becoming an important part of software development. Software usability evaluation can be costly in terms of time and human. Therefore, automation is promising way to augment existing approaches especially if the evaluation is subjective where  the usability concentrated  about user's "opinion". This paper proposes to use opinion mining as  an automatic technique  to evaluate  subjective usability. Opinion mining is a research subtopic of data mining aiming to automatically obtain useful opinioned knowledge in subjective texts. We propose a novel model  to extract knowledge from opinions to improve subjective software usability. This is the first time opinion mining used in software usability.  To evaluate our proposed model, a set of experiments was designed and conducted  and we got an average accuracy of 85.41%. Also, we propose to use   graphics to visualize user's opinion in software and to compare the usability of two software.

[1]  Bruno Ohana,et al.  Sentiment Classification of Reviews Using SentiWordNet , 2009 .

[2]  Afifa Lodhi,et al.  Usability Heuristics as an assessment parameter: For performing Usability Testing , 2010, 2010 2nd International Conference on Software Technology and Engineering.

[3]  Andrew McCallum,et al.  Using Maximum Entropy for Text Classification , 1999 .

[4]  Stephen Brewster,et al.  Usability Evaluation of Web Mapping Sites , 2008 .

[5]  Lei Zhang,et al.  Entity discovery and assignment for opinion mining applications , 2009, KDD.

[6]  Alaa M. El-Halees,et al.  Arabic Opinion Mining Using Combined Classification Approach , 2011 .

[7]  Gerard Salton,et al.  Term-Weighting Approaches in Automatic Text Retrieval , 1988, Inf. Process. Manag..

[8]  Belur V. Dasarathy,et al.  Nearest neighbor (NN) norms: NN pattern classification techniques , 1991 .

[9]  Ingo Mierswa,et al.  YALE: rapid prototyping for complex data mining tasks , 2006, KDD '06.

[10]  Alexander Blecken,et al.  Usability Evaluation of a Learning Management System , 2010, 2010 43rd Hawaii International Conference on System Sciences.

[11]  Thomas Tiedtke,et al.  AWUSA – A Tool for Automated Website Usability Analysis , 2002 .

[12]  Mike Thelwall,et al.  Sentiment in short strength detection informal text , 2010 .

[13]  Jurek Kirakowski,et al.  What is Usability , 1991 .

[14]  Jan Stage,et al.  Experimental Evaluation of Techniques for Usability Testing of Mobile Systems in a Laboratory Setting , 2003 .

[15]  Marti A. Hearst,et al.  The state of the art in automating usability evaluation of user interfaces , 2001, CSUR.

[16]  Luis Mena Tobar,et al.  WebA: A Tool for the Assistance in Design and Evaluation of Websites , 2008, J. Univers. Comput. Sci..

[17]  John Yearwood,et al.  Opinion Search in Web Logs , 2007, ADC.

[18]  Gérard Dray,et al.  Web opinion mining: how to extract opinions from blogs? , 2008, CSTST.

[19]  James R. Lewis,et al.  IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use , 1995, Int. J. Hum. Comput. Interact..

[20]  Miroslav Dudík,et al.  A maximum entropy approach to species distribution modeling , 2004, ICML.

[21]  Silvia Mara Abrahão,et al.  Usability evaluation methods for the web: A systematic mapping study , 2011, Inf. Softw. Technol..

[22]  Michalis Nik Xenos,et al.  Combining experimental and inquiry methods in software usability evaluation: The paradigm of LvS educational software , 2010, J. Syst. Inf. Technol..

[23]  Nicolás Marín,et al.  Usability Issues in Data Mining Systems , 2003, ICEIS.

[24]  Toni Granollers,et al.  Enhancing usability testing through datamining techniques: A novel approach to detecting usability problem patterns for a context of use , 2008, Inf. Softw. Technol..

[25]  Bing Liu,et al.  Opinion observer: analyzing and comparing opinions on the Web , 2005, WWW '05.

[26]  M. Thelwall,et al.  Sentiment Strength Detection in Short Informal Text 1 , 2010 .

[27]  Bo Pang,et al.  Thumbs up? Sentiment Classification using Machine Learning Techniques , 2002, EMNLP.

[28]  Chun-hung Li,et al.  Web structure mining for usability analysis , 2005, The 2005 IEEE/WIC/ACM International Conference on Web Intelligence (WI'05).

[29]  Bing Liu,et al.  Mining and summarizing customer reviews , 2004, KDD.

[30]  Ralph Weischedel,et al.  PERFORMANCE MEASURES FOR INFORMATION EXTRACTION , 2007 .

[31]  Ana Amélia Amorim Carvalho 1 USABILITY TESTING OF EDUCATIONAL SOFTWARE : METHODS , TECHNIQUES AND EVALUATORS , 2006 .