A Content Analysis for Website Usefulness Evaluation: Utilizing Text Mining Technique

With the increasing influence of online media, company websites have become important communication channels between companies and customers. Companies use their websites as a marketing tool for a variety of purposes, including enhancing their image and selling products or services. Many researchers have examined the criteria, methods, and tools for website evaluation, but most have focused on usability. Prior content analyses have focused not on text content but on website components, an approach likely to produce subjective evaluations. This study attempts to objectively evaluate company websites by utilizing text mining. We analyze the usefulness of company websites by presenting visualized out puts from a business perspective, allowing practitioners to easily understand the results of the website evaluation and use them i n decision making. To demonstrate our method empirically, we selected a company with a number of affiliates in Korea and analyzed the text content of their websites to assess their usefulness using natural language processing and graphics packages in R. Practitioners c an easily employ our objective evaluation method, and researchers can use it to gain a new perspective on website evaluation.

[1]  Frank Go,et al.  Projected Destination Image Online: Website Content Analysis of Pictures and Text , 2004, J. Inf. Technol. Tour..

[2]  Vassilis Moustakis,et al.  Website Quality Assessment Criteria , 2004, ICIQ.

[3]  Ş. Baloğlu,et al.  The website design and Internet site marketing practices of upscale and luxury hotels in Turkey , 2006 .

[4]  Antonis C. Stylianou,et al.  Global corporate web sites: an empirical investigation of content and design , 2003, Inf. Manag..

[5]  Richard R. Perdue,et al.  Internet Site Evaluations: The Influence of Behavioral Experience, Existing Images, and Selected Website Characteristics , 2002 .

[6]  Stefano Federici,et al.  Web usability evaluation with screen reader users: implementation of the partial concurrent thinking aloud technique , 2010, Cognitive Processing.

[7]  Robert D. Macredie,et al.  The assessment of usability of electronic shopping: A heuristic evaluation , 2005, Int. J. Inf. Manag..

[8]  Prashant C. Palvia,et al.  Developing and validating an instrument for measuring user-perceived web quality , 2002, Inf. Manag..

[9]  Marti A. Hearst,et al.  Improving Web Site Design , 2002, IEEE Internet Comput..

[10]  Thiam Kian Chiew,et al.  Webuse: website usability evaluation tool , 2003 .

[11]  Gerrit Hirschfeld,et al.  Spatial frequencies in aesthetic website evaluations – explaining how ultra-rapid evaluations are formed , 2012, Ergonomics.

[12]  Przemyslaw Prusinkiewicz,et al.  Simulation modeling of plants and plant ecosystems , 2000, CACM.

[13]  Ben Shneiderman,et al.  Universal usability , 2000, Commun. ACM.

[14]  Seung Ryul Jeong,et al.  Visualizing the Results of Opinion Mining from Social Media Contents , 2014 .

[15]  Alistair G. Sutcliffe,et al.  Assessing the reliability of heuristic evaluation for Web site attractiveness and usability , 2002, Proceedings of the 35th Annual Hawaii International Conference on System Sciences.

[16]  Liqing Huang,et al.  Research on C2C e-commerce website usability evaluation system , 2010, 2010 IEEE 11th International Conference on Computer-Aided Industrial Design & Conceptual Design 1.

[17]  Selçuk Çebi,et al.  A quality evaluation model for the design quality of online shopping websites , 2013, Electron. Commer. Res. Appl..

[18]  Dianne Cyr,et al.  Colour appeal in website design within and across cultures: A multi-method evaluation , 2010, Int. J. Hum. Comput. Stud..

[19]  Helen Petrie,et al.  The relationship between accessibility and usability of websites , 2007, CHI.

[20]  Ping Zhang,et al.  Satisfiers and dissatisfiers: a two-factor model for website design and evaluation , 2000 .

[21]  Joseph F. Dumas,et al.  A Practical Guide to Usability Testing , 1993 .

[22]  Shailey Minocha,et al.  Usability beyond the website: An empirically-grounded e-commerce evaluation instrument for the total customer experience , 2006, Behav. Inf. Technol..

[23]  Andreas L. Symeonidis,et al.  Semantic analysis of web documents for the generation of optimal content , 2014, Eng. Appl. Artif. Intell..

[24]  Laura Manzari,et al.  User-Centered Design of a Web Site for Library and Information Science Students: Heuristic Evaluation and Usability Testing , 2013 .

[25]  Seung Ryul Jeong,et al.  A Web Accessability Compliance Framework for Website Development: A Case of W Bank Internet Banking Project - , 2013 .

[26]  Silvia Mara Abrahão,et al.  Usability evaluation methods for the web: A systematic mapping study , 2011, Inf. Softw. Technol..

[27]  Seung Ryul Jeong,et al.  Opinion-Mining Methodology for Social Media Analytics , 2015, KSII Trans. Internet Inf. Syst..

[28]  Viswanath Venkatesh,et al.  Assessing a Firm's Web Presence: A Heuristic Evaluation Procedure for the Measurement of Usability , 2002, Inf. Syst. Res..

[29]  Virpi Roto,et al.  User experience evaluation methods: current state and development needs , 2010, NordiCHI.

[30]  Jinwoo Kim,et al.  Architectural criteria for website evaluation – conceptual framework and empirical validation , 2004, Behav. Inf. Technol..

[31]  Huub van den Bergh,et al.  Measuring the quality of governmental websites in a controlled versus an online setting with the 'Website Evaluation Questionnaire' , 2012, Gov. Inf. Q..

[32]  Nikolaos M. Avouris,et al.  Website Evaluation: A Usability-Based Perspective , 2001, Panhellenic Conference on Informatics.

[33]  Weiping Wang,et al.  E-business Websites Evaluation Based on Opinion Mining , 2009, 2009 International Conference on Electronic Commerce and Business Intelligence.

[34]  Steven John Simon,et al.  The impact of culture and gender on web sites: an empirical study , 2000, DATB.

[35]  Ramaratnam R Bishu,et al.  Web evaluation: heuristic evaluation vs. user testing. , 2009 .

[36]  Ed Huai-hsin Chi Improving Web Usability Through Visualization , 2002, IEEE Internet Comput..

[37]  Soo Shi Tzuaan,et al.  Website user experience (UX) testing tool development using Open Source Software (OSS) , 2012, 2012 Southeast Asian Network of Ergonomics Societies Conference (SEANES).

[38]  Chyuan Perng,et al.  A strategic framework for website evaluation based on a review of the literature from 1995-2006 , 2010, Inf. Manag..