Age and domain specific usability analysis of opinion visualisation techniques

ABSTRACT This study analysed the impact of age and domain knowledge on the usability of some of the state-of-the-art opinion visualisation techniques. A questionnaire survey was designed to ask the users’ level of agreement or disagreement about the selected opinion visualisation techniques against a set of information visualisation metrics. The data were collected by conducting seminars and using a web-based online questionnaire. We categorised participants (N = 146) into three age groups (≤20 years: teenager; 21–30 years: young adults; >30: adults). According to domain knowledge, participants are classified into two groups, one having knowledge of human computer interaction (HCI users) and the other without this knowledge (non-HCI users). The collected data were analysed using an independent sample t-test and analysis of variance. It is concluded that there are significant differences between the perception of HCI and non-HCI users on visual appeal, understandability, user friendliness, intuitiveness, informativeness, usefulness, comprehensiveness, comparison ability, and pre-knowledge requirement. Moreover, age was found to be significant for visual appeal, comprehensiveness, intuitiveness, and pre-knowledge requirement.

[1]  Moshe Zviran,et al.  User satisfaction from commercial web sites: The effect of design and use , 2006, Inf. Manag..

[2]  W. Johnson,et al.  Handbook of Aging and Cognition , 2008 .

[3]  Yushiana Mansor,et al.  Heuristic evaluation of interface usability for a web-based OPAC , 2007, Libr. Hi Tech.

[4]  J. Krosnick.  EXPERTISE AND POLITICAL PSYCHOLOGY , 1990 .

[5]  Håkan Jonsson,et al.  Evaluating three-dimensional information visualization designs: a case study of three designs , 1998, Proceedings. 1998 IEEE Conference on Information Visualization. An International Conference on Computer Visualization and Graphics (Cat. No.98TB100246).

[6]  Vimala Balakrishnan.  The Evaluation of Opinion Mining and Sentiment Analysis Systems using Evaluation Metrics , 2013 .

[7]  André P. Calitz,et al.  The evaluation of information visualisation techniques using eye tracking , 2009 .

[8]  Paul R. Kinnear,et al.  Skill in Map Reading and Memory for Maps , 1988 .

[9]  Chris North,et al.  The Value of Information Visualization , 2008, Information Visualization.

[10]  Shijing Liu.  Technology Acceptance Model for Determining the Effects of Age, Usability, and Content on Mobile Application Usage , 2012 .

[11]  Matthew O. Ward,et al.  Theoretical Foundations of Information Visualization , 2008, Information Visualization.

[12]  Erica L. Olmsted-Hawala,et al.  Age-Related Differences in Eye Tracking and Usability Performance: Website Usability for Older Adults , 2013, Int. J. Hum. Comput. Interact..

[13]  Andreas Holzinger,et al.  On Some Aspects of Improving Mobile Applications for the Elderly , 2007, HCI.

[14]  K. A. Ericsson,et al.  Toward a general theory of expertise : prospects and limits , 1991 .

[15]  Robert Spence.  Information Visualization: An Introduction , 2014 .

[16]  Ian MacColl,et al.  Usability evaluation of a tag-based interface , 2012 .

[17]  R. Engle,et al.  Memory processes among bridge players of differing expertise. , 1978 .

[18]  Raquel M. Pillat,et al.  Experimental study on evaluation of multidimensional information visualization techniques , 2005, CLIHC '05.

[19]  Eric K. Ringger,et al.  Pulse: Mining Customer Opinions from Free Text , 2005, IDA.

[20]  F. Craik,et al.  The handbook of aging and cognition , 1992 .

[21]  Ruwei Dai,et al.  AMAZING: A sentiment mining and retrieval system , 2009, Expert Syst. Appl..

[22]  Andy Field,et al.  Discovering statistics using IBM SPSS statistics: and sex and drugs and rock 'n' roll, 4th Edition , 2013 .

[23]  S. Czaja,et al.  Age differences in the performance of computer-based work. , 1993, Psychology and aging.

[24]  Timothy A. Post,et al.  Problem-Solving Skill in the Social Sciences , 1983 .

[25]  Arthur Wingfield,et al.  Contextual knowledge reduces demands on working memory during reading , 2006, Memory & cognition.

[26]  Bing Liu,et al.  Opinion observer: analyzing and comparing opinions on the Web , 2005, WWW '05.

[27]  Satoshi Morinaga,et al.  Mining product reputations on the Web , 2002, KDD.

[28]  F. Nightingale,et al.  Florence Nightingale : measuring hospital care outcomes : excerpts from the books Notes on matters affecting the health, efficiency, and hospital administration of the British Army founded chiefly on the experience of the late war and Notes on hospitals , 1999 .

[29]  David Sundaram,et al.  Purposeful Visualization , 2011, 2011 44th Hawaii International Conference on System Sciences.

[30]  Martina Ziefle,et al.  How older adults meet complexity: Aging effects on the usability of different mobile phones , 2005, Behav. Inf. Technol..

[31]  Michelle L. Gregory,et al.  User-directed Sentiment Analysis: Visualizing the Affective Content of Documents , 2006 .

[32]  T. Salthouse,et al.  The effects of age and experience on memory for visually presented music. , 1998, The journals of gerontology. Series B, Psychological sciences and social sciences.

[33]  Daniel A. Keim,et al.  Visual opinion analysis of customer feedback data , 2009, 2009 IEEE Symposium on Visual Analytics Science and Technology.

[34]  Richard F. Riesenfeld,et al.  A Survey of Radial Methods for Information Visualization , 2009, IEEE Transactions on Visualization and Computer Graphics.

[35]  Andreas Holzinger,et al.  Usability engineering methods for software developers , 2005, CACM.

[36]  Chaomei Chen,et al.  Visual Analysis of Conflicting Opinions , 2006, 2006 IEEE Symposium On Visual Analytics Science And Technology.

[37]  Barbara S. Chaparro,et al.  Evaluating websites for older adults: adherence to ‘senior-friendly’ guidelines and end-user performance , 2008, Behav. Inf. Technol..

[38]  J. Pallant.  SPSS survival manual : a step-by-step guide to data analysis using SPSS version 15 , 2007 .

[39]  Michael Stonebraker,et al.  Visual Information Density Adjuster (VIDA) , 1997 .

[40]  David Chek Ling Ngo,et al.  Another look at a model for evaluating interface aesthetics , 2001 .

[41]  Randall W. Engle,et al.  Effects of Domain Knowledge, Working Memory Capacity, and Age on Cognitive Performance: An Investigation of the Knowledge-Is-Power Hypothesis , 2000, Cognitive Psychology.

[42]  Robert Kosara,et al.  Understanding the structure of information visualization through visual metaphors , 2010 .

[43]  Steven W. Brown,et al.  The effects and interaction of spatial visualization and domain expertise on information seeking , 2004, Comput. Hum. Behav..

[44]  Morten Hertzum,et al.  How Age Affects Pointing With Mouse and Touchpad: A Comparison of Young, Adult, and Elderly Users , 2010, Int. J. Hum. Comput. Interact..

[45]  Monica Landoni,et al.  Is Google the answer? A study into usability of search engines , 2007 .

[46]  Yong Ho Kim,et al.  Usability study of digital institutional repositories , 2008, Electron. Libr..

[47]  John T. Stasko,et al.  Toward a Deeper Understanding of the Role of Interaction in Information Visualization , 2007, IEEE Transactions on Visualization and Computer Graphics.

[48]  L. S. Soederberg Miller,et al.  Age differences in the effects of domain knowledge on reading efficiency. , 2009, Psychology and aging.

[49]  Peter Graf,et al.  Age-related differences in the initial usability of mobile device icons , 2011, Behav. Inf. Technol..

[50]  C. Flavián,et al.  The role of satisfaction and website usability in developing customer loyalty and positive word‐of‐mouth in the e‐banking services , 2008 .

[51]  Benjamin D. Jee,et al.  The effects of domain knowledge on metacomprehension accuracy , 2009, Memory & cognition.

[52]  Daniel A. Keim,et al.  Visual Sentiment Analysis of RSS News Feeds Featuring the US Presidential Election in 2008 , 2009 .

[53]  Stephen Shaoyi Liao,et al.  Mining comparative opinions from customer reviews for Competitive Intelligence , 2011, Decis. Support Syst..

[54]  Edward Rolf Tufte,et al.  The visual display of quantitative information , 1985 .

[55]  Hong Zhou,et al.  OpinionSeer: Interactive Visualization of Hotel Customer Feedback , 2010, IEEE Transactions on Visualization and Computer Graphics.

[56]  Wooseob Jeong,et al.  Usability Study on Newspaper Mobile Web Sites , 2012, OCLC Syst. Serv..

[57]  Chui Yin Wong,et al.  Usability of user interface styles for learning a graphical software application , 2012, 2012 International Conference on Computer & Information Science (ICCIS).

[58]  L. Miller.  Age differences in the effects of domain knowledge on reading efficiency. , 2009 .

[59]  Julio J. Valdés,et al.  Finding Relevant Attributes in High Dimensional Data: A Distributed Computing Hybrid Data Mining Strategy , 2007, Trans. Rough Sets.

[60]  Ahmed Seffah,et al.  Investigating Usability Metrics for the Design and Development of Applications for the Elderly , 2008, ICCHP.

[61]  Michael Gamon,et al.  BLEWS: Using Blogs to Provide Context for News Articles , 2008, ICWSM.

[62]  H. Simon,et al.  Perception in chess , 1973 .

[63]  André Calero Valdez,et al.  Effects of Aging and Domain Knowledge on Usability in Small Screen Devices for Diabetes Patients , 2009, USAB.

[64]  L. Miller,et al.  The effects of age and domain knowledge on text processing. , 2003, The journals of gerontology. Series B, Psychological sciences and social sciences.