Empirical Refinement of a Semiotic Information Quality Framework

This paper presents the refinement of a semiotic information quality framework based on the analysis of practitioner and academic focus group feedback. The initial information quality framework was developed to address the question of what criteria should be used to define and assess quality. Semiotic theory, the philosophical theory of signs, provided a theoretical foundation for defining the framework structure (i.e. quality categories and their criteria) and for integrating objective, product-based and subjective, service-based quality perspectives, thus addressing problems observed in other proposed quality schemes with respect to scope and inconsistency. Following on from the initial theoretical work, empirical methods were used to refine the framework, especially the subjective components related to consumer quality perceptions. Specifically, focus group feedback served to (1) further clarify the scope and boundaries of the research and (2) to identify inter-dependencies, ambiguities, and gaps in the initial set of quality criteria.

[1]  Amanda Spink,et al.  Human-computer interaction in information retrieval: nature and manifestations of feedback , 1998, Interact. Comput..

[2]  Adir Even,et al.  Value-Driven Data Quality Assessment , 2005, ICIQ.

[3]  Graeme Shanks,et al.  Next Steps in Understanding Information Quality and Its Effect on Decision Making and Organisational Effectiveness , 2004 .

[4]  Pertti Vakkari,et al.  The influence of relevance levels on the effectiveness of interactive information retrieval , 2004, J. Assoc. Inf. Sci. Technol..

[5]  Sue Lacey Bryant,et al.  The information needs and information seeking behaviour of family doctors: a selective literature review , 2000 .

[6]  Martin J. Eppler,et al.  Measuring Information Quality in the Web Context: A Survey of State-of-the-Art Instruments and an Application Methodology , 2002, ICIQ.

[7]  Shan-Ju L. Chang,et al.  Conceptualizing context and its relationship to the information behaviour in dissertation research process , 2001 .

[8]  Graeme G. Shanks,et al.  Understanding Data Quality in a Data Warehouse , 1998, Aust. Comput. J..

[9]  Graeme G. Shanks,et al.  A semiotic information quality framework: development and comparative analysis , 2005, J. Inf. Technol..

[10]  Ruth A. Palmquist.  The Search for an Internet Metaphor: A Comparison of Literatures. , 1996 .

[11]  Thomas D. Wilson,et al.  Exploring models of information behaviour: the 'uncertainty' project , 1999, Inf. Process. Manag..

[12]  Barbara D. Klein.  WHEN DO USERS DETECT INFORMATION QUALITY PROBLEMS ON THE WORLD WIDE WEB , 2002 .

[13]  R. Stamper.  The Semiotic Framework for Information Systems Research , 1990 .

[14]  Richard Y. Wang,et al.  What Skills Matter in Data Quality? , 2002, ICIQ.

[15]  Hareton K. N. Leung,et al.  Quality metrics for intranet applications , 2001, Inf. Manag..

[16]  Robert S. Taylor.  Value-Added Processes in the Information Life Cycle , 1982, J. Am. Soc. Inf. Sci..

[17]  Martin J. Eppler,et al.  Conceptualizing Information Quality: A Review of Information Quality Frameworks from the Last Ten Years , 2000, IQ.

[18]  Adenekan Dedeke,et al.  A Conceptual Framework for Developing Quality Measures for Information Systems , 2000, IQ.

[19]  Mario Piattini,et al.  Comparing different quality models for portals , 2006, Online Inf. Rev..

[20]  M. Peterson,et al.  An evaluation of the quality and contents of asthma education on the World Wide Web. , 2002, Chest.

[21]  S. Värlander.  Online information quality in experiential consumption: An exploratory study , 2007 .

[22]  Rita Kovac,et al.  Starting with Quality: Using TDQM in a Start-Up Organization , 2002, ICIQ.

[23]  Elaine Toms,et al.  Information interaction: Providing a framework for information architecture , 2002, J. Assoc. Inf. Sci. Technol..

[24]  Leo Pipino,et al.  Factors affecting the assessment of web site quality , 2001, ECIS.

[25]  Paul Sturges,et al.  The Archaeologist Undeceived: Selecting Quality Archaeological Information from the Internet , 2003, Informing Sci. Int. J. an Emerg. Transdiscipl..

[26]  M. Pamela Neely.  The Product Approach to Data Quality and Fitness for Use: A Framework for Analysis , 2005, ICIQ.

[27]  P. Mouncey.  Improving Data Warehouse and Business Information Quality , 2001 .

[28]  Ross Wilkinson,et al.  Using clustering and classification approaches in interactive retrieval , 2001, Inf. Process. Manag..

[29]  Diane M. Strong,et al.  AIMQ: a methodology for information quality assessment , 2002, Inf. Manag..

[30]  Diane M. Strong,et al.  10 Potholes in the Road to Information Quality , 1997, Computer.

[31]  G. L..  Collected Papers , 1912, Nature.

[32]  John Krogstie,et al.  Defining quality aspects for conceptual models , 1995, ISCO.

[33]  Jarkko Kari,et al.  User-defined relevance criteria in web searching , 2006, J. Documentation.

[34]  Prashant C. Palvia,et al.  Developing and validating an instrument for measuring user-perceived web quality , 2002, Inf. Manag..

[35]  Diane M. Strong,et al.  Information quality benchmarks: product and service performance , 2002, CACM.

[36]  Robert J. Gaizauskas,et al.  Coupling information retrieval and information extraction: A new text technology for gathering information from the web , 1997, RIAO.

[37]  P. R. H. Hendriks,et al.  Specifying software quality with the extended ISO model , 1996, Software Quality Journal.

[38]  Raman Chandrasekar,et al.  Do thumbnail previews help users make better relevance decisions about web search results? , 2002, SIGIR '02.

[39]  R. P. Srivastava,et al.  A conceptual framework and belief‐function approach to assessing overall information quality , 2003, Int. J. Intell. Syst..

[40]  Raya Fidel,et al.  A multidimensional approach to the study of human-information interaction: A case study of collaborative information retrieval , 2004, J. Assoc. Inf. Sci. Technol..

[41]  Richard Y. Wang,et al.  Anchoring data quality dimensions in ontological foundations , 1996, CACM.

[42]  Soo Young Rieh.  Information quality and cognitive authority in the World Wide Web , 2001 .

[43]  Stephanie Watts,et al.  A Relevant, Believable Approach for Data Quality Assessment , 2003, ICIQ.

[44]  Marcia J. Bates,et al.  The cascade of interactions in the digital library interface , 2002, Inf. Process. Manag..

[45]  John M. Budd,et al.  Phenomenology and information studies , 2005, J. Documentation.

[46]  Elaine Toms,et al.  Measuring the reputation of web sites: a preliminary exploration , 2001, JCDL '01.

[47]  Binshan Lin,et al.  Accessing information sharing and information quality in supply chain management , 2006, Decis. Support Syst..

[48]  Diane M. Strong,et al.  Data quality in context , 1997, CACM.

[49]  Christina Goulding,et al.  Grounded theory, ethnography and phenomenology: A comparative analysis of three qualitative strategies for marketing research , 2005 .

[50]  Ethelene Whitmire,et al.  The relationship between undergraduates' epistemological beliefs, reflective judgment, and their information-seeking behavior , 2004, Inf. Process. Manag..

[51]  Peter Ingwersen,et al.  Dimensions of relevance , 2000, Inf. Process. Manag..

[52]  Liping Liu,et al.  Evolutional Data Quality: A Theory-Specific View , 2002, ICIQ.

[53]  V. Vroom.  Work and motivation , 1964 .

[54]  Joemon M. Jose,et al.  Searchers' criteria For assessing web pages , 2003, SIGIR '03.

[55]  I-Chiu Chang,et al.  An empirical study on the impact of quality antecedents on tax payers' acceptance of Internet tax-filing systems , 2005, Government Information Quarterly.

[56]  Younghwa Lee,et al.  The Technology Acceptance Model: Past, Present, and Future , 2003, Commun. Assoc. Inf. Syst..

[57]  Les Gasser,et al.  Assessing Information Quality of a Community-Based Encyclopedia , 2005, ICIQ.

[58]  Peter Hernon,et al.  Information life cycle: Its place in the management of U.S. government information resources , 1994 .

[59]  R. Stamper.  The semiotic framework for informations systems research , 1991 .

[60]  Felix Naumann,et al.  Assessment Methods for Information Quality Criteria , 2000, IQ.

[61]  Helena Forslund,et al.  Measuring information quality in the order fulfilment process , 2007 .

[62]  D. T. Hawkins.  What is credible information , 1999 .

[63]  Diane M. Strong,et al.  A Model for Delivering Quality Information as Product and Service , 1997, IQ.

[64]  Graeme Shanks,et al.  A Semiotic Information Quality Framework , 2004 .

[65]  Barbara D. Klein.  User Perceptions of Data Quality: Internet and Traditional Text Sources , 2001, J. Comput. Inf. Syst..

[66]  Christine Marton.  Quality of health information on the Web: user perceptions of relevance and reliability , 2003 .

[67]  Jaeki Song,et al.  Trust in health infomediaries , 2007, Decis. Support Syst..

[68]  Susan Gauch,et al.  Incorporating quality metrics in centralized/distributed information retrieval on the World Wide Web , 2000, SIGIR '00.

[69]  John Krogstie,et al.  A Semiotic Approach to Quality in Requirements Specifications , 2001, Organizational Semiotics.

[70]  Terrence A. Brooks,et al.  Web search: how the Web has changed information retrieval , 2003, Information Research.

[71]  Michael B. Eisenberg,et al.  A re-examination of relevance: toward a dynamic, situational definition , 1990, Inf. Process. Manag..

[72]  Giri Kumar Tayi,et al.  Examining data quality , 1998, CACM.

[73]  Diane M. Strong,et al.  Beyond Accuracy: What Data Quality Means to Data Consumers , 1996, J. Manag. Inf. Syst..

[74]  Elaine Toms,et al.  Searching for Relevance in the Relevance of Search , 2005, CoLIS.

[75]  Marcia J. Bates,et al.  The design of browsing and berrypicking techniques for the online search interface , 1989 .

[76]  Lynn Silipigni Connaway,et al.  What is enough? Satisficing information needs , 2007, J. Documentation.

[77]  Anne Morris,et al.  Web Wisdom: How to Evaluate and Create Information Quality on the Web , 2000 .

[78]  Shirlee-ann Knight,et al.  User perceptions of information quality in world wide web information retrieval behaviour , 2007 .

[79]  Keng Siau,et al.  Measuring information quality of web sites: development of an instrument , 1999, ICIS.

[80]  Barbara Pernici,et al.  IP-UML: Towards a Methodology for Quality Improvement Based on the IP-MAP Framework , 2002, ICIQ.