Developing information quality assessment framework of presentation slides

Computerized presentation slides have become essential for many occasions such as business meetings, classroom discussions, multipurpose talks and public events. Given the tremendous increases in online resources and materials, locating high-quality slides relevant to a given task is often a formidable challenge, particularly when a user looks for superior quality slides. This study proposes a new, comprehensive framework for information quality (IQ) developed specifically for computerized presentation slides and explores the possibility of automatically detecting the IQ of slides. To determine slide-specific IQ criteria as well as their relative importances, we carried out a user study, involving 60 participants from two universities, and conducted extensive coding analysis. Further, we subsequently conducted a series of multiple experiments to examine the validity of the IQ features developed on the basis of the selected criteria from the user study. The study findings contribute to identifying key dimensions and related features that can improve effective IQ assessments of computerized presentation slides.

[1]  Garr Reynolds,et al.  Presentation Zen: Simple Ideas on Presentation Design and Delivery , 2008 .

[2]  Borim Ryu,et al.  Combining relevancy and methodological quality into a single ranking for evidence-based medicine , 2012, Inf. Sci..

[3]  Soo Young Rieh.  Judgment of information quality and cognitive authority in the Web , 2002, J. Assoc. Inf. Sci. Technol..

[4]  Daniel Neagu,et al.  Information Quality Framework for e-Learning Systems , 2010 .

[5]  Harold L. Pazer,et al.  A framework for analyzing the information monitoring and decision support system investment tradeoff dilemma: an application to crisis management , 1995 .

[6]  Ee-Peng Lim,et al.  Measuring article quality in wikipedia: models and evaluation , 2007, CIKM '07.

[7]  J. Fleiss.  Measuring nominal scale agreement among many raters. , 1971 .

[8]  Johnny Saldaña,et al.  The Coding Manual for Qualitative Researchers , 2009 .

[9]  Mouzhi Ge,et al.  A Review of Information Quality Research - Develop a Research Agenda , 2007, ICIQ.

[10]  Pável Calado,et al.  Exploiting user feedback to learn to rank answers in q&a forums: a case study with stack overflow , 2013, SIGIR.

[11]  Michael Alley,et al.  The Craft of Scientific Presentations: Critical Steps to Succeed and Critical Errors to Avoid , 2004 .

[12]  Weiming Hu,et al.  Quality-Based Learning for Web Data Classification , 2014, AAAI.

[13]  Oren Kurland,et al.  Using Document-Quality Measures to Predict Web-Search Effectiveness , 2013, ECIR.

[14]  W. Bruce Croft,et al.  Document quality models for web ad hoc retrieval , 2005, CIKM '05.

[15]  Soo Young Rieh,et al.  Developing a unifying framework of credibility assessment: Construct, heuristics, and interaction in context , 2008, Inf. Process. Manag..

[16]  Benno Stein,et al.  Predicting quality flaws in user-generated content: the case of wikipedia , 2012, SIGIR '12.

[17]  Linda C. Smith,et al.  A framework for information quality assessment , 2007 .

[18]  Kathryn A. Neeley,et al.  Discovering the Power of PowerPoint: Rethinking the Design of Presentation Slides from a Skillful User's Perspective , 2005 .

[19]  Christopher J. C. Burges,et al.  From RankNet to LambdaRank to LambdaMART: An Overview , 2010 .

[20]  Hang Li,et al.  A Short Introduction to Learning to Rank , 2011, IEICE Trans. Inf. Syst..

[21]  Jacob Marschak,et al.  ECONOMICS OF INFORMATION SYSTEMS , 1971 .

[22]  Diane M. Strong,et al.  Beyond Accuracy: What Data Quality Means to Data Consumers , 1996, J. Manag. Inf. Syst..

[23]  Thierry Baccino,et al.  The impact of paper-based versus computerized presentation on text comprehension and memorization , 2016, Comput. Hum. Behav..

[24]  Sally Fincher,et al.  Making sense of card sorting data , 2005, Expert Syst. J. Knowl. Eng..

[25]  Jo Mackiewicz,et al.  Perceptions of Clarity and Attractiveness in PowerPoint Graph Slides , 2007 .

[26]  Adenekan Dedeke,et al.  A Conceptual Framework for Developing Quality Measures for Information Systems , 2000, IQ.

[27]  Qiang Wu,et al.  Adapting boosting for information retrieval measures , 2010, Information Retrieval.

[28]  Daniel Neagu,et al.  Assessing information quality of e-learning systems: a web mining approach , 2011, Comput. Hum. Behav..

[29]  Donald P. Ballou,et al.  Designing Information Systems to Optimize the Accuracy-Timeliness Tradeoff , 1995, Inf. Syst. Res..

[30]  Tie-Yan Liu,et al.  Learning to Rank for Information Retrieval , 2011 .

[31]  Thomas Mandl,et al.  Implementation and evaluation of a quality-based search engine , 2006, HYPERTEXT '06.

[32]  Judit Bar-Ilan,et al.  Information quality assessment of community generated content: A user study of Wikipedia , 2011, J. Inf. Sci..

[33]  Jaana Kekäläinen,et al.  Cumulated gain-based evaluation of IR techniques , 2002, TOIS.

[34]  Klaus Berberich,et al.  Improving local search ranking through external logs , 2011, SIGIR.

[35]  Jae-Gil Lee,et al.  Quality-Based Automatic Classification for Presentation Slides , 2014, ECIR.

[36]  Eric Brill,et al.  Beyond PageRank: machine learning for static ranking , 2006, WWW '06.

[37]  Pável Calado,et al.  Automatic quality assessment of content created collaboratively by web communities: a case study of wikipedia , 2009, JCDL '09.

[38]  Tie-Yan Liu.  Learning to Rank for Information Retrieval , 2009, Found. Trends Inf. Retr..

[39]  Hang Li,et al.  AdaRank: a boosting algorithm for information retrieval , 2007, SIGIR.

[40]  W. Bruce Croft,et al.  Quality-biased ranking of web documents , 2011, WSDM '11.

[41]  Matthew B. Miles,et al.  Qualitative Data Analysis: An Expanded Sourcebook , 1994 .

[42]  Les Gasser,et al.  Information quality work organization in wikipedia , 2008, J. Assoc. Inf. Sci. Technol..