Can search result summaries enhance the web search efficiency and experiences of the visually impaired users?

There are limited studies that are addressing the challenges of visually impaired (VI) users when viewing search results on a search engine interface by using a screen reader. This study investigates the effect of providing an overview of search results to VI users. We present a novel interactive search engine interface called InteractSE to support VI users during the results exploration stage in order to improve their interactive experience and web search efficiency. An overview of the search results is generated using an unsupervised machine learning approach to present the discovered concepts via a formal concept analysis that is domain-independent. These concepts are arranged in a multi-level tree following a hierarchical order and covering all retrieved documents that share maximal features. The InteractSE interface was evaluated by 16 legally blind users and compared with the Google search engine interface for complex search tasks. The evaluation results were obtained based on both quantitative (as task completion time) and qualitative (as participants’ feedback) measures. These results are promising and indicate that InteractSE enhances the search efficiency and consequently advances user experience. Our observations and analysis of the user interactions and feedback yielded design suggestions to support VI users when exploring and interacting with search results.

[1]  I. V. Ramakrishnan,et al.  Capti-speak: a speech-enabled web screen reader , 2015, W4A.

[2]  Gary Marchionini.  Information-seeking strategies of novices using a full-text electronic encyclopedia , 1989 .

[3]  Ruoyuan Gao,et al.  Toward creating a fairer ranking in search engine results , 2020, Inf. Process. Manag..

[4]  James R. Lewis.  Psychometric Evaluation of the PSSUQ Using Data from Five Years of Usability Studies , 2002 .

[5]  J. Creswell.  Revisiting Mixed Methods and Advancing Scientific Practices , 2015 .

[6]  Chirag Shah,et al.  Interactive IR User Study Design, Evaluation, and Reporting , 2019, Interactive IR User Study Design, Evaluation, and Reporting.

[7]  Meredith Ringel Morris,et al.  Accessible Information Seeking , 2020, CHIIR.

[8]  Rudolf Wille,et al.  Formal Concept Analysis as Mathematical Theory of Concepts and Concept Hierarchies , 2005, Formal Concept Analysis.

[9]  Gary Marchionini,et al.  Information Seeking in Electronic Environments , 1995 .

[10]  Chirag Shah,et al.  "Implicit search feature based approach to assist users in exploratory search tasks" by Chathra Hendahewa, with Prateek Jainas as coordinator , 2015, Inf. Process. Manag..

[11]  H. Beyer.  Tukey, John W.: Exploratory Data Analysis. Addison‐Wesley Publishing Company Reading, Mass. — Menlo Park, Cal., London, Amsterdam, Don Mills, Ontario, Sydney 1977, XVI, 688 S. , 1981 .

[12]  Gary Marchionini.  Search, sense making and learning: closing gaps , 2019 .

[13]  Tony Stockman,et al.  Evaluating a search interface for visually impaired searchers , 2015, J. Assoc. Inf. Sci. Technol..

[14]  S. Sawilowsky.  New Effect Size Rules of Thumb , 2009 .

[15]  Susan T. Dumais,et al.  Understanding User Behavior Through Log Data and Analysis , 2014, Ways of Knowing in HCI.

[16]  Ryen W. White,et al.  Task tours: helping users tackle complex search tasks , 2012, CIKM.

[17]  Melody Y. Ivory,et al.  Search result exploration: a preliminary study of blind and sighted users' decision making and performance , 2004, CHI EA '04.

[18]  Ryen W. White,et al.  Characterizing the influence of domain expertise on web search behavior , 2009, WSDM '09.

[19]  Iris Xie,et al.  Enhancing usability of digital libraries: Designing help features to support blind and visually impaired users , 2020, Inf. Process. Manag..

[20]  Ben Shneiderman,et al.  Users can change their web search tactics: Design guidelines for categorized overviews , 2008, Inf. Process. Manag..

[21]  Ali Jaoua,et al.  Automatic Entity Extraction From an N-Ary Relation: Toward a General Law for Information Decomposition , 1995, Inf. Sci..

[22]  Neville A. Stanton,et al.  Human Factors Methods , 2013 .

[23]  Tony Stockman,et al.  A comparative analysis of the information-seeking behavior of visually impaired and sighted searchers , 2012, J. Assoc. Inf. Sci. Technol..

[24]  Barbara Leporini,et al.  Evaluating a modified Google user interface via screen reader , 2007, Universal Access in the Information Society.

[25]  James R. Lewis,et al.  IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use , 1995, Int. J. Hum. Comput. Interact..

[26]  M. F. Porter,et al.  An algorithm for suffix stripping , 1997 .

[27]  Bernhard Ganter,et al.  Formal Concept Analysis: Mathematical Foundations , 1998 .

[28]  Faris Alqadah,et al.  Biclustering neighborhood-based collaborative filtering method for top-n recommender systems , 2015, Knowledge and Information Systems.

[29]  Tetsuya Sakai,et al.  Statistical Significance, Power, and Sample Sizes: A Systematic Review of SIGIR and TOIS, 2006-2015 , 2016, SIGIR.

[30]  Richard E. Ladner,et al.  WebinSitu: a comparative analysis of blind and sighted browsing behavior , 2007, Assets '07.

[31]  Carol Collier Kuhlthau.  Inside the Search Process: Information Seeking from the User's Perspective. , 1991 .

[32]  A. Strauss,et al.  Grounded theory , 2017 .

[33]  Barbara Leporini,et al.  Designing search engine user interfaces for the visually impaired , 2003, W4A '04.

[34]  Marouane Kessentini,et al.  Web Service Interface Decomposition Using Formal Concept Analysis , 2017, 2017 IEEE International Conference on Web Services (ICWS).

[35]  Carol Peters,et al.  Interaction and User Interfaces , 2012 .

[36]  Ryen W. White,et al.  Exploratory Search: Beyond the Query-Response Paradigm , 2009, Exploratory Search: Beyond the Query-Response Paradigm.

[37]  Anastasios Tombros,et al.  The Effects of Cross-modal Collaboration on the Stages of Information Seeking , 2015, Interacción.

[38]  Tony Stockman,et al.  Evaluating an Interface for Cross-Modal Collaborative Information Seeking , 2018, Interact. Comput..

[39]  Felix Naumann,et al.  Data fusion , 2009, CSUR.

[40]  Haithem Mezni,et al.  Reusing process fragments for fast service composition: a clustering-based approach , 2019, Enterp. Inf. Syst..

[41]  Kirsty Williamson,et al.  Information behavior of people in the fourth age: Implications for the conceptualization of information literacy , 2009 .

[42]  Ali Jaoua,et al.  Analyze Unstructured Data Patterns for Conceptual Representation , 2017, 2017 International Conference on Computational Science and Computational Intelligence (CSCI).

[43]  Charles Oppenheim,et al.  Access to information on the World Wide Web for blind and visually impaired people , 1999 .

[44]  Marcia J. Bates,et al.  The design of browsing and berrypicking techniques for the online search interface , 1989 .

[45]  G. A. Miller.  THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[46]  Gerd Berget,et al.  What Is Known About the Impact of Impairments on Information Seeking and Searching? , 2020, J. Assoc. Inf. Sci. Technol..

[47]  Ryen W. White,et al.  Supporting Complex Search Tasks , 2014, CIKM.

[48]  Fadi Biadsy,et al.  JustSpeak: enabling universal voice control on Android , 2014, W4A.

[49]  Ryen W. White,et al.  Bridging Screen Readers and Voice Assistants for Enhanced Eyes-Free Web Search , 2019, WWW.

[50]  Ali Jaoua,et al.  Using Formal Concept Analysis for Heterogeneous Information Retrieval , 2005, CLA.

[51]  T. C. Beinema,et al.  Developing a Web Search Interface for the Visually Impaired , 2017 .

[52]  Muhammad Rafiq Mufti,et al.  An Audible Search Engine for Visually Impaired Users: A Prototype Developed using Assistive Technology , 2015 .

[53]  Ben Shneiderman,et al.  Clarifying Search: A User-Interface Framework for Text Searches , 1997, D Lib Mag..

[54]  Dwight P. Miller.  The Depth/Breadth Tradeoff in Hierarchical Computer Menus , 1981 .

[55]  Dawid Weiss,et al.  A survey of Web clustering engines , 2009, CSUR.

[56]  Dorothy Williams,et al.  Towards a conceptual framework for provider information behaviour , 2013, J. Documentation.

[57]  Sheue-Ling Hwang,et al.  An improved Web search engine for visually impaired users , 2011, Universal Access in the Information Society.

[58]  Barbara Leporini,et al.  Improving search engine interfaces for blind users: a case study , 2006, Universal Access in the Information Society.

[59]  Vincenzo Loia,et al.  Hierarchical web resources retrieval by exploiting Fuzzy Formal Concept Analysis , 2012, Inf. Process. Manag..

[60]  Ali Jaoua,et al.  Conceptual Interactive Search Engine Interface for Visually Impaired Web Users , 2018, 2018 IEEE/ACS 15th International Conference on Computer Systems and Applications (AICCSA).

[61]  Diane Kelly,et al.  Methods for Evaluating Interactive Information Retrieval Systems with Users , 2009, Found. Trends Inf. Retr..

[62]  Ali Jaoua,et al.  Text Summarization Based on Conceptual Data Classification , 2006, Int. J. Inf. Technol. Web Eng..

[63]  I. V. Ramakrishnan,et al.  Web Screen Reading Automation Assistance Using Semantic Abstraction , 2017, IUI.

[64]  Aaron Allen,et al.  What Frustrates Screen Reader Users on the Web: A Study of 100 Blind Users , 2007, Int. J. Hum. Comput. Interact..

[65]  Luciano Gamberini,et al.  Overlaying social information: The effects on users' search and information-selection behavior , 2017, Inf. Process. Manag..

[66]  Gary Marchionini,et al.  Exploratory search , 2006, Commun. ACM.

[67]  Reem Bahgat,et al.  PREFCA: A portal retrieval engine based on formal concept analysis , 2017, Inf. Process. Manag..

[68]  Dena Al-Thani,et al.  Accessibility or Usability of InteractSE? A Heuristic Based Approach to Evaluate Proposed Search Engine for the Visually Impaired Users , 2018, ArXiv.

[69]  R. Wille.  Concept lattices and conceptual knowledge systems , 1992 .

[70]  Marti A. Hearst.  Search User Interfaces , 2009 .

[71]  Guy H. Walker,et al.  Human Factors Methods Integration: A Case Study in the Railway Industry , 2017 .