SEA: Segment-enrich-annotate paradigm for adapting dialog-based content for improved accessibility

While navigation within complex information spaces is a problem for all users, the problem is most evident with individuals who are blind who cannot simply locate, point, and click on a link in hypertext documents with a mouse. Users who are blind have to listen searching for the link in the document using only the keyboard and a screen reader program, which may be particularly inefficient in large documents with many links or deep hierarchies that are hard to navigate. Consequently, they are especially penalized when the information being searched is hidden under multiple layers of indirections. In this article, we introduce a segment-enrich-annotate (SEA) paradigm for adapting digital content with deep structures for improved accessibility. In particular, we instantiate and evaluate this paradigm through the iCare-Assistant, an assistive system for helping students who are blind in accessing Web and electronic course materials. Our evaluations, involving the participation of students who are blind, showed that the iCare-Assistant system, built based on the SEA paradigm, reduces the navigational overhead significantly and enables user who are blind access complex online course servers effectively.

[1]  Henry Lieberman,et al.  Letizia: An Agent That Assists Web Browsing , 1995, IJCAI.

[2]  Ron Hoz,et al.  The Tactics and Knowledge Representations Used by Blind Students in Learning from Texts , 2001 .

[3]  Victor Kaptelinin,et al.  UMEA: translating interaction histories into project contexts , 2003, CHI '03.

[4]  Divyakant Agrawal,et al.  Retrieving and organizing web pages by “information unit” , 2001, WWW '01.

[5]  Wolfgang Nejdl,et al.  Extendible Adaptive Hypermedia Courseware: Integrating Different Courses and Web Material , 2000, AH.

[6]  K. Selçuk Candan,et al.  CUTS: CUrvature-based development pattern analysis and segmentation for blogs and other Text Streams , 2006, HYPERTEXT '06.

[7]  Neel Sundaresan,et al.  A semantic transcoding system to adapt Web services for users with disabilities , 2000, Assets '00.

[8]  Alfred Kobsa,et al.  User-Oriented Adaptivity and Adaptability in the AVANTI Project , 1996 .

[9]  Giovanni Guida,et al.  User modeling in expert man-machine interfaces: a case study in intelligent information retrieval , 1990, IEEE Trans. Syst. Man Cybern..

[10]  Patricia Wright.  Cognitive overheads and prostheses: some issues in evaluating hypertexts , 1991, HYPERTEXT '91.

[11]  Diomides Markoulis.  Moral and cognitive reasoning features in cogenitally blind children: Comparisons with the sighted , 1988 .

[12]  Marshall G. Jones,et al.  Using Metacognitive Theories to Design User Interfaces for Computer-Based Learning. , 1995 .

[13]  Mitchell P. Marcus,et al.  Topic segmentation: algorithms and applications , 1998 .

[14]  Hsin-Hsi Chen,et al.  Some Similarity Computation Methods in Novelty Detection , 2002, TREC.

[15]  Ian Smith,et al.  Taking email to task: the design and evaluation of a task management centered email tool , 2003, CHI '03.

[16]  Carolyn Penstein Rosé,et al.  Topic-Segmentation of Dialogue , 2006, HLT-NAACL 2006.

[17]  Jacques Savoy.  Ranking Schemes in Hybrid Boolean Systems: A New Approach , 1997, J. Am. Soc. Inf. Sci..

[18]  Michael J. Hannafin,et al.  Empirically-based guidelines for the design of interactive multimedia , 1993 .

[19]  Pablo Castells,et al.  An Authoring Tool for Building Adaptive Learning Guidance Systems on the Web , 2001, Active Media Technology.

[20]  John D. Lafferty,et al.  Statistical Models for Text Segmentation , 1999, Machine Learning.

[21]  Peter Brusilovsky,et al.  Efficient Techniques for Adaptive Hypermedia , 1997, Intelligent Hypertext.

[22]  Monika Henzinger,et al.  Finding Related Pages in the World Wide Web , 1999, Comput. Networks.

[23]  Azadeh Shakery,et al.  Relevance Propagation for Topic Distillation UIUC TREC 2003 Web Track Experiments , 2003, TREC.

[24]  Ann Blandford,et al.  MLTutor: An Application of Machine Learning Algorithms for an Adaptive Web-based Information System , 2003, Int. J. Artif. Intell. Educ..

[25]  Thorsten Joachims,et al.  WebWatcher : A Learning Apprentice for the World Wide Web , 1995 .

[26]  Johanna D. Moore,et al.  Latent Semantic Analysis for Text Segmentation , 2001, EMNLP.

[27]  Ivan Herman,et al.  Graph Visualization and Navigation in Information Visualization: A Survey , 2000, IEEE Trans. Vis. Comput. Graph..

[28]  Bruce Krulwich,et al.  Learning user information interests through extraction of semantically significant phrases , 1996 .

[29]  Jong Wook Kim,et al.  Keyword Weight Propagation for Indexing Structured Web Content , 2006 .

[30]  Yi Zhang,et al.  Novelty and redundancy detection in adaptive filtering , 2002, SIGIR '02.

[31]  Ken Lang,et al.  NewsWeeder: Learning to Filter Netnews , 1995, ICML.

[32]  Joseph E. Beck,et al.  Adaptation of Problem Presentation and Feedback in an Intelligent Mathematics Tutor , 1996, Intelligent Tutoring Systems.

[33]  K. Selçuk Candan,et al.  Reasoning for Web document associations and its applications in site map construction , 2002, Data Knowl. Eng..

[34]  Julian J. Faraway,et al.  Practical Regression and Anova using R , 2002 .

[35]  Pattie Maes,et al.  Social information filtering: algorithms for automating “word of mouth” , 1995, CHI '95.

[36]  Patricia Deubel.  An Investigation of Behaviorist and Cognitive Approaches to Instructional Multimedia Design. , 2003 .

[37]  Jihie Kim,et al.  Towards Modeling Threaded Discussions using Induced Ontology Knowledge , 2006, AAAI.

[38]  Soumen Chakrabarti,et al.  Enhanced topic distillation using text, markup tags, and hyperlinks , 2001, SIGIR '01.

[39]  Tao Qin,et al.  Microsoft Research Asia at Web Track and Terabyte Track of TREC 2004 , 2004, TREC.

[40]  Simeon Keates,et al.  Improving Web accessibility through an enhanced open-source browser , 2005, IBM Syst. J..

[41]  K. Selçuk Candan,et al.  Structure-based Mining of Hierarchical Media Data , Meta-Data , and Ontologies , 2004 .

[42]  John S. Boreczky,et al.  Comparison of video shot boundary detection techniques , 1996, J. Electronic Imaging.

[43]  Louis Perrochon,et al.  WAB: World Wide Web access for blind and visually impaired computer users , 1996, SIGC.

[44]  Jong Wook Kim,et al.  Topic segmentation of message hierarchies for indexing and navigation support , 2005, WWW '05.

[45]  Jong Wook Kim,et al.  Annotating educational discussion boards to help students who are blind , 2007 .

[46]  Pilar Rodríguez Marín,et al.  Teaching tasks in an adaptive learning environment , 1999, HCI.

[47]  K. Selçuk Candan,et al.  Using Random Walks for Mining Web Document Associations , 2000, PAKDD.

[48]  S. Sudarshan,et al.  Bidirectional Expansion For Keyword Search on Graph Databases , 2005, VLDB.

[49]  Peter Brusilovsky,et al.  Methods and techniques of adaptive hypermedia , 1996, User Modeling and User-Adapted Interaction.

[50]  Ioannis Hatzilygeroudis.  Using a hybrid rule-based approach in developing an intelligent tutoring system with knowledge acquisition and update capabilities , 2004, Expert Syst. Appl..

[51]  K. Selçuk Candan,et al.  Discovering Web Document Associations for Web Site Summarization , 2001, WWW Posters.

[52]  Maria Luisa Sapino,et al.  Navigation Support for Students who are Blind in Accessing Discussion Boards , 2005 .

[53]  Pat Langley,et al.  User modeling in adaptive interfaces , 1999 .

[54]  Tao Qin,et al.  A study of relevance propagation for web search , 2005, SIGIR '05.

[55]  Jon Kleinberg,et al.  Authoritative sources in a hyperlinked environment , 1999, SODA '98.

[56]  Jong Wook Kim,et al.  Leveraging Structural Knowledge for Hierarchically-Informed Keyword Weight Propagation in the Web , 2006, WEBKDD.

[57]  Inderjeet Mani,et al.  Representational Issues in Machine Learning of User Profiles , 1996 .

[58]  John R. Bourne,et al.  Online Engineering Education: Learning Anywhere, Anytime , 2005, Online Learning.

[59]  Terence Cavanaugh.  The Need for Assistive Technology in Educational Technology , 2001 .

[60]  Freddy Y. Y. Choi.  Advances in domain independent linear text segmentation , 2000, ANLP.

[61]  Anthony K. Van Reusen,et al.  Cognitive and Metacognitive Interventions: Important Trends for Teachers of Students Who Are Visually Impaired. , 1994 .

[62]  Sergey Brin,et al.  The Anatomy of a Large-Scale Hypertextual Web Search Engine , 1998, Comput. Networks.

[63]  I. V. Ramakrishnan,et al.  Hearsay: enabling audio browsing on hypertext content , 2004, WWW '04.

[64]  Michael J. Pazzani,et al.  Syskill & Webert: Identifying Interesting Web Sites , 1996, AAAI/IAAI, Vol. 1.

[65]  Thorsten Brants,et al.  A System for new event detection , 2003, SIGIR.

[66]  Vicki L. Hanson,et al.  Personalization of Web browsing: adaptations to meet the needs of older adults , 2005, Universal Access in the Information Society.

[67]  Kui-Lam Kwok,et al.  TREC 2002 Web, Novelty and Filtering Track Experiments using PIRCS , 2002, TREC.

[68]  S. Sudarshan,et al.  Keyword searching and browsing in databases using BANKS , 2002, Proceedings 18th International Conference on Data Engineering.

[69]  Mario Cannataro,et al.  A Probabilistic Approach to Model Adaptive Hypermedia Systems , 2001, WebDyn@ICDT.

[70]  James Allan,et al.  Retrieval and novelty detection at the sentence level , 2003, SIGIR.

[71]  James D. Hollan.  User Modeling and User Interfaces: A Case for Domain Models, Task Models, and Tailorability , 1990, AAAI.

[72]  Umeshwar Dayal,et al.  From User Access Patterns to Dynamic Hypertext Linking , 1996, Comput. Networks.

[73]  Peter Brusilovsky,et al.  Adaptive Hypermedia , 2001, User Modeling and User-Adapted Interaction.

[74]  M. de Rijke,et al.  Towards Topic Driven Access to Full Text Documents , 2004, ECDL.

[75]  Krishna Bharat,et al.  Improved algorithms for topic distillation in a hyperlinked environment , 1998, SIGIR '98.

[76]  W. Tonn,et al.  Sampling, Density Estimation and Spatial Relationships , 1998 .

[77]  Barry Alan Feigenbaum,et al.  Accessibility requirements for systems design to accommodate users with vision impairments , 2005, IBM Syst. J..

[78]  Gerhard Fischer,et al.  User Modeling in Human–Computer Interaction , 2001, User Modeling and User-Adapted Interaction.

[79]  C. Kirchner,et al.  Who's Surfing? Internet Access and Computer Use by Visually Impaired Youths and Adults , 2001 .

[80]  Enrico Pontelli,et al.  Navigation of HTML tables, frames, and XML fragments , 2002, Assets '02.

[81]  Inderjeet Mani,et al.  Machine Learning of User Profiles: Representational Issues , 1996, AAAI/IAAI, Vol. 1.

[82]  Jon M. Kleinberg,et al.  Automatic Resource Compilation by Analyzing Hyperlink Structure and Associated Text , 1998, Comput. Networks.

[83]  Yoav Shoham,et al.  Learning Information Retrieval Agents: Experiments with Automated Web Browsing , 1995 .

[84]  John Villamil-Casanova,et al.  Interactive Guide to Multimedia , 1996 .

[85]  Peter Gregor,et al.  Are guidelines enough? An introduction to designing Web sites accessible to older people , 2005, IBM Syst. J..

[86]  Divyakant Agrawal,et al.  Query Relaxation by Structure and Semantics for Retrieval of Logical Web Documents , 2002, IEEE Trans. Knowl. Data Eng..

[87]  William W. Cohen,et al.  On the collective classification of email "speech acts" , 2005, SIGIR '05.

[88]  Bich-Liên Doan,et al.  A web page topic segmentation algorithm based on visual criteria and content layout , 2007, SIGIR.

[89]  Junji Maeda,et al.  Site-wide annotation: reconstructing existing pages to be accessible , 2002, Assets '02.

[90]  Jan-Ming Ho,et al.  Discovering informative content blocks from Web documents , 2002, KDD.

[91]  Wen-Syan Li,et al.  Constructing multi-granular and topic-focused web site maps , 2001, WWW '01.