SADIe: Structural semantics for accessibility and device independence

Visually impaired users are hindered in their efforts to access the largest repository of electronic information in the world, namely, the World Wide Web (web). A visually impaired user's information and presentation requirements are different from a sighted user's. These requirements can become problems in that the web is visually centric with regard to presentation and information order/layout. Finding semantic information already encoded directly into documents can help to alleviate these problems. Our approach can be loosely described as follows. For a particular cascading stylesheet (CSS), we provide an extension to an upper-level ontology which represents the interface between web documents and the programmatic transformation mechanism. This extension gives the particular characteristics of the elements appearing in that specific CSS. We can consider this extension to be an annotation of the CSS elements implicitly encoded into the web document. This means that one ontology can be used to accuratly transform every web document that references the CSS used to generate that ontology. Simply one ontology accuratly transforms an entire site using a generalized programmatic machinery able to cope with all sites using CSS. Here we describe our method, implementation, and technical evaluation.

[1]  Andres Gonzalez,et al.  Platform-independent accessibility API: accessible document object model , 2005, W4A '05.

[2]  David R. Karger,et al.  Piggy Bank: Experience the Semantic Web inside your web browser , 2005, J. Web Semant..

[3]  Junji Maeda,et al.  Accessibility designer: visualizing usability for the blind , 2004, Assets '04.

[4]  Timo Laakko,et al.  Two approaches to bringing Internet services to WAP devices , 2000, Comput. Networks.

[5]  Carole A. Goble,et al.  DANTE: annotation and transformation of web pages for visually impaired users , 2004, WWW Alt. '04.

[6]  Stephen J. H. Yang,et al.  Enhancing pervasive Web accessibility with rule-based adaptation strategy , 2007, Expert Syst. Appl..

[7]  Gail E. Kaiser,et al.  DOM-based content extraction of HTML documents , 2003, WWW '03.

[8]  Barbara Leporini,et al.  Improving search engine interfaces for blind users: a case study , 2006, Universal Access in the Information Society.

[9]  Kyong-Ho Lee,et al.  Device-independent web browsing based on CC/PP and annotation , 2006, Interact. Comput..

[10]  Paul Crichton Towards total inclusion , 2005 .

[11]  Carole A. Goble,et al.  Traversing the Web: mobility heuristics for visually impaired surfers , 2003, Proceedings of the Fourth International Conference on Web Information Systems Engineering, 2003. WISE 2003..

[12]  Thomas R. Gruber,et al.  A translation approach to portable ontology specifications , 1993, Knowl. Acquis..

[13]  G. A. Miller THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[14]  Peter J. Nürnberg,et al.  Towards a structural diversity space , 2004, HYPERTEXT '04.

[15]  R. G. Stone,et al.  Proving the validity and accessibility of dynamic web-pages , 2003, W4A '04.

[16]  Vicki L. Hanson,et al.  From assistive technology to a web accessibility service , 2002, Assets '02.

[17]  Matthew T. Atkinson,et al.  Opening up access to online documents using essentiality tracks , 2006, W4A '06.

[18]  Frank van Harmelen,et al.  A semantic web primer , 2004 .

[19]  Frank M. Shipman,et al.  Hypertext paths and the World-Wide Web: experiences with Walden's Paths , 1997, HYPERTEXT '97.

[20]  John R. Smith,et al.  Transcoding Internet content for heterogeneous client devices , 1998, ISCAS '98. Proceedings of the 1998 IEEE International Symposium on Circuits and Systems (Cat. No.98CH36187).

[21]  Bambang Parmanto,et al.  AcceSS: accessibility through simplification & summarization , 2005, W4A '05.

[22]  David Sloan,et al.  Forcing standardization or accommodating diversity?: a framework for applying the WCAG in the real world , 2005, W4A '05.

[23]  Carole A. Goble,et al.  proXimity: Walking the Link , 2004, J. Digit. Inf..

[24]  Carole A. Goble,et al.  Screen Readers Cannot See Ontology Based Semantic Annotation for Visually Impaired Web Travellers , 2004 .

[25]  Steffen Staab,et al.  Unveiling the hidden bride: deep annotation for mapping and migrating legacy data to the Semantic Web , 2004, J. Web Semant..

[26]  Frankie James Presenting HTML Structure in Audio: User Satisfaction with Audio Hypertext , 1998 .

[27]  John R. Smith,et al.  Content-based transcoding of images in the Internet , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[28]  Simon Harper,et al.  A Travel Flow and Mobility Framework for Visually Impaired Travellers , 2000 .

[29]  Shawn Lawton Henry,et al.  Interdependent components of web accessibility , 2005, W4A '05.

[30]  Siu-Tsen Shen,et al.  Towards culture-centred design , 2006, Interact. Comput..

[31]  Darren Lunn SADIe: Structural-Semantics for Accessibility and Device Independence , 2005 .

[32]  Tohru Ifukube,et al.  Maximum listening speeds for the blind , 2003 .

[33]  Paolo Tonella,et al.  Web application transformations based on rewrite rules , 2002, Inf. Softw. Technol..

[34]  Murray Altheim Augmented Metadata in XHTML , 2001 .

[35]  Simon Harper,et al.  An Integrating Framework for Electronic Aids to Support Journeys by Visually Impaired People , 2000 .

[36]  Junji Maeda,et al.  WebDigest: layout-preserving visually enhanced Web pages , 2003, 2003 Symposium on Applications and the Internet, 2003. Proceedings..

[37]  Tom Negrino,et al.  JavaScript for the World Wide Web: Visual QuickStart Guide , 1999 .

[38]  Paul P. Maglio,et al.  Intermediaries: An Approach to Manipulating Information Streams , 1999, IBM Syst. J..

[39]  Jason Cranford Teague,et al.  DHTML and CSS for the World Wide Web : Visual QuickStart Guide , 2001 .

[40]  Stefan Wermter,et al.  Emergent Neural Computational Architectures Based on Neuroscience , 2001, Lecture Notes in Computer Science.

[41]  Brian King,et al.  Creating Applications with Mozilla , 2002 .

[42]  Yeliz Yesilada,et al.  Workshop Report: W4A—International Cross Disciplinary Workshop on Web Accessibility 2004 , 2003, SIGC.

[43]  Andreas Paepcke,et al.  Power browser: efficient Web browsing for PDAs , 2000, CHI.

[44]  Demetrios G. Sampson,et al.  Designing learning systems to provide accessible services , 2005, W4A '05.

[45]  Paul Bohman,et al.  An accessible method of hiding HTML content , 2003, W4A '04.

[46]  Neel Sundaresan,et al.  A semantic transcoding system to adapt Web services for users with disabilities , 2000, Assets '00.

[47]  Derek J. Hatley,et al.  Process for System Architecture and Requirements Engineering , 2000 .

[48]  Tantek Çelik,et al.  Microformats: a pragmatic path to the semantic web , 2006, WWW '06.

[49]  Marja-Riitta Koivunen,et al.  Annotea: an open RDF infrastructure for shared Web annotations , 2001, WWW '01.

[50]  Vicki L. Hanson The user experience: designs and adaptations , 2003, W4A '04.

[51]  C. Goble,et al.  Mobility Support for Visually Impaired Web Travellers End of Second Year Interview Report , 2003 .

[52]  Barbara Leporini,et al.  Designing search engine user interfaces for the visually impaired , 2003, W4A '04.

[53]  Lightweight Mark-Up for Low Cost Semantics , 2004 .

[54]  Mark Pilgrim Dive Into Accessibility , 2004 .

[55]  Brian Layzell What can be done to help the disabled?Free computers? , 2005 .

[56]  Jens Riegelsberger,et al.  Could I have the Menu Please? An Eye Tracking Study of Design Conventions , 2004 .

[57]  L. Carr,et al.  COHSE: informed WWW link navigation using ontologys , 1999 .

[58]  Michael Howard Kay XSLT 2.0 Programmer's Reference , 2004 .

[59]  Paul Bohman,et al.  A conceptual framework for accessibility tools to benefit users with cognitive disabilities , 2005, W4A '05.

[60]  Enrico Pontelli,et al.  Navigation of HTML tables, frames, and XML fragments , 2002, Assets '02.

[61]  Masahiro Hori,et al.  Extensible Framework of Authoring Tools for Web Document Annotation , 2002 .

[62]  Lequan Min The universality and emergent computation in cellular neural networks , 2003, IEEE Circuits and Systems Magazine.

[63]  Tiziana Catarci,et al.  A no-frills approach for accessible Web-based learning material , 2003, W4A '04.

[64]  Vicki L. Hanson,et al.  Web accessibility: a broader view , 2004, WWW '04.

[65]  Gregg C. Vanderheiden,et al.  Web Content Accessibility Guidelines 1.0 W3C DRAFT Proposed Recommendation , 1999 .

[66]  Mari Abe,et al.  Robust pointing by XPath language: authoring support and empirical evaluation , 2003, 2003 Symposium on Applications and the Internet, 2003. Proceedings..

[67]  Aude Dufresne,et al.  Touching and hearing GUI's: design issues for the PC-Access system , 1996, Assets '96.

[68]  Wee Sun Lee,et al.  Using link analysis to improve layout on mobile devices , 2004, WWW '04.

[69]  Paul P. Maglio,et al.  Intermediaries personalize information streams , 2000, CACM.

[70]  Simon Harper,et al.  Metrics of Visual Complexity , 2005 .

[71]  Gregg C. Vanderheiden,et al.  Web content accessibility guidelines 1.0 , 2001, INTR.

[72]  Gregg C. Vanderheiden,et al.  Core Techniques for Web Content Accessibility Guidelines 1.0 , 2000 .

[73]  Sukil Kim,et al.  An active step toward a web content accessible society , 2005, W4A '05.

[74]  Ben Shneiderman,et al.  An exploratory evaluation of three interfaces for browsing large hierarchical tables of contents , 1994, TOIS.

[75]  Eric Miller,et al.  An Introduction to the Resource Description Framework , 1998, D Lib Mag..

[76]  Jihong Kim,et al.  WebAlchemist: a Web transcoding system for mobile Web access in handheld devices , 2001, SPIE ITCom.

[77]  Bob Regan Accessibility and design: a failure of the imagination , 2003, W4A '04.

[78]  Carole A. Goble,et al.  A foundation for tool based mobility support for visually impaired web users , 2003, WWW '03.

[79]  Wendy Hall,et al.  Conceptual linking: ontology-based open hypermedia , 2001, WWW '01.

[80]  Carole A. Goble,et al.  Towel: Experiences of Augmenting the Web with Journey Knowledge , 2003, WWW.

[81]  Chaomei Chen Structuring and visualising the WWW by generalised similarity analysis , 1997, HYPERTEXT '97.

[82]  Athanasios Manitsaris,et al.  Semantically enhanced browsing for blind people in the WWW , 2005, HYPERTEXT '05.

[83]  Andreas Girgensohn,et al.  Web Page Filtering and Re-Authoring for Mobile Users , 1999, Comput. J..

[84]  Carole A. Goble,et al.  proXimity: Ad-Hoc Networks for Enhanced Mobility , 2004, ICCHP.

[85]  Dan Suciu,et al.  Data on the Web: From Relations to Semistructured Data and XML , 1999 .

[86]  Lloyd Rutledge,et al.  Hypermedia and the Semantic Web: A Research Agenda , 2001, J. Digit. Inf..

[87]  Carl Gutwin,et al.  Interacting with Big Interfaces on Small Screens: a Comparison of Fisheye, Zoom, and Panning Techniques , 2004, Graphics Interface.

[88]  Ian Horrocks,et al.  OWL Web Ontology Language Reference-W3C Recommen-dation , 2004 .

[89]  Yeliz Yesilada,et al.  Ontology Based Semantic Annotation for Enhancing Mobility Support for Visually Impaired Web Users , 2003 .

[90]  Carole A. Goble,et al.  Web Mobility Guidelines for Visually Impaired Surfers , 2001, J. Res. Pract. Inf. Technol..

[91]  Peter J. Nürnberg,et al.  Multiple open services: a new approach to service provision in open hypermedia systems , 2001, HYPERTEXT '01.

[92]  Minsu Jang,et al.  Web Content Adaptation and Transcoding Based on CC/PP and Semantic Templates , 2003, WWW.

[93]  Earl Johnson,et al.  Toward accessible human-computer interaction , 1995 .

[94]  Tom Negrino,et al.  JavaScript for the World Wide Web , 1997 .

[95]  Junji Maeda,et al.  Site-wide annotation: reconstructing existing pages to be accessible , 2002, Assets '02.

[96]  Helen Petrie,et al.  Tension, what tension?: Website accessibility and visual design , 2003, W4A '04.

[97]  P. Blenkhorn,et al.  WebbIE : a Web Browser for Visually Impaired People , 2004 .

[98]  Robert Stevens,et al.  A pilot study to examine the mobility problems of visually impaired users travelling the web , 2000, SIGC.

[99]  Christos Bouras,et al.  A web content manipulation technique based on page Fragmentation , 2007, J. Netw. Comput. Appl..

[100]  Nikunj P. Dalal,et al.  Cognitive design of home pages: an experimental study of comprehension on the World Wide Web , 2000, Inf. Process. Manag..

[101]  Ben Shneiderman,et al.  The Psychology of Menu Selection: Designing Cognitive Control at the Human/Computer Interface , 1991 .

[102]  Steffen Staab,et al.  On deep annotation , 2003, WWW '03.

[103]  Sean Bechhofer,et al.  Semantic triage for increased Web accessibility , 2005, IBM Syst. J..

[104]  D. Flannanghan JavaScript: The definitive guide , 1999 .

[105]  Peter J. Nürnberg What is hypertext? , 2003, UK Conference on Hypertext.

[106]  not Cwi,et al.  XHTML™ 1.0 The Extensible HyperText Markup Language , 2002 .

[107]  Paolo Tonella,et al.  Restructuring Web applications via transformation rules , 2001, Proceedings First IEEE International Workshop on Source Code Analysis and Manipulation.

[108]  Tim Berners-Lee,et al.  Weaving The Web: The Original Design And Ultimate Destiny of the World Wide Web , 1999 .

[109]  José M. Vidal,et al.  Cascading style sheets , 1997, World Wide Web J..

[110]  Radhika Nagpal,et al.  Engineering Self-Organising Systems: methodologies and Applications , 2005 .

[111]  Jef Raskin The humane interface (book excerpt) , 2000, UBIQ.

[112]  Bill Kennedy,et al.  HTML and XHTML: The Definitive Guide , 2002 .

[113]  Carlos A. Velasco,et al.  Raising awareness among designers accessibility issues , 2001, SIGC.

[114]  Peter Gregor,et al.  Accessible accessibility , 2000, CUU '00.

[115]  Steffen Staab Emergent Semantics , 2002, IEEE Intell. Syst..

[116]  Sarah Horton,et al.  Designing beneath the surface of the web , 2006, W4A '06.

[117]  Renata Pontin de Mattos Fortes,et al.  Automatic accessibility evaluation of dynamic web pages generated through XSLT , 2005, W4A '05.

[118]  Hironobu Takagi,et al.  Annotation-based transcoding for nonvisual web access , 2000, Assets '00.

[119]  Claus Atzenbeck,et al.  Constraints in spatial structures , 2005, HYPERTEXT '05.

[120]  Louie Zhao,et al.  Mozilla accessibility on Unix/Linux , 2005, W4A '05.

[121]  Stephanie Forrest,et al.  Analogies with immunology represent an important step toward the vision of robust, distributed protection for computers. , 1991 .

[122]  Peter J. Nürnberg,et al.  Openness in shared hypermedia workspaces: the case for collaborative open hypermedia systems , 1999, LINK.

[123]  Masahiro Hori,et al.  Semantic Annotation for Web Content Adaptation , 2003, Spinning the Semantic Web.

[124]  Shan Chen,et al.  An Experimental Study on Validation Problems with Existing HTML Webpages , 2005, International Conference on Internet Computing.

[125]  Paul P. Maglio,et al.  Intermediary-based transcoding framework , 2001, IBM Syst. J..

[126]  Hironobu Takagi,et al.  Transcoding proxy for nonvisual web access , 2000, Assets '00.

[127]  Louis Perrochon,et al.  WAB: World Wide Web access for blind and visually impaired computer users , 1996, SIGC.

[128]  Jim Austin,et al.  Emergent Neural Computational Architectures Based on Neuroscience: Towards Neuroscience-Inspired Computing , 2001 .

[129]  K. Gegenfurtner,et al.  Design Issues in Gaze Guidance Under review with ACM Transactions on Computer Human Interaction , 2009 .

[130]  I. V. Ramakrishnan,et al.  Hearsay: enabling audio browsing on hypertext content , 2004, WWW '04.

[131]  Carole A. Goble,et al.  Middleware to expand context and preview in hypertext , 2003, Assets '04.

[132]  Sean Bechhofer,et al.  SADIe:: transcoding based on CSS , 2006, Assets '06.

[133]  Carlos Delgado Kloos,et al.  Web composition with WCAG in mind , 2005, W4A '05.

[134]  Kouichi Ono,et al.  Annotation-based Web content transcoding , 2000, Comput. Networks.

[135]  I. V. Ramakrishnan,et al.  Automatic Annotation of Content-Rich HTML Documents: Structural and Semantic Analysis , 2003, SEMWEB.

[136]  Lisa Seeman The semantic web, web accessibility, and device independence , 2004, W4A '04.

[137]  Eric A. Meyer Is accessible design a myth? , 2005, W4A '05.

[138]  Nathaniel Levi Lloyd The Piggy Bank , 2004 .

[139]  Chieko Asakawa What's the web like if you can't see it? , 2005, W4A '05.

[140]  Michael Brambring Mobility and Orientation Processes of the Blind , 1985 .

[141]  Judy Brewer,et al.  Web accessibility highlights and trends , 2003, W4A '04.

[142]  Carole A. Goble,et al.  How much is too much in a hypertext link?: investigating context and preview -- a formative evaluation , 2004, HYPERTEXT '04.

[143]  Gail E. Kaiser,et al.  Extracting content from accessible web pages , 2005, W4A '05.

[144]  Daniela Cancila,et al.  Do text transcoders improve usability for disabled users? , 2005, W4A '05.

[145]  Shadi Abou-Zahra SemanticWeb enabled web accessibility evaluation tools , 2005, W4A '05.

[146]  Wei-Ying Ma,et al.  Learning important models for web page blocks based on layout and content analysis , 2004, SKDD.

[147]  Hironobu Takagi,et al.  Proposing new metrics to evaluate web usability for the blind , 2005, CHI Extended Abstracts.

[148]  Carole A. Goble,et al.  Towel: Real World Mobility on the Web , 1999, CADUI.

[149]  Jenny Craven Accessibility and usability of websites , 2003 .

[150]  Gary Marchionini,et al.  Visualizing websites using a hierarchical table of contents browser:WebTOC , 1998 .

[151]  Takashi Itoh,et al.  User interface of a nonvisual table navigation method , 1999, CHI EA '99.

[152]  Carole A. Goble,et al.  Augmenting the mobility of profoundly blind Web travellers , 2005, New Rev. Hypermedia Multim..

[153]  Carole A. Goble,et al.  Prototype mobility tools for visually impaired surfers , 2001, HYPERTEXT '01.

[154]  Carole A. Goble,et al.  The travails of visually impaired web travellers , 2000, HYPERTEXT '00.

[155]  Wei-Ying Ma,et al.  Detecting web page structure for adaptive viewing on small form factor devices , 2003, WWW '03.

[156]  Carole A. Goble,et al.  Evaluating DANTE: Semantic transcoding for visually disabled users , 2007, TCHI.

[157]  Richard Cox,et al.  Attention design: Eight issues to consider , 2006, Comput. Hum. Behav..

[158]  Leela Damodaran,et al.  Edemocracy: challenges for social inclusion , 2005 .

[159]  Tohru Ifukube,et al.  Auditory and tactile interfaces for representing the visual effects on the web , 2002, ASSETS.

[160]  Catherine C. Marshall,et al.  Turning the page on navigation , 2005, Proceedings of the 5th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL '05).

[161]  Silas S. Brown A World Wide Web Mediator for Users with Low Vision , 2001 .

[162]  A. T. Schreiber,et al.  Semantic Annotation of Image Collections , 2003 .

[163]  David Carmel,et al.  The connectivity sonar: detecting site functionality by structural patterns , 2003, HYPERTEXT '03.

[164]  Radu Dogaru,et al.  Universality and Emergent Computation in Cellular Neural Networks (World Scientific Series on Nonlinear Science, Series a, 43) , 2003 .

[165]  Gustavo Rossi,et al.  A metaphor for the visually impaired: browsing information in a 3D auditory environment , 1995, CHI '95.

[166]  Philip Barker EXPLORING HYPERMEDIA , 1993 .

[167]  Deborah L. McGuinness,et al.  OWL Web ontology language overview , 2004 .

[168]  Steffen Staab,et al.  Annotation of the Shallow and the Deep Web , 2003 .

[169]  Baoyao Zhou,et al.  Function-based object model towards website adaptation , 2001, WWW '01.

[170]  Katashi Nagao,et al.  Semantic transcoding: making the world wide web more understandable and usable with external annotations , 2000, COLING 2000.

[171]  Kouichi Ono,et al.  Annotation by Transformation for the Automatic Generation of Content Customization Metadata , 2002, Pervasive.

[172]  Melody Y. Ivory,et al.  Evolution of web site design patterns , 2005, TOIS.