WYSIWYM - Integrated visualization, exploration and authoring of semantically enriched un-structured content

The Semantic Web and Linked Data gained traction in the last years. However, the majority of information still is contained in unstructured documents. This can also not be expected to change, since text, images and videos are the natural way how humans interact with information. Semantic structuring on the other hand enables the (semi-)automatic integration, repurposing, rearrangement of information. NLP technologies and formalisms for the integrated representation of unstructured and semantic content (such as RDFa and Microdata) aim at bridging this semantic gap. However, in order for humans to truly benefit from this integration, we need ways to author, visualize and explore unstructured and semantically enriched content in an integrated manner. In this paper, we present the WYSIWYM (What You See is What You Mean) concept, which addresses this issue and formalizes the binding between semantic representation models and UI elements for authoring, visualizing and exploration. With RDFaCE, Pharmer and conTEXT we present and evaluate three complementary showcases implementing the WYSIWYM concept for different application domains.

[1]  Andreas Abecker,et al.  iMapping: a zooming user interface approach for personal and semantic knowledge management , 2010, HT '10.

[2]  Sharon L. Oviatt,et al.  Designing the User Interface for Multimodal Speech and Pen-Based Gesture Applications: State-of-the-Art Systems and Future Research Directions , 2000, Hum. Comput. Interact..

[3]  Ali Khalili,et al.  User interfaces for semantic authoring of textual content: A systematic literature review , 2013, J. Web Semant..

[4]  Patrick W. Jordan,et al.  An Introduction to Usability , 1998 .

[5]  Sebastian Hellmann,et al.  OntosFeeder - A Versatile Semantic Context Provider for Web Content Authoring , 2011, ESWC.

[6]  Mike Thelwall,et al.  Synthesis Lectures on Information Concepts, Retrieval, and Services , 2009 .

[7]  David R. Karger,et al.  The web page as a WYSIWYG end-user customizable database-backed information management application , 2009, UIST '09.

[8]  Richard Power,et al.  What You See Is What You Meant: direct knowledge editing with natural language feedback , 1998, ECAI.

[9]  Ralf Heese,et al.  Linked Data Authoring for Non-Experts , 2009, LDOW.

[10]  Jeff Sauro,et al.  The Factor Structure of the System Usability Scale , 2009, HCI.

[11]  Weber-WulffDebora.  Human-computer interaction in the new millennium , 2002 .

[12]  Martin Gaedke,et al.  Exploiting single-user web applications for shared editing: a generic transformation approach , 2012, WWW.

[13]  Amit P. Sheth,et al.  RDF data exploration and visualization , 2007, CIMS '07.

[14]  Soren Lauesen.  User Interface Design: A Software Engineering Perspective , 2004 .

[15]  Melike Sah,et al.  Semport: a personalized semantic portal , 2007, HT '07.

[16]  Ben Shneiderman,et al.  Creating creativity: user interfaces for supporting innovation , 2000, TCHI.

[17]  Aba-Sah Dadzie,et al.  Approaches to visualising Linked Data: A survey , 2011, Semantic Web.

[18]  Ali Khalili,et al.  conTEXT - Lightweight Text Analytics Using Linked Data , 2014, ESWC.

[19]  David R. Karger,et al.  Fresnel: A Browser-Independent Presentation Vocabulary for RDF , 2005, SEMWEB.

[20]  Jeff A. Johnson,et al.  Designing with the Mind in Mind, Second Edition: Simple Guide to Understanding User Interface Design Guidelines , 2014 .

[21]  James A. Landay,et al.  A visual language for sketching large and complex interactive designs , 2002, CHI.

[22]  Adrian Paschke,et al.  One Click Annotation , 2010, SFSW.

[23]  Ed Huai-hsin Chi,et al.  Annotate once, appear anywhere: collective foraging for snippets of interest using paragraph fingerprinting , 2009, CHI.

[24]  Ali Khalili,et al.  Semantic Medical Prescriptions -- Towards Intelligent and Interoperable Medical Prescriptions , 2013, 2013 IEEE Seventh International Conference on Semantic Computing.

[25]  Ali Khalili,et al.  The RDFa Content Editor - From WYSIWYG to WYSIWYM , 2012, 2012 IEEE 36th Annual Computer Software and Applications Conference.

[26]  Daniel Tunkelang,et al.  Faceted Search , 2009, Synthesis Lectures on Information Concepts, Retrieval, and Services.

[27]  Amparo Elizabeth Cano,et al.  Ozone Browser: Augmenting the Web with Semantic Overlays , 2009, SFSW@ESWC.

[28]  Anupriya Ankolekar,et al.  The two cultures: mashing up web 2.0 and the semantic web , 2007, WWW '07.

[29]  Ali Khalili,et al.  WYSIWYM Authoring of Structured Content Based on Schema.org , 2013, WISE.

[30]  Brad A. Myers,et al.  A brief history of human-computer interaction technology , 1998, INTR.

[31]  Enrico Motta,et al.  Is Question Answering fit for the Semantic Web?: A survey , 2011, Semantic Web.

[32]  Niels Henze,et al.  User-centred process for the definition of free-hand gestures applied to controlling music playback , 2012, Multimedia Systems.

[33]  Wolfgang Müller,et al.  A-R-E: The Author-Review-Execute Environment , 2011, ICCS.

[34]  Leslie J. Kitchen,et al.  Optimization of html automatically generated by wysiwyg programs , 2004, WWW '04.