Semantic Models for Adaptive Interactive Systems (semais 2011) Automated Planning for User Interface Composition

In ubiquitous computing, both the context of use and the users' needs may change dynamically with users' mobility and with the availability of interaction resources. In such changing environment, an interactive system must be dynamically composable according to the user need and to the current context of use. This article elicits the degrees of freedom User Interfaces (UI) composition faces to, and investigates automated planning to compose UIs without relying on a predefined task model. The composition process considers a set of ergonomic criterions, the current context of use, and the user need as inputs of a planning problem. The user need is specified by the end-user (e.g., get medical assistance). The system composes a UI in turn by assembling fragments of models along a planning process.

[1]  Jens Lehmann,et al.  DBpedia: A Nucleus for a Web of Open Data , 2007, ISWC/ASWC.

[2]  Jens Lehmann,et al.  LinkedGeoData: Adding a Spatial Dimension to the Web of Data , 2009, SEMWEB.

[3]  Hejie Chen,et al.  Deriving user interface from ontologies: a model-based approach , 2005, 17th IEEE International Conference on Tools with Artificial Intelligence (ICTAI'05).

[4]  Günther Schuh,et al.  A SCIENTIFIC FOUNDATION OF COLLABORATIVE ENGINEERING , 2007 .

[5]  Peretz Shoval,et al.  Evaluation of an ontology-content based filtering method for a personalized newspaper , 2008, RecSys '08.

[6]  Stephan Lukosch,et al.  Modeling collaboration processes to understand and predict group performance , 2010, SEMAIS '10.

[7]  Andrew Tokmakoff,et al.  Designing socially acceptable multimodal interaction in cooking assistants , 2011, IUI '11.

[8]  James A. Landay,et al.  Interactive sketching for the early stages of user interface design , 1995, CHI '95.

[9]  Marco Pistore,et al.  Automated Composition of Semantic Web Services into Executable Processes , 2004, SEMWEB.

[10]  Vanessa Evers,et al.  The effects of transparency on perceived and actual competence of a content-based recommender , 2008 .

[11]  David McSherry,et al.  Explanation in Recommender Systems , 2005, Artificial Intelligence Review.

[12]  Graham Clarke,et al.  Some socio-technical aspects of intelligent buildings and pervasive computing research , 2009 .

[13]  Nenad Stojanovic,et al.  Usage-Oriented Evolution of Ontology-Based Knowledge Management Systems , 2002, OTM.

[14]  Boris Motik,et al.  User-Driven Ontology Evolution Management , 2002, EKAW.

[15]  Dominique L. Scapin,et al.  Ergonomic criteria for evaluating the ergonomic quality of interactive systems , 1997, Behav. Inf. Technol..

[16]  Frank van Harmelen,et al.  A Framework for Handling Inconsistency in Changing Ontologies , 2005, SEMWEB.

[17]  Jarke J. van Wijk,et al.  The value of visualization , 2005, VIS 05. IEEE Visualization, 2005..

[18]  Abigail Sellen,et al.  Getting the right design and the design right , 2006, CHI.

[19]  Thomas Kirste,et al.  A middleware for rapid prototyping smart environments: experiences in research and teaching , 2010, UbiComp '10 Adjunct.

[20]  Karin Coninx,et al.  COMET(s), A Software Architecture Style and an Interactors Toolkit for Plastic User Interfaces , 2008, DSV-IS.

[21]  Gerd Wagner,et al.  Ontologies, Meta-models, and the Model-Driven Paradigm , 2006, Ontologies for Software Engineering and Software Technology.

[22]  Yiming Ma,et al.  Web for data mining: organizing and interpreting the discovered rules using the Web , 2000, SKDD.

[23]  Fabrice Guillet,et al.  A 2D-3D visualization support for human-centered rule mining , 2007, Comput. Graph..

[24]  Stephen C. Hayne,et al.  The facilitators perspective on meetings and implications for group support systems design , 1999, DATB.

[25]  Steffen Staab,et al.  An Ontology for Software , 2009, Handbook on Ontologies.

[26]  Thomas Kirste,et al.  A distributed action selection mechanism for device cooperation in smart environments , 2008 .

[27]  Tim Hussein.  Adapting web sites by spreading activation in ontologies , 2007 .

[28]  Stuart E. Middleton,et al.  Capturing interest through inference and visualization: ontological user profiling in recommender systems , 2003, K-CAP '03.

[29]  Robert Meersman,et al.  Data modelling versus ontology engineering , 2002, SGMD.

[30]  Kris McGlinn,et al.  Avoiding "big brother" anxiety with progressive self-management of ubiquitous computing services , 2008, MobiQuitous.

[31]  Thomas R. Gruber,et al.  A translation approach to portable ontology specifications , 1993, Knowl. Acquis..

[32]  Bill Buxton,et al.  Sketching User Experiences: Getting the Design Right and the Right Design , 2007 .

[33]  JOERG M. HAAKE,et al.  Modeling and Exploiting Context for Adaptive Collaboration , 2010, Int. J. Cooperative Inf. Syst..

[34]  Mark W. Newman,et al.  DENIM: finding a tighter fit between tools and practice for Web site design , 2000, CHI.

[35]  Carlos A. Iglesias,et al.  Disasters2.0: application of web 2.0 technologies in emergency situations , 2009 .

[36]  John Julian Carstens,et al.  SPARQL Protocol And RDF Query Language , 2012 .

[37]  Geoffrey C. Fox,et al.  A Web based conversational case-based recommender system for ontology aided metadata discovery , 2004, Fifth IEEE/ACM International Workshop on Grid Computing.

[38]  Ronen I. Brafman,et al.  Designing with interactive example galleries , 2010, CHI.

[39]  Keith Cheverst,et al.  Exploring Issues of User Model Transparency and Proactive Behaviour in an Office Environment Control System , 2005, User Modeling and User-Adapted Interaction.

[40]  J J Vidal,et al.  Toward direct brain-computer communication. , 1973, Annual review of biophysics and bioengineering.

[41]  Barry Smyth,et al.  Trust in recommender systems , 2005, IUI.

[42]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[43]  Agnar Aamodt,et al.  Knowledge communication and CBR , 2002, ECCBR Workshops.

[44]  Michael Uschold,et al.  Ontologies: principles, methods and applications , 1996, The Knowledge Engineering Review.

[45]  Asunción Gómez-Pérez,et al.  Towards a Glossary of Activities in the Ontology Engineering Field , 2008, LREC.

[46]  Vldb Endowment,et al.  The VLDB journal : the international journal on very large data bases. , 1992 .

[47]  Flavius Frasincar,et al.  Hermes: a semantic web-based news decision support system , 2008, SAC '08.

[48]  Natalya F. Noy,et al.  A Component-Based Framework For Ontology Evolution , 2003 .

[49]  Johanna D. Moore,et al.  Multimedia Explanations in IDEA Decision Support Systems , 1998 .

[50]  Edward H. Shortliffe,et al.  A Framework for Explaining Decision-Theoretic Advice , 1994, Artif. Intell..

[51]  Jean Vanderdonckt,et al.  A Theoretical Survey of User Interface Description Languages: Preliminary Results , 2009, 2009 Latin American Web Congress.

[52]  Heiko Paulheim,et al.  Ontology-Enhanced User Interfaces: A Survey , 2010, Int. J. Semantic Web Inf. Syst..

[53]  Fred Niederman,et al.  Issues and Concerns About Computer-Supported Meetings: The Facilitator's Perspective , 1996, MIS Q..

[54]  G. Konstantinidis.  Ontology Evolution : A Framework and its Application to RDF , 2007 .

[55]  Jens Lehmann,et al.  RelFinder: Revealing Relationships in RDF Knowledge Bases , 2009, SAMT.

[56]  Jay F. Nunamaker,et al.  Collaboration Engineering with ThinkLets to Pursue Sustained Success with Group Support Systems , 2003, J. Manag. Inf. Syst..

[57]  F. Ackermann.  Participants' perceptions on the role of facilitators using Group Decision Support Systems , 1996 .

[58]  Asunción Gómez-Pérez,et al.  Evaluation of ontologies , 2001, International Journal of Intelligent Systems.

[59]  Jun Hu,et al.  Spatial econometrics models for congestion prediction with in-vehicle route guidance , 2009 .

[60]  Paolo Traverso,et al.  Automated Planning: Theory & Practice , 2004 .

[61]  Mario Piattini,et al.  Ontologies for Software Engineering and Software Technology , 2010 .

[62]  Heike Hofmann,et al.  Visual Comparison of Association Rules , 2001, Comput. Stat..

[63]  Gregory D. Abowd,et al.  A Conceptual Framework and a Toolkit for Supporting the Rapid Prototyping of Context-Aware Applications , 2001, Hum. Comput. Interact..

[64]  Jean-Sébastien Sottet,et al.  Model-Driven Adaptation for Plastic User Interfaces , 2007, INTERACT.

[65]  Michael Kohlhase,et al.  Semantic transparency in user assistance systems , 2009, SIGDOC '09.

[66]  Michael Rebstock,et al.  Linking Heterogeneous Conceptual Models through a Unifying Modeling Concepts Ontology , 2010, SBPM.

[67]  Chris Stolte,et al.  Rendering effective route maps: improving usability through generalization , 2001, SIGGRAPH.

[68]  Jean Vanderdonckt,et al.  SketchiXML: towards a multi-agent design tool for sketching user interfaces based on USIXML , 2004, TAMODIA '04.

[69]  K. Alexander,et al.  FROM AN ONTOLOGY-ORIENTED APPROACH CONCEPTION TO USER INTERFACE DEVELOPMENT , 2007 .

[70]  José Juan Pazos-Arias,et al.  AVATAR: an approach based on semantic reasoning to recommend personalized TV programs , 2005, WWW.

[71]  Jörg M. Haake,et al.  Facilitating team-based adaptation of shared workspaces , 2010, 2010 International Symposium on Collaborative Technologies and Systems.

[72]  Rob Nadolski,et al.  Effects of the ISIS Recommender System for Navigation Support in self-organised Learning Networks , 2009, J. Educ. Technol. Soc..

[73]  Manfred Broy,et al.  Formalizing the notion of adaptive system behavior , 2009, SAC '09.

[74]  Thomas R. Gruber,et al.  Collective knowledge systems: Where the Social Web meets the Semantic Web , 2008, J. Web Semant..

[75]  Gwendolyn L. Kolfschoten,et al.  A Design Approach for Collaboration Processes: A Multimethod Design Science Study in Collaboration Engineering , 2009, J. Manag. Inf. Syst..

[76]  Rudi Studer,et al.  OntoManager - A System for the Usage-Based Ontology Management , 2003, OTM.

[77]  Valeriya Gribova,et al.  AUTOMATIC GENERATION OF CONTEXT-SENSITIVE HELP USING A USER INTERFACE PROJECT , 2007 .

[78]  Krzysztof Z. Gajos,et al.  SUPPLE: automatically generating user interfaces , 2004, IUI '04.

[79]  Fabio Paternò,et al.  ConcurTaskTrees: A Diagrammatic Notation for Specifying Task Models , 1997, INTERACT.

[80]  Asunción Gómez-Pérez,et al.  METHONTOLOGY: From Ontological Art Towards Ontological Engineering , 1997, AAAI 1997.

[81]  Bernhard Mitschang,et al.  Context-Aware Mashups for Mobile Devices , 2008, WISE.

[82]  Heiko Paulheim,et al.  Mapping pragmatic class models to reference ontologies , 2011, 2011 IEEE 27th International Conference on Data Engineering Workshops.

[83]  Martin J. O'Connor,et al.  A Software Tool for Visualizing, Managing and Eliciting SWRL Rules , 2010, ESWC.

[84]  Jean Vanderdonckt,et al.  A Unifying Reference Framework for multi-target user interfaces , 2003, Interact. Comput..

[85]  Robert O. Briggs,et al.  Extending the Contextual and Organizational Elements of Adaptive Structuration Theory in GSS Research , 2008, J. Assoc. Inf. Syst..

[86]  Stuart E. Middleton,et al.  Capturing knowledge of user preferences: ontologies in recommender systems , 2001, K-CAP '01.

[87]  Jean Vanderdonckt,et al.  The Comets Inspector: Towards Run Time Plasticity Control Based on a Semantic Network , 2006, TAMODIA.

[88]  Norman I. Badler,et al.  A Parameterized Action Representation for Virtual Human Agents , 1998 .

[89]  José Ramón Hilera,et al.  Using Ontologies in Software Engineering and Technology , 2006, Ontologies for Software Engineering and Software Technology.

[90]  Boris Motik,et al.  Managing Multiple Ontologies and Ontology Evolution in Ontologging , 2002, Intelligent Information Processing.

[91]  Joëlle Coutaz,et al.  User interface plasticity: model driven engineering to the limit! , 2010, EICS '10.

[92]  Dimitri Masson,et al.  Magellan, an evolutionary system to foster user interface design creativity , 2010, EICS '10.

[93]  Stephen Travis Pope,et al.  A cookbook for using the model-view controller user interface paradigm in Smalltalk-80 , 1988 .

[94]  Allan Collins,et al.  A spreading-activation theory of semantic processing , 1975 .

[95]  Joëlle Coutaz,et al.  Plasticity of User Interfaces: Framework and Research Agenda , 1999, INTERACT.

[96]  Neil Ireson.  Local community situational awareness during an emergency , 2009, 2009 3rd IEEE International Conference on Digital Ecosystems and Technologies.

[97]  Jay F. Nunamaker,et al.  Lessons from a Dozen Years of Group Support Systems Research: A Discussion of Lab and Field Findings , 1996, J. Manag. Inf. Syst..

[98]  Sophia B. Liu.  Spatiotemporal Mashups : A Survey of Current Tools to Inform Next Generation Crisis Support , 2009 .

[99]  Mark Weiser.  The computer for the 21st century , 1991 .

[100]  Mark A. Musen,et al.  A Framework for Ontology Evolution in Collaborative Environments , 2006, SEMWEB.

[101]  Colin Atkinson,et al.  On the Relationship of Ontologies and Models , 2006, WoMM.