Reasoning about Hand-Drawn Sketches: An Approach Based on Intelligent Software Agents

Sketching is a powerful means to represent objects and reason on them. In this paper we describe an integrated environment, conceived as a multi agent system, that brings together sketch recognition functionalities and decision support facilities. In this environment, intelligent agents are exploited both for managing the process of recognition of the sketched objects, and for supporting users in solving decisional problems. We explain our approach and its potential by means of a running example taken from the domain of building's safety.

[1]  James A. Landay,et al.  Sketching Interfaces: Toward More Human Interface Design , 2001, Computer.

[2]  Dov M. Gabbay,et al.  Deontic Logic in Computer Science , 2008, DEON 2008.

[3]  Viviana Mascardi,et al.  An agent-based framework for sketched symbol interpretation , 2008, J. Vis. Lang. Comput..

[4]  Jürgen Lind,et al.  Iterative Software Engineering for Multiagent Systems , 2001, Lecture Notes in Computer Science.

[5]  Leon G. Higley,et al.  Forensic Entomology: An Introduction , 2009 .

[6]  Sven Ove Hansson,et al.  Review of Deontic Logic in Computer Science: Normative System Specification, John-Jules Ch. Meyer and Roel J. Wieringa (eds.), John Wiley & Sons, Chichester 1993 , 1994, Bull. IGPL.

[7]  NICHOLAS R. JENNINGS,et al.  An agent-based approach for building complex software systems , 2001, CACM.

[8]  Robert B. Ross,et al.  IMPACT: A System for Building Agent Applications , 2000, Journal of Intelligent Information Systems.

[9]  Paul McNamara,et al.  Deontic logic , 2006, Logic and the Modalities in the Twentieth Century.

[10]  Jürgen Lind,et al.  Issues in Agent-Oriented Software Engineering , 2000, AOSE.

[11]  Kenneth D. Forbus,et al.  Sketching for military courses of action diagrams , 2003, IUI '03.

[12]  Roel Wieringa,et al.  Deontic logic in computer science: normative system specification , 1994 .

[13]  Nicholas R. Jennings.  Agent-Oriented Software Engineering , 1999, MAAMAW.

[14]  John S. Gero,et al.  Drawings and the design process , 1998 .

[15]  Kenneth D. Forbus,et al.  Towards a computational model of sketching , 2001, IUI '01.

[16]  Ellen Yi-Luen Do,et al.  Intelligent Critiquing of Design Sketches , 2004, AAAI Technical Report.

[17]  A. Roadmapof.  A Roadmap of Agent Research and Development , 1995 .

[18]  Kenneth D. Forbus,et al.  Sketching for knowledge capture: a progress report , 2002, IUI '02.

[19]  John S. Gero,et al.  Sketching as mental imagery processing , 2001 .