LADDER: a language to describe drawing, display, and editing in sketch recognition

We have created LADDER, the first language to describe how sketched diagrams in a domain are drawn, displayed, and edited. The difficulty in creating such a language is choosing a set of predefined entities that is broad enough to support a wide range of domains, while remaining narrow enough to be comprehensible. The language consists of predefined shapes, constraints, editing behaviors, and display methods, as well as a syntax for specifying a domain description sketch grammar and extending the language, ensuring that shapes and shape groups from many domains can be described. The language allows shapes to be built hierarchically (e.g., an arrow is built out of three lines), and includes the concept of "abstract shapes", analogous to abstract classes in an object oriented language. Shape groups describe how multiple domain shapes interact and can provide the sketch recognition system with information to be used in top-down recognition. Shape groups can also be used to describe "chain-reaction" editing commands that effect multiple shapes at once. To test that recognition is feasible using this language, we have built a simple domain-independent sketch recognition system that parses the domain descriptions and generates the code necessary to recognize the shapes.

[1]  J. Nash.  THE BARGAINING PROBLEM , 1950, Classics in Game Theory.

[2]  George Stiny,et al.  Shape Grammars and the Generative Specification of Painting and Sculpture , 1971, IFIP Congress.

[3]  E. Kalai,et al.  OTHER SOLUTIONS TO NASH'S BARGAINING PROBLEM , 1975 .

[4]  M. Kaneko.  An extension of the Nash bargaining problem and the Nash social welfare function , 1980 .

[5]  P. Pattanaik,et al.  Social choice and welfare , 1983 .

[6]  Editors , 1986, Brain Research Bulletin.

[7]  N. D. Belajcic.  Computer Implementation of Shape Grammars , 1988 .

[8]  James Glass,et al.  The SUMMIT speech recognition system: phonological modelling and lexical access , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[9]  John P. Conley,et al.  The bargaining problem without convexity: extending the egalitarian and Kalai-Smorodinsky solutions , 1991 .

[10]  Ken Binmore,et al.  Noncooperative models of bargaining , 1992 .

[11]  Jeffrey S. Rosenschein,et al.  A Domain Theory for Task Oriented Negotiation , 1993, IJCAI.

[12]  Jeffrey S. Rosenschein,et al.  Rules of Encounter - Designing Conventions for Automated Negotiation among Computers , 1994 .

[13]  W. Thomson.  Chapter 35 Cooperative models of bargaining , 1994 .

[14]  John P. Conley,et al.  An Extension of the Nash Bargaining Solution to Nonconvex Problems , 1996 .

[15]  Ellen Yi-Luen Do,et al.  Demonstrating the electronic cocktail napkin: a paper-like interface for early design , 1996, CHI Conference Companion.

[16]  Lin Zhou.  THE NASH BARGAINING THEORY WITH NON-CONVEX PROBLEMS , 1997 .

[17]  Sarit Kraus,et al.  Reaching Agreements Through Argumentation: A Logical Model and Implementation , 1998, Artif. Intell..

[18]  M. Mariotti.  Nash bargaining theory when the number of alternatives can be finite , 1998 .

[19]  James Gips,et al.  Computer Implementation of Shape Grammars , 1999 .

[20]  Robert J. K. Jacob,et al.  A software model and specification language for non-WIMP user interfaces , 1999, TCHI.

[21]  Ivar Jacobson,et al.  The Unified Modeling Language User Guide , 1998, J. Database Manag..

[22]  N. R. Jennings,et al.  To appear in: Int Journal of Group Decision and Negotiation GDN2000 Keynote Paper Automated Negotiation: Prospects, Methods and Challenges , 2022 .

[23]  Oliver Bimber,et al.  A multi-layered architecture for sketch-based interaction within virtual environments , 2000, Comput. Graph..

[24]  Sketch based interfaces: early processing for sketch understanding , 2001, PUI '01.

[25]  Christine Alvarado,et al.  A Framework for Multi-Domain Sketch Recognition , 2002 .

[26]  R. Davis,et al.  Perceptually Based Learning of Shape Descriptions , 2002 .

[27]  Randall Davis,et al.  Generating Domain Specific Sketch Recognizers From Object Descriptions , 2002 .

[28]  Joaquim A. Jorge,et al.  JavaSketchIt: Issues in Sketching the Look of User Interfaces , 2002 .

[29]  James V. Mahoney,et al.  Three main concerns in sketch recognition and an approach to addressing them , 2002 .

[30]  A. McLennan.  Economics and language: Five essays. , 2002 .

[31]  Peter C. Fishburn,et al.  Theory and decision , 2003 .

[32]  S. Lahiri.  Axiomatic characterization of the Nash and Kalai-Smorodinsky solutions for discrete bargaining problems , 2003 .

[33]  J. Hougaard,et al.  Nonconvex n-person bargaining: efficient maxmin solutions , 2003 .

[34]  P. E. Dunne,et al.  Extremal Behaviour in Multiagent Contract Negotiation , 2011, J. Artif. Intell. Res..