A Sketch-Based Tool for Analyzing Vibratory Mechanical Systems

Sketches are a ubiquitous form of communication in engineering design due to their simplicity and efficiency. However, because of a lack of suitable machine-interpretation techniques, they are virtually unusable with current computer-aided design and engineering tools. The informal nature of sketches and their inherent ambiguity present a number of challenges to the development of such techniques. Here we address one particular challenge, the task of reliably locating and recognizing the intended visual objects from a continuous stream of pen strokes. We present an integrated sketch parsing and recognition approach, based on a novel mark-group-recognize paradigm, which is tailored to the domain of mechanical systems. In the first step of processing, the sketch is examined to identify certain delimiting symbols called "markers." The remaining pen strokes are then partitioned into distinct clusters, each representing a single symbol. Finally, a trainable symbol recognizer is used to find the best interpretation of each cluster. We have used these techniques to build a sketch-based tool for designing and analyzing vibratory mechanical systems. This tool enables designers to analyze and animate vibratory systems by simply sketching them on a tablet computer. User studies indicate that even first-time users find our tool to be effective.

[1]  Joaquim A. Jorge,et al.  CALI: An Online Scribble Recognizer for Calligraphic Interfaces , 2002 .

[2]  David G. Stork,et al.  Pattern Classification , 1973 .

[3]  Takayuki Dan Kimura,et al.  Recognizing multistroke geometric shapes: an experimental evaluation , 1993, UIST '93.

[4]  Alice M. Agogino,et al.  Insights on Designers’ Sketching Activities in New Product Design Teams , 2004 .

[5]  Robert W. Brodersen,et al.  Pen and speech recognition in the user interface for mobile multimedia terminals , 1996 .

[6]  Levent Burak Kara,et al.  Combining geometry and domain knowledge to interpret hand-drawn diagrams , 2005, Comput. Graph..

[7]  W. Eric L. Grimson.  The Combinatorics of Heuristic Search Termination for Object Recognition in Cluttered Environments , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  David Craig,et al.  The importance of drawing in the mechanical design process , 1990, Comput. Graph..

[9]  Anne Römer,et al.  Support value of sketching in the design process , 2003 .

[10]  Randall Davis,et al.  HMM-based efficient sketch recognition , 2005, IUI.

[11]  Pedro M. Domingos,et al.  Beyond Independence: Conditions for the Optimality of the Simple Bayesian Classifier , 1996, ICML.

[12]  K. Takahashi,et al.  A Discrete HMM for Online Handwriting Recognition , 2000, Int. J. Pattern Recognit. Artif. Intell..

[13]  Stuart Russell,et al.  Statistical Visual Language Models for Ink Parsing , 2002 .

[14]  Thomas F. Stahovich.  Segmentation of Pen Strokes Using Pen Speed , 2004, AAAI Technical Report.

[15]  Hod Lipson,et al.  Classification of Sketch Strokes and Corner Detection Using Conic Sections and Adaptive Clustering , 1997 .

[16]  Nicholas E. Matsakis.  Recognition of Handwritten Mathematical Expressions , 1999 .

[17]  Victor R. Lesser,et al.  The Hearsay-II Speech-Understanding System: Integrating Knowledge to Resolve Uncertainty , 1980, CSUR.

[18]  Christine Alvarado,et al.  Dynamically constructed Bayes nets for multi-domain sketch understanding , 2005, IJCAI.

[19]  Paul A. Viola,et al.  Spatial recognition and grouping of text and graphics , 2004, SBM'04.

[20]  Maria C. Yang,et al.  An Analysis of Sketching Skill and Its Role in Early Stage Engineering Design , 2007 .

[21]  Yan Jin,et al.  Impact of Mental Iteration on Concept Generation , 2006 .

[22]  Takayuki Dan Kimura,et al.  A Graphic Diagram Editor for Pen Computers , 1994, Softw. Concepts Tools.

[23]  Maria C. Yang,et al.  Concept Generation and Sketching: Correlations With Design Outcome , 2003 .

[24]  David J. Fleet,et al.  Perceptual Organization as a Foundation for Intelfigent Sketch Editing , 2002 .

[25]  Joseph J. LaViola,et al.  MathPad2: a system for the creation and exploration of mathematical sketches , 2004, SIGGRAPH 2004.

[26]  A. Richard Newton,et al.  Sketched symbol recognition using Zernike moments , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[27]  Gennaro Costagliola,et al.  Visual Language Editors based on LR Parsing Techniques , 2003, IWPT.

[28]  Robert C. Miller,et al.  Off-Line Sketch Interpretation , 2004, AAAI Technical Report.

[29]  Levent Burak Kara,et al.  Hierarchical parsing and recognition of hand-sketched diagrams , 2004, UIST '04.

[30]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[31]  James A. Landay,et al.  Sketching Interfaces: Toward More Human Interface Design , 2001, Computer.

[32]  Levent Burak Kara,et al.  Automatic parsing and recognition of hand-drawn sketches for pen-based computer interfaces , 2004 .

[33]  Levent Burak Kara,et al.  An Image-Based Trainable Symbol Recognizer for Sketch-Based Interfaces , 2004, AAAI Technical Report.

[34]  David W. Jacobs,et al.  The Use of Grouping in Visual Object Recognition , 1988 .

[35]  Pedro M. Domingos,et al.  On the Optimality of the Simple Bayesian Classifier under Zero-One Loss , 1997, Machine Learning.

[36]  Joaquim A. Jorge,et al.  Using fuzzy logic to recognize geometric shapes interactively , 2000, Ninth IEEE International Conference on Fuzzy Systems. FUZZ- IEEE 2000 (Cat. No.00CH37063).

[37]  Dean Rubine,et al.  Specifying gestures by example , 1991, SIGGRAPH.

[38]  Thomas F. Stahovich,et al.  Kirchhoff's Pen: a pen-based circuit analysis tutor , 2007, SBIM '07.

[39]  A. Enis Çetin,et al.  Vision-Based Single-Stroke Character Recognition for Wearable Computing , 2001, IEEE Intell. Syst..