Sketch Input of Engineering Euclidean Solid Models

Abstract —This position paper describes some open problems of sketch input of engineering Euclidean solid models. After a brief historical introduction, we discuss traditional design using pencil and paper, and how this paradigm has been adapted (or forgotten) by various current approaches to computer interpretation of sketches. We discuss three particular open problems, those of modalities, annotations, and assemblies. We also analyse current perception-based approaches in order to identify the most important areas in which further work is needed: detection of geometrical, perceptual and manufacturing cues, and a taxonomy of cue interdependencies which would prevent incompleteness and contradictions. Index Terms—Pen computing, Sketch-based modelling, Sketching interface, Cues. I. I NTRODUCTION Pen computing refers to those computer user interfaces where users interact with computers by means of pens which guide pointers moving around a screen. In this paper, such interfaces are considered distinct from classic keyboard/ display/mouse environments only as far as they are used to simulate the behaviour of actual paper and pencil. We are only interested in "virtual" paper and pencil which allows free sketching and annotating, not in the "pointing mode" of WIMP environments. Similarly, we are interested in handwriting as far as it conveys

[1]  Pierre Leclercq,et al.  A multi-agent system for the interpretation of architectural sketches , 2004, SBM'04.

[2]  Dov Dori,et al.  From engineering drawings to 3D models: are we ready now? , 1995, Comput. Aided Des..

[3]  Hod Lipson,et al.  Optimization-based reconstruction of a 3D object from a single freehand line drawing , 1996, Comput. Aided Des..

[4]  Thomas Marill,et al.  Emulating the human interpretation of line-drawings as three-dimensional objects , 1991, International Journal of Computer Vision.

[5]  S.G. Fabri,et al.  Line tracking algorithm for scribbled drawings , 2008, 2008 3rd International Symposium on Communications, Control and Signal Processing.

[6]  Joseph J. LaViola Advances in Mathematical Sketching: Moving Toward the Paradigm's Full Potential , 2007, IEEE Computer Graphics and Applications.

[7]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[8]  Manuel Contero,et al.  Computer-aided sketching as a tool to promote innovation in the new product development process , 2009, Comput. Ind..

[9]  Ryan Schmidt,et al.  Analytic drawing of 3D scaffolds , 2009, SIGGRAPH 2009.

[10]  Martin C. Cooper Line Drawing Interpretation , 2008 .

[11]  Donald D. Hoffman,et al.  Visual Intelligence: How We Create What We See , 1998 .

[12]  Susan J. Tate,et al.  Recognising symmetry in solid models , 2003, Comput. Aided Des..

[13]  Peter A. C. Varley,et al.  A new algorithm for finding faces in wireframes , 2010, Comput. Aided Des..

[14]  Eugene S. Ferguson,et al.  Engineering and the Mind's Eye , 1994 .

[15]  Dov Dori,et al.  Sparse Pixel Vectorization: An Algorithm and Its Performance Evaluation , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Peter Wonka,et al.  Generating 3D Building Models from Architectural Drawings: A Survey , 2009, IEEE Computer Graphics and Applications.

[17]  Ralph R. Martin,et al.  Perpendicularity as a key to interpreting line drawings of engineering objects , 2005 .

[18]  Chao Tian,et al.  Physical sketching: Reconstruction and analysis of 3D objects from freehand sketches , 2009, Comput. Aided Des..

[19]  K. Sugihara Machine interpretation of line drawings , 1986, MIT Press series in artificial intelligence.

[20]  Levent Burak Kara,et al.  An evaluation of user experience with a sketch-based 3D modeling system , 2007, Comput. Graph..

[21]  Pedro Company,et al.  A Method for Reconstructing Sketched Polyhedral Shapes with Rounds and Fillets , 2010, Smart Graphics.

[22]  Mario Costa Sousa,et al.  Sketch-based modeling: A survey , 2009, Comput. Graph..

[23]  Peter Ashley Clifford Varley,et al.  Automatic creation of boundary-representation models from single line drawings , 2003 .

[24]  Sundar Murugappan,et al.  FEAsy: A Sketch-Based Interface Integrating Structural Analysis in Early Design , 2009 .

[25]  Peter Ashley,et al.  Operating modes in actual versus virtual paper-and-pencil design scenarios , 2009 .

[26]  Lee Yong Tsui,et al.  Regularity selection for effective 3D object reconstruction from a single line drawing , 2008, Pattern Recognit. Lett..

[27]  Manuel Contero,et al.  A study of usability of sketching tools aimed at supporting prescriptive sketches , 2006, SBM'06.

[28]  Manuel Contero,et al.  A survey on geometrical reconstruction as a core technology to sketch-based modeling , 2005, Comput. Graph..

[29]  David Perkins Cubic Corners, Oblique Views of Pictures, the Perception of Line Drawings of Simple Space Forms. Geometry and the Perception of Pictures: Three Studies. Technical Report No. 5. , 1971 .

[30]  Engelbert Westkämper,et al.  The implementation of a sketch-based virtual product development , 2010, Prod. Eng..

[31]  Manuel Contero,et al.  An Agent-Based Paradigm for Free-Hand Sketch Recognition , 2009, AI*IA.

[32]  Jason Hong,et al.  Computational Support for Sketching in Design: A Review , 2009, Found. Trends Hum. Comput. Interact..

[33]  Philip Ti-Fei Su,et al.  Building Tablet PC Applications , 2002 .

[34]  Ravin Balakrishnan,et al.  ILoveSketch: as-natural-as-possible sketching system for creating 3d curve models , 2008, UIST '08.

[35]  David Craig,et al.  The importance of drawing in the mechanical design process , 1990, Comput. Graph..

[37]  Donald D. Hoffman Visual Intelligence: How We Create What We See , 1998 .

[38]  H. Barlow Vision Science: Photons to Phenomenology by Stephen E. Palmer , 2000, Trends in Cognitive Sciences.

[39]  Manuel Contero,et al.  A New Sketch-Based Computer Aided Engineering Pre-Processor , 2008 .

[40]  Masayuki Nakajima,et al.  CrossSketch: freeform surface modeling with details , 2007, SBIM '07.

[41]  Ralph R. Martin,et al.  Detecting design intent in approximate CAD models using symmetry , 2010, Comput. Aided Des..

[42]  Fumihiko Kimura,et al.  A CAD System for Efficient Product Design Based on Design Intent , 1989 .

[43]  Frédo Durand,et al.  3D modeling with silhouettes , 2010, SIGGRAPH 2010.

[44]  Ralph R. Martin,et al.  Skewed Mirror Symmetry for Depth Estimation in 3D Line-Drawings , 2003, GREC.

[45]  P. A. C. Varley Automated Sketching and Engineering Culture , 2008 .

[46]  Manuel Contero,et al.  An optimisation-based reconstruction engine for 3D modelling by sketching , 2004, Comput. Graph..

[47]  Levent Burak Kara,et al.  Sketch-Based 3D-Shape Creation for Industrial Styling Design , 2007, IEEE Computer Graphics and Applications.