Artificial Intelligence for Engineering Design, Analysis and Manufacturing Sketch­based Interfaces for Modeling and Users' Needs: Redefining Connections Sketch-based Interfaces for Modeling and Users' Needs: Redefining Connections

Abstract The goal of this paper is to reexamine assumptions about sketch-based interfaces for modeling in the context of designers' needs and practices. Research questions examine (a) the type of sketch support and (b) the timing of support. Both concepts try to determine when, what, why and how to augment design processes in a way that is useful to designers. Two experiments (one in architecture and one in product design) based on ergonomics theory are conducted and intend to question some of these assumptions. The Port Zeeland experiment examines how 20 novices perceive and copy a blurred architectural sketch, which provides clues for a sketch interpretation system. The “Tragere” experiment studies how 12 professional product designers, some of whom are “idea generators” and others “idea pursuers,” perceive, recognize, and handle a design sketch. The results take a designer's point of view in assessing the timing and value of sketch assistance in product design. The quantitative data analysis provides rich clues about when, why and how product sketches should be supported. The paper explores the strategies developed by designers to perceive and recognize graphical content and discusses the generation of three-dimensional volumes, the univocity state between sketches and three-dimensional models, and the treatment of features in freehand sketches. The paper concludes with observations on the timing and value of support, as first integrated in NEMo, a tool for early stage architectural design, and then in PEPS3, an early stage framework for product design.

[1]  Pierre Leclercq Le concept d'esquisse augmentée , 2005 .

[2]  Ann Heylighen,et al.  EXTENDING THE DIALOGUE BETWEEN DESIGN(ERS) AND DISABLED USE(RS): FROM CONVERSATION TO EMBODIED SKILL , 2010 .

[3]  Barbara Tversky,et al.  What do Sketches Say about Thinking , 2002 .

[4]  Eugene S. Ferguson,et al.  Engineering and the Mind's Eye , 1994 .

[5]  F. N. Ferreira,et al.  Eurographics Workshop on Sketch-Based Interfaces and Modeling 2004 , 2004 .

[6]  Max J. Egenhofer,et al.  Perceptual Sketch Interpretation , 2008, SDH.

[7]  Christine Alvarado,et al.  SketchREAD: a multi-domain sketch recognition engine , 2004, UIST '04.

[8]  Mario Costa Sousa,et al.  Sketch-based modeling: A survey , 2009, Comput. Graph..

[9]  Christine Alvarado,et al.  Multi-domain sketch understanding , 2007, SIGGRAPH Courses.

[10]  Masaki Suwa,et al.  Macroscopic analysis of design processes based on a scheme for coding designers' cognitive actions , 1998 .

[11]  Randall Davis,et al.  Sketch Understanding in Design: Overview of Work at the MIT AI Lab , 2002 .

[12]  Françoise Darses,et al.  Is there anything to expect from 3D views in sketching support tools , 2008 .

[13]  Ben Jonson,et al.  Design ideation: the conceptual sketch in the digital age , 2005 .

[14]  Françoise Darses,et al.  An Anthropo-Based Standpoint on Mediating Objects: Evolution and Extension of Industrial Design Practices , 2010, DCC.

[15]  Levent Burak Kara,et al.  Combining geometry and domain knowledge to interpret hand-drawn diagrams , 2005, Comput. Graph..

[16]  Ellen Yi Luen and Gross Mark D. Do,et al.  Inferring Design Intentions From Sketches: An Investigation of Freehand Drawing Conventions in Design , 1997 .

[17]  Ivan E. Sutherland,et al.  Sketchpad—a man-machine graphical communication system , 1998 .

[18]  Nicole Vincent,et al.  1 - Interprétation de documents techniques par "cycles perceptifs" à partir d'une perception globale du document , 1998 .

[19]  Aurélie Jeunejean Algorithme de tracé réaliste pour environnement de dessin virtuel , 2004 .

[20]  Randall Davis,et al.  LADDER, a sketching language for user interface developers , 2005, Comput. Graph..

[21]  David Radcliffe,et al.  Impact of CAD tools on creative problem solving in engineering design , 2009, Comput. Aided Des..

[22]  Chor-Kheng Lim An Insight into the Freedom of Using a Pen : Pen-based System and Pen-and-paper , 2003 .

[23]  John S. Gero,et al.  DOES SKETCHING OFF-LOAD VISUO-SPATIAL WORKING MEMORY? , 2005 .

[24]  Ramesh Raskar,et al.  Epipolar methods for multi-view sketching , 2004, SBM'04.

[25]  Eric Saund,et al.  Finding Perceptually Closed Paths in Sketches and Drawings , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Marie-Paule Cani,et al.  From Paper to Machine : Extracting Strokes from Images for use in Sketch Recognition , 2022 .

[27]  Steve Garner,et al.  Is Sketching Still Relevant in Virtual Design Studios , 2000 .

[28]  Donald A. Schön,et al.  Kinds of seeing and their functions in designing , 1992 .

[29]  Bryan Lawson,et al.  Sketches of thought , 1997 .

[30]  Levent Burak Kara,et al.  An evaluation of user experience with a sketch-based 3D modeling system , 2007, Comput. Graph..

[31]  Manuel Contero,et al.  On the evolution of geometrical reconstruction as a core technology to sketch-based modeling , 2004, SBM'04.

[32]  Hod Lipson,et al.  Optimization-based reconstruction of a 3D object from a single freehand line drawing , 1996, Comput. Aided Des..

[33]  Pierre Leclercq,et al.  A freehand-sketch environment for architectural design supported by a multi-agent system , 2005, Comput. Graph..

[34]  Eric Saund,et al.  A perceptually-supported sketch editor , 1994, UIST '94.

[35]  Paul Rodgers,et al.  Using concept sketches to track design progress , 2000 .

[36]  Ravin Balakrishnan,et al.  ILoveSketch: as-natural-as-possible sketching system for creating 3d curve models , 2008, UIST '08.

[37]  Paul Rodgers,et al.  Visible ideas:Information patterns of conceptual sketch activity , 1998 .

[38]  Gershon Elber,et al.  Sketching as a solid modeling tool , 1995, SMA '95.

[39]  Ivan E. Sutherland,et al.  Sketchpad a Man-Machine Graphical Communication System , 1899, Outstanding Dissertations in the Computer Sciences.

[40]  Hod Lipson,et al.  Optimization-based reconstruction of a 3D object from a single freehand line drawing , 1996, Comput. Aided Des..

[41]  Chao Tian,et al.  Physical sketching: Reconstruction and analysis of 3D objects from freehand sketches , 2009, Comput. Aided Des..

[42]  Viviana Mascardi,et al.  An agent-based framework for sketched symbol interpretation , 2008, J. Vis. Lang. Comput..

[43]  Ellen Yi-Luen What ' s in a diagram that a computer should understand , 1995 .

[44]  Viviana Mascardi,et al.  Reasoning about Hand-Drawn Sketches: An Approach Based on Intelligent Software Agents , 2008, VISUAL.

[45]  Hh Henri Achten,et al.  A decade of design research in the Netherlands , 2005 .

[46]  Hideki Aoyama,et al.  Digital style design systems from concept to sophisticated shape , 2007 .

[47]  Alexandre Demeure,et al.  Modèles et outils pour la conception et l'exécution d'Interfaces Homme-Machine Plastiques, Ecosystème. (Models and tools for conception and execution of Plastic User Interface, Ecosystem) , 2007 .

[48]  Hod Lipson,et al.  Correlation-based reconstruction of a 3D object from a single freehand sketch , 2007, SIGGRAPH Courses.

[49]  Burcu Şenyapılı,et al.  The (in)secure position of the design jury towards computer generated presentations , 2005 .

[50]  Branko Kolarevic,et al.  Digital Architectures , 2000, Proceedings of the 20th Annual Conference of the Association for Computer Aided Design in Architecture (ACADIA).

[51]  Jacques Leplat La conception en design industriel et en architecture. Désir, pertinence, coopération et cognition de Lebahar , 2008 .

[52]  Pierre Leclercq,et al.  Environnement de conception architecturale pré-intégrée - Eléments d'une plate-forme d'assistance basée sur une représentation sémantique , 1994 .

[53]  Thomas F. Stahovich,et al.  Grouping Strokes into Shapes in Hand-Drawn Diagrams , 2010, AAAI.

[54]  David Craig,et al.  The importance of drawing in the mechanical design process , 1990, Comput. Graph..

[55]  Françoise Détienne,et al.  Characterization of Collaborative Design and Interaction Management Activities in a Distant Engineering Design Situation , 1992 .

[56]  Stéphane Huot Une nouvelle approche pour la conception créative : de l'interprétation du dessin à main levée au prototypage d'interactions non-standard , 2005 .

[57]  Melanie Mitchell,et al.  Analogy-Making as a Complex Adaptive System , 2000 .

[58]  L. Segel,et al.  Design Principles for the Immune System and Other Distributed Autonomous Systems , 2001 .

[59]  Willemien Visser,et al.  The Cognitive Artifacts of Designing , 2006 .

[60]  Paul A. Viola,et al.  Spatial recognition and grouping of text and graphics , 2004, SBM'04.

[61]  Satoshi Matsuoka,et al.  Teddy: A Sketching Interface for 3D Freeform Design , 1999, SIGGRAPH Courses.

[62]  Stéphane Safin,et al.  Du crayon au stylo numérique : influences des IHM à stylo et des interprétations numériques sur l'activité graphique en tâches de conception. , 2011 .

[63]  Stéphane Safin,et al.  Premières évaluations d'un bureau virtuel pour un processus de conception augmenté , 2005, IHM '05.

[64]  Pamela Schenk,et al.  The role of drawing in the graphic design process , 1991 .

[65]  Beryl Plimmer,et al.  A toolkit approach to sketched diagram recognition , 2007, BCS HCI.

[66]  Dominique L. Scapin,et al.  Evaluating a user interface with ergonomic criteria , 1995, Int. J. Hum. Comput. Interact..

[67]  C. Dorst Design research: a revolution-waiting-to-happen☆ , 2008 .

[68]  Hh Henri Achten,et al.  DDDOOLZ. A Virtual Reality Sketch Tool for Early Design , 2000 .

[69]  Éric Anquetil,et al.  Eager interpretation of on-line hand-drawn structured documents: The DALI methodology , 2009, Pattern Recognit..