A cameraphone-based approach for the generation of 3D models from paper sketches

Due to the advantages it offers, a sketch-based user-interface (UI) has been utilised in various domains, such as 3D modelling, 'graphical user-interface' design, 3D animation of cartoon characters, etc. However, its benefits have not yet been adequately exploited with those of a mobile phone, despite that the latter is nowadays a widely used wireless handheld device for mobile communication. Given this scenario, this paper discloses a novel approach of using a paper sketch-based UI, which combines the benefits of paper sketching and those of a cameraphone (a mobile phone with an integrated camera), in the domain of 'early form' design modelling. More specifically, the framework disclosed and evaluated in this paper, enables users to remotely obtain visual representations of 3D geometric models from freehand sketches by combining the portability of paper with that of cameraphones. Based on this framework, a prototype tool has been implemented and evaluated. Despite the limitations of the current prototype tool, the evaluation results of the framework's underlying concepts and of the prototype tool collectively indicate that the idea disclosed in this paper contributes in providing users with a mobile sketch-based interface, which can also be used in other domains, beyond 'early form' design modelling.

[1]  Irwin King,et al.  Randomized generalized Hough transform for 2-D gray scale object detection , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[2]  Gershon Elber,et al.  Inferring 3D models from freehand sketches and constraints , 1997, Comput. Aided Des..

[3]  Christine Alvarado,et al.  A Framework for Multi-Domain Sketch Recognition , 2002 .

[4]  Udo Lindemann,et al.  DIGITAL FREE-HAND SKETCHING IN 3D - A TOOL FOR EARLY DESIGN PHASES , 2003 .

[5]  S. Roth-Koch.  Generating CAD Models form Sketches , 2000, Workshop on Geometric Modeling.

[6]  Francisco Charte.  Visual Basic .NET , 2002 .

[7]  M. Gross,et al.  Digital clay: deriving digital models from freehand sketches , 2000 .

[8]  Joaquim A. Jorge,et al.  Towards Calligraphic Interfaces: Sketching 3D Scenes with Gestures and Context Icons , 2000, WSCG.

[9]  Pieter Jan Stappers,et al.  Toward Electronic Napkins and Beermats: Computer Support for Visual Ideation Skills , 1999, Visual Representations and Interpretations.

[10]  Mohamed S. Kamel,et al.  Extraction of Binary Character/Graphics Images from Grayscale Document Images , 1993, CVGIP Graph. Model. Image Process..

[11]  Paul Rodgers,et al.  Visible ideas:Information patterns of conceptual sketch activity , 1998 .

[12]  Louis Weitzman,et al.  Relational Grammars: Theory and Practice in a Visual Language Interface for Process Modeling , 1996 .

[13]  Geoff Holmes,et al.  Natural language and computational linguistics , 1991 .

[14]  Philip J. Farrugia,et al.  WHY CAD TOOLS BENEFIT FROM A SKETCHING LANGUAGE , 2003 .

[15]  Manuel Contero,et al.  CONCEPTUAL MODELING TOOL AT THE EARLY DESIGN PHASE , 2003 .

[16]  Joaquim A. Jorge,et al.  JavaSketchIt: Issues in Sketching the Look of User Interfaces , 2002 .

[17]  Geoff Holmes,et al.  Natural language and computational linguistics - an introduction , 1991, Ellis Horwood Series in computers and their applications.

[18]  David Pugh,et al.  Designing solid objects using interactive sketch interpretation , 1992, I3D '92.

[19]  Masaki Suwa,et al.  Unexpected discoveries and S-invention of design requirements , 2000 .

[20]  Enric Martí,et al.  Line-drawing interpretation as polyhedral objects to man-machine interaction in CAD systems , 1994 .