C ANVAS : Context-inferred Interpretation of Sketches for Preparatory Design Studies

In early or preparatory design stages, an architect or designer sketches out rough ideas, not only about the object or structure being considered, but its relation to its spatial context. This is an iterative process, where the sketches are not only the primary means for testing and refining ideas, but also for communicating among a design team and to clients. Hence, sketching is the preferred media for artists and designers during the early stages of design, albeit with a major drawback: sketches are 2D and effects such as view perturbations or object movement are not supported, thereby inhibiting the design process. We present an interactive system that allows for the creation of a 3D abstraction of a designed space, built primarily by sketching in 2D within the context of an anchoring design or photograph. The system is progressive in the sense that the interpretations are refined as the user continues sketching. As a key technical enabler, we reformulate the sketch interpretation process as a selection optimization from a set of context-generated canvas planes in order to retrieve a regular arrangement of planes. We demonstrate our system (available at http:/geometry.cs.ucl.ac.uk/projects/2016/smartcanvas/) with a wide range of sketches and design studies.

[1]  T. Strothotte,et al.  Assessing the effect of non-photorealistic rendered images in CAD , 1996, CHI.

[2]  Satoshi Matsuoka,et al.  Teddy: A Sketching Interface for 3D Freeform Design , 1999, SIGGRAPH Courses.

[3]  Vladimir Kolmogorov,et al.  What energy functions can be minimized via graph cuts? , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Ian D. Reid,et al.  Single View Metrology , 2000, International Journal of Computer Vision.

[5]  Baoquan Chen,et al.  SMARTPAPER: An Interactive and User Friendly Sketching System , 2004, Comput. Graph. Forum.

[6]  Kiia Kallio 3D6B Editor: Projective 3D Sketching with Line-Based Rendering , 2005, SBM.

[7]  Holly E. Rushmeier,et al.  The Mental Canvas: A Tool for Conceptual Architectural Design and Analysis , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[8]  Hod Lipson,et al.  Optimization-based reconstruction of a 3D object from a single freehand line drawing , 1996, Comput. Aided Des..

[9]  Adam Finkelstein,et al.  Where do people draw lines? , 2008, ACM Trans. Graph..

[10]  Ravin Balakrishnan,et al.  ILoveSketch: as-natural-as-possible sketching system for creating 3d curve models , 2008, UIST '08.

[11]  Harry Shum,et al.  Sketching reality: Realistic interpretation of architectural designs , 2008, TOGS.

[12]  Ryan Schmidt,et al.  Analytic drawing of 3D scaffolds , 2009, ACM Trans. Graph..

[13]  Takeo Igarashi,et al.  Structured annotations for 2D-to-3D modeling , 2009, ACM Trans. Graph..

[14]  Ravin Balakrishnan,et al.  EverybodyLovesSketch: 3D sketching for a broader audience , 2009, UIST '09.

[15]  Takeo Igarashi,et al.  Modeling-in-Context: User Design of Complementary Objects with a Single Photo , 2010, SBIM.

[16]  Ligang Liu,et al.  Analysis, reconstruction and manipulation using arterial snakes , 2010, ACM Trans. Graph..

[17]  Takeo Igarashi,et al.  SketchChair: an all-in-one chair design system for end users , 2011, Tangible and Embedded Interaction.

[18]  Holly E. Rushmeier,et al.  Insitu: sketching architectural designs in context , 2011, ACM Trans. Graph..

[19]  CrossShade: shading concept sketches using cross-section curves , 2012, ACM Trans. Graph..

[20]  Marc Alexa,et al.  How do humans sketch objects? , 2012, ACM Trans. Graph..

[21]  Shi-Min Hu,et al.  Sketch2Scene: sketch-based co-retrieval and co-placement of 3D models , 2013, ACM Trans. Graph..

[22]  Daniel Cohen-Or,et al.  Geosemantic Snapping for Sketch‐Based Modeling , 2013, Comput. Graph. Forum.

[23]  Daniel Cohen-Or,et al.  Sketch‐to‐Design: Context‐Based Part Assembly , 2012, Comput. Graph. Forum.

[24]  Kun Zhou,et al.  Interpreting concept sketches , 2013, ACM Trans. Graph..

[25]  Adrien Bousseau,et al.  True2Form: 3D curve networks from 2D sketches via selective regularization , 2014, ACM Trans. Graph..

[26]  Karan Singh,et al.  Flow-complex-based shape reconstruction from 3D curves , 2014, TOGS.

[27]  Niloy J. Mitra,et al.  Replaceable Substructures for Efficient Part‐Based Modeling , 2015, Comput. Graph. Forum.

[28]  Adrien Bousseau,et al.  Line drawing interpretation in a multi-view context , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).