VideoTrace: rapid interactive scene modelling from video

VideoTrace is a system for interactively generating realistic 3D models of objects from video---models that might be inserted into a video game, a simulation environment, or another video sequence. The user interacts with VideoTrace by tracing the shape of the object to be modelled over one or more frames of the video. By interpreting the sketch drawn by the user in light of 3D information obtained from computer vision techniques, a small number of simple 2D interactions can be used to generate a realistic 3D model. Each of the sketching operations in VideoTrace provides an intuitive and powerful means of modelling shape from video, and executes quickly enough to be used interactively. Immediate feedback allows the user to model rapidly those parts of the scene which are of interest and to the level of detail required. The combination of automated and manual reconstruction allows VideoTrace to model parts of the scene not visible, and to succeed in cases where purely automated approaches would fail.

[1]  Reinhard Koch,et al.  Visual Modeling with a Hand-Held Camera , 2004, International Journal of Computer Vision.

[2]  Philip H. S. Torr,et al.  Building Models of Regular Scenes from Structure and Motion , 2006, BMVC.

[3]  Les A. Piegl,et al.  The NURBS book (2nd ed.) , 1997 .

[4]  Wolfgang Niem,et al.  MAPPING TEXTURE FROM MULTIPLE CAMERA VIEWS ONTO 3D-OBJECT MODELS FOR COMPUTER ANIMATION , 1995 .

[5]  Long Quan,et al.  Image-based plant modeling , 2006, SIGGRAPH 2006.

[6]  J. Hughes,et al.  SmoothSketch: 3D free-form shapes from complex sketches , 2006, ACM Trans. Graph..

[7]  Toby Howard,et al.  Interactive reconstruction of virtual environments from video sequences , 2003, Computers & graphics.

[8]  Vladimir Kolmogorov,et al.  An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Long Quan,et al.  Modeling hair from multiple views , 2005, SIGGRAPH 2005.

[10]  Les A. Piegl,et al.  The NURBS Book , 1995, Monographs in Visual Communication.

[11]  Jitendra Malik,et al.  Learning a classification model for segmentation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[12]  Paul Debevec,et al.  Modeling and Rendering Architecture from Photographs , 1996, SIGGRAPH 1996.

[13]  Peter F. Sturm,et al.  Using geometric constraints through parallelepipeds for calibration and 3D modeling , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Thorsten Thormählen,et al.  Zuverlässige Schätzung der Kamerabewegung aus einer Bildfolge , 2006 .

[15]  David Salesin,et al.  Keyframe-based tracking for rotoscoping and animation , 2004, ACM Trans. Graph..

[16]  Hod Lipson,et al.  Classification of Sketch Strokes and Corner Detection Using Conic Sections and Adaptive Clustering , 1997 .

[17]  Roberto Cipolla,et al.  Modelling and Interpretation of Architecture from Several Images , 2004, International Journal of Computer Vision.

[18]  Luc Van Gool,et al.  Procedural modeling of buildings , 2006, ACM Trans. Graph..