A general texture mapping framework for image-based 3D modeling

This paper presents a general texture mapping framework for image-based 3D modeling. It aims to generating seamless texture map for 3D model created by real-world photos under uncontrolled environment. Our proposed method addresses two challenging problems: 1) texture discontinuity due to system error in 3D modeling from self-calibration; 2) color/lighting difference among images due to real-world uncontrolled environments. The general framework contains two stages to resolve these problems. The first stage globally optimizes the registration of texture patches and triangle faces with Markov Random Field (MRF) to optimize texture mosaic. The second stage does local radiometric correction to adjust color difference between texture patches and then blend texture boundaries to improve color continuity. The proposed method is evaluated on several 3D models by image-based 3D modeling, and demonstrates promising results.

[1]  Robert B. Fisher,et al.  Colour texture fusion of multiple range images , 2003, Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings..

[2]  J. Ostermann,et al.  Congestion Control for Scalable Video Streaming Using the Scalability Extension of H.264/AVC , 2007, IEEE Journal of Selected Topics in Signal Processing.

[3]  Heiko Schwarz,et al.  A LOW-COMPLEXITY APPROACH FOR INCREASING THE GRANULARITY OF PACKET-BASED FIDELITY SCALABILITY IN SCALABLE VIDEO CODING , 2007 .

[4]  R. Basri,et al.  Direct visibility of point sets , 2007, SIGGRAPH 2007.

[5]  Jin Cao,et al.  Stochastic models for generating synthetic HTTP source traffic , 2004, IEEE INFOCOM 2004.

[6]  Victor S. Lempitsky,et al.  Seamless Mosaicing of Image-Based Texture Maps , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Shmuel Peleg,et al.  Seamless Image Stitching in the Gradient Domain , 2004, ECCV.

[8]  Robert B. Fisher,et al.  Multiple color texture map fusion for 3D models , 2007, Pattern Recognit. Lett..

[9]  Keith W. Ross,et al.  Implementation of adaptive streaming of stored MPEG-4 FGS video over TCP , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[10]  Wenjun Zeng,et al.  Rate-distortion optimized dynamic bitstream switching for scalable video streaming , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[11]  Pascal Frossard,et al.  Distortion-buffer optimized TCP video streaming , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[12]  Eric Q. Li,et al.  Bundled depth-map merging for multi-view stereo , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  David P. Dobkin,et al.  The quickhull algorithm for convex hulls , 1996, TOMS.

[14]  Yousaf Bin Zikria,et al.  Video Transport over Heterogeneous Networks Using SCTP and DCCP , 2008, IMTIC.

[15]  Mathias Wien,et al.  Real-Time System for Adaptive Video Streaming Based on SVC , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Edward H. Adelson,et al.  A multiresolution spline with application to image mosaics , 1983, TOGS.

[17]  Marc Pollefeys,et al.  Robust Radiometric Calibration and Vignetting Correction , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Mark Handley,et al.  Datagram Congestion Control Protocol (DCCP) , 2006, RFC.

[19]  Bernd Girod,et al.  Rate-distortion hint tracks for adaptive video streaming , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Jean-Philippe Pons,et al.  Seamless image-based texture atlases using multi-band blending , 2008, 2008 19th International Conference on Pattern Recognition.

[21]  Wenjun Zeng,et al.  Joint Design of Source Rate Control and QoS-Aware Congestion Control for Video Streaming over the Internet , 2007, 2005 IEEE 7th Workshop on Multimedia Signal Processing.

[22]  Bernd Girod,et al.  Advances in channel-adaptive video streaming , 2002, Proceedings. International Conference on Image Processing.

[23]  Mario Gerla,et al.  Adaptive video streaming: pre-encoded MPEG-4 with bandwidth scaling , 2004, Comput. Networks.

[24]  Shamik Sural,et al.  Segmentation and histogram generation using the HSV color space for image retrieval , 2002, Proceedings. International Conference on Image Processing.

[25]  Kwangsue Chung,et al.  Buffer-driven adaptive video streaming with TCP-friendliness , 2008, Comput. Commun..

[26]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[27]  Adam Baumberg,et al.  Blending Images for Texturing 3D Models , 2002, BMVC.

[28]  Heiko Schwarz,et al.  Overview of the Scalable Video Coding Extension of the H.264/AVC Standard , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[29]  Jim Kurose,et al.  Multimedia streaming via TCP: an analytic performance study , 2004, SIGMETRICS 2004.

[30]  Muhammad Ajmal Azad,et al.  A comparative analysis of DCCP variants (CCID2, CCID3), TCP and UDP for MPEG4 video applications , 2009, 2009 International Conference on Information and Communication Technologies.