Image-based rendering of ancient Chinese artifacts for multi-view displays — a multi-camera approach

Image-based rendering (IBR) is an emerging and promising technology for photo-realistic rendering of scenes and objects from a collection of densely sampled images and videos. This paper proposes an image-based approach to the rendering and multi-view display of ancient Chinese artifacts for cultural heritage preservation. A multiple-camera circular array was constructed to record images of the artifacts. Novel techniques for segmenting and rendering new views of the artifacts from the sampled images are developed. The multiple views so synthesized enable the ancient artifacts to be displayed in modern multi-view displays and conventional stereo systems. Several collections from the University Museum and Art Gallery at the University of Hong Kong are captured and excellent rendering results are obtained.

[1]  Harry Shum,et al.  An Object-Based Approach to Image/Video-Based Synthesis and Processing for 3-D and Multiview Televisions , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Leonard McMillan,et al.  Plenoptic Modeling: An Image-Based Rendering System , 2023 .

[3]  Vladimir Kolmogorov,et al.  Multi-camera Scene Reconstruction via Graph Cuts , 2002, ECCV.

[4]  Maurizio Forte.  3D facial reconstruction and visualization of ancient Egyptian mummies using spiral CT data , 1999, SIGGRAPH '99.

[5]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[6]  Marc Levoy,et al.  The digital Michelangelo project: 3D scanning of large statues , 2000, SIGGRAPH.

[7]  Heung-Yeung Shum,et al.  Image-Based Rendering and Synthesis , 2007, IEEE Signal Processing Magazine.

[8]  Andrea Fusiello.  Image-based Rendering * , 2003 .

[9]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[10]  Harry Shum,et al.  Rendering with concentric mosaics , 1999, SIGGRAPH.

[11]  IkeuchiKatsushi,et al.  The Great Buddha Project , 2007 .

[12]  In-So Kweon,et al.  Adaptive Support-Weight Approach for Correspondence Search , 2006, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Harry Shum,et al.  Pop-up light field: An interactive image-based modeling and rendering system , 2004, TOGS.

[14]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[15]  Nanning Zheng,et al.  Stereo Matching Using Belief Propagation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Harry Shum,et al.  Lazy snapping , 2004, ACM Trans. Graph..

[17]  Joost van de Weijer,et al.  Boosting color saliency in image feature detection , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Harry Shum,et al.  The plenoptic video , 2005, IEEE Trans. Circuits Syst. Video Technol..

[19]  Harry Shum,et al.  Image-based rendering , 2006, Found. Trends Comput. Graph. Vis..

[20]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[21]  Toshiaki Fujii,et al.  Ray space coding for 3D visual communication , 1996 .

[22]  Kun Zhou,et al.  Precomputed shadow fields for dynamic scenes , 2005, ACM Trans. Graph..

[23]  S. Osher,et al.  Geometric Level Set Methods in Imaging, Vision, and Graphics , 2011, Springer New York.

[24]  M. Halle,et al.  3-D Displays and Signal Processing , 2007, IEEE Signal Processing Magazine.

[25]  Richard Szeliski,et al.  Creating full view panoramic image mosaics and environment maps , 1997, SIGGRAPH.

[26]  Giuseppe Attardi,et al.  3D Facial Re-construction and Visualization of ancient Egyptian mummies using spiral CT data. Soft tissues re-construction and textures application , 2000 .

[27]  Atsushi Nakazawa,et al.  The great buddha project: modeling cultural heritage for VR systems through observation , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[28]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[29]  E. Adelson,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[30]  Richard Szeliski,et al.  Layered depth images , 1998, SIGGRAPH.