Super-Resolution of Multiple Moving 3D Objects with Pixel-Based Registration

In this paper, we propose a super-resolution technique for multiple independently moving 3D objects from a single camera, the camera is also allowed to move freely Previous techniques were mostly focused on planar objects, and it was difficult to realize super-resolution for the scene containing 3D objects, due to significant appearance changes caused by objects' motion and viewpoint changes In this paper, we propose a new technique which can solve the above mentioned problems by applying pixel-based registration instead of planar based registration, which are commonly used in the previous 3D super-resolution techniques Since the technique is pixel-wise and is not required to divide the scene into planar patches, it can be applied to images containing objects with complex shapes or non-rigid objects, to which applying planar approximation is difficult.

[1]  Takashi Matsuyama,et al.  Simultaneous super-resolution and 3D video using graph-cuts , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  D. Du,et al.  Computing in Euclidean Geometry , 1995 .

[3]  Xiaojun Wu,et al.  Real-time dynamic 3-D object shape reconstruction and high-fidelity texture mapping for 3-D video , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  David Eppstein,et al.  MESH GENERATION AND OPTIMAL TRIANGULATION , 1992 .

[5]  Hideo Saito,et al.  Super-Resolved Image Synthesis from Uncalibrated Camera with Unknown Motion , 2002, MVA.

[6]  Roberto Cipolla,et al.  Automatic 3D Modelling of Architecture , 2000, BMVC.

[7]  Subhashis Banerjee,et al.  Super Resolution of Images of 3D Scenecs , 2007, ACCV.

[8]  Takeo Kanade,et al.  Image-consistent surface triangulation , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[9]  Henrik I. Christensen,et al.  Multiple Plane Segmentation Using Optical Flow , 2002, BMVC.

[10]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[11]  C Tomasi,et al.  Shape and motion from image streams: a factorization method. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[12]  Aggelos K. Katsaggelos,et al.  Super Resolution of Images and Video , 2006, Super Resolution of Images and Video.