Depth Estimation of a Deformable Object via a Monocular Camera

The depth estimation of the 3D deformable object has become increasingly crucial to various intelligent applications. In this paper, we propose a feature-based approach for accurate depth estimation of a deformable 3D object with a single camera, which reduces the problem of depth estimation to a pose estimation problem. The proposed method needs to reconstruct the target object at the very beginning. With the 3D reconstruction as an a priori model, only one monocular image is required afterwards to estimate the target object’s depth accurately, regardless of pose changes or deformability of the object. Experiments are taken on an NAO robot and a human to evaluate the depth estimation accuracy by the proposed method.

[1]  Guohui Wang,et al.  A New Oren-Nayar Shape-from-Shading Approach for 3D Reconstruction Using High-Order Godunov-Based Scheme , 2018, Algorithms.

[2]  Yong Woon Park,et al.  3D Reconstruction Framework for Multiple Remote Robots on Cloud System , 2017, Symmetry.

[3]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[4]  Z. Geng,et al.  Depth Estimation from Single Image Using CNN-Residual Network , 2017 .

[5]  Nassir Navab,et al.  Deeper Depth Prediction with Fully Convolutional Residual Networks , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[6]  Rob Fergus,et al.  Depth Map Prediction from a Single Image using a Multi-Scale Deep Network , 2014, NIPS.

[7]  Vladlen Koltun,et al.  Dense Monocular Depth Estimation in Complex Dynamic Scenes , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Ce Liu,et al.  Depth Transfer: Depth Extraction from Video Using Non-Parametric Sampling , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Alexandru Telea,et al.  An Unified Multiscale Framework for Planar, Surface, and Curve Skeletonization , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Dolors Ayala,et al.  Erosion and Dilation on 2-D and 3-D Digital Images: A New Size-Independent Approach , 2001, VMV.

[11]  Junyi Chen,et al.  3-D Reconstruction of Binocular Vision Using Distance Objective Generated From Two Pairs of Skew Projection Lines , 2017, IEEE Access.

[12]  Gustavo Carneiro,et al.  Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescue , 2016, ECCV.

[13]  Liang Lin,et al.  Monocular Depth Estimation with Affinity, Vertical Pooling, and Label Enhancement , 2018, ECCV.

[14]  Xu Chang,et al.  Reconstruction of Hydraulic Fractures Using Passive Ultrasonic Travel-Time Tomography , 2018 .

[15]  Jian Su,et al.  Global Calibration Method of a Camera Using the Constraint of Line Features and 3D World Points , 2016 .

[16]  Jing Yuan,et al.  Optimization reconstruction method of object profile using flexible laser plane and bi-planar references , 2018, Scientific Reports.

[17]  Oisin Mac Aodha,et al.  Unsupervised Monocular Depth Estimation with Left-Right Consistency , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Rynson W. H. Lau,et al.  Look Deeper into Depth: Monocular Depth Estimation with Semantic Booster and Attention-Driven Loss , 2018, ECCV.

[19]  Introduction to Topology -- 2 in nLab , 2017 .

[20]  Ashutosh Saxena,et al.  Depth Estimation Using Monocular and Stereo Cues , 2007, IJCAI.

[21]  Jing Yuan,et al.  3D reconstruction of laser projective point with projection invariant generated from five points on 2D target , 2017, Scientific Reports.

[22]  Raja Giryes,et al.  Depth Estimation From a Single Image Using Deep Learned Phase Coded Mask , 2018, IEEE Transactions on Computational Imaging.

[23]  Dacheng Tao,et al.  Deep Ordinal Regression Network for Monocular Depth Estimation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[24]  William A. P. Smith,et al.  Linear Depth Estimation from an Uncalibrated, Monocular Polarisation Image , 2016, ECCV.