Dense Points Aided Performance Evaluation Criterion of Human Obsevation for Image-based 3D Reconstruction

3D reconstruction is widely used in various scenarios such as virtual simulation and unmanned driving. Correspondingly, the requirements for its quality have been greatly improved. This paper presents a series of performance evaluation criteria based on the internal distribution of dense point cloud. In the definition of the assessment, the amount of point cloud information, uniform distribution, and the level of structural recurrence are considered. Using the criterion proposed in this paper, the pros and cons of the 3D reconstruction result can be comprehensively evaluated in comparison experiments of improving certain steps or using different methods. The design can further guide directions for optimization research and subsequent application. The experimental results show that adding the proposed standards based on general assessments can effectively reflect the quality of the reconstruction model. The performance evaluation criteria are scientific and practical.

[1]  Steven M. Seitz,et al.  Multicore bundle adjustment , 2011, CVPR 2011.

[2]  Anurag Sai Vempati,et al.  Onboard real-time dense reconstruction of large-scale environments for UAV , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[3]  Yunbo Rao,et al.  Extreme Feature Regions Detection and Accurate Quality Assessment for Point-Cloud 3D Reconstruction , 2019, IEEE Access.

[4]  Changchang Wu,et al.  Structure from Motion Using Structure-Less Resection , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[5]  Benjamin J. Schmid,et al.  Building Descriptors From Local Feature Neighborhoods for Applications in Semi-Dense 3D Reconstruction , 2018, IEEE Transactions on Image Processing.

[6]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[7]  Andrew W. Fitzgibbon,et al.  Towards Pointless Structure from Motion: 3D Reconstruction and Camera Parameters from General 3D Curves , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[8]  Tomonari Furukawa,et al.  Global Vision-Based Reconstruction of Three-Dimensional Road Surfaces Using Adaptive Extended Kalman Filter , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[9]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Jiamao Li,et al.  Dynamic Obstacles Rejection for 3D Map Simultaneous Updating , 2018, IEEE Access.

[11]  Changchang Wu,et al.  SiftGPU : A GPU Implementation of Scale Invariant Feature Transform (SIFT) , 2007 .

[12]  Margarita Chli,et al.  Real-time local 3D reconstruction for aerial inspection using superpixel expansion , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[13]  Changchang Wu,et al.  Towards Linear-Time Incremental Structure from Motion , 2013, 2013 International Conference on 3D Vision.

[14]  Pascal Monasse,et al.  Tree-Based Morse Regions: A Topological Approach to Local Feature Detection , 2014, IEEE Transactions on Image Processing.

[15]  Richard Szeliski,et al.  Towards Internet-scale multi-view stereo , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Torsten Sattler,et al.  Comparative Evaluation of Hand-Crafted and Learned Local Features , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Jingtai Liu,et al.  Photography Constraint Aided Keyframe Selection and Matching Method for UAV 3D Reconstruction , 2018, 2018 Chinese Control And Decision Conference (CCDC).

[18]  Pascal Fua,et al.  A Performance Evaluation of Local Features for Image-Based 3D Reconstruction , 2017, IEEE Transactions on Image Processing.