Evolutionary Multiform Optimization With Two-Stage Bidirectional Knowledge Transfer Strategy for Point Cloud Registration

Point cloud registration is an important task in computer vision, where the goal is to estimate a transformation to align a pair of point clouds. Most of the existing registration methods face the problems of poor robustness and getting stuck in local optima. Evolutionary multitasking is an effective paradigm to enhance global search capability and improve convergence characteristics through knowledge transfer across multiple related tasks. Inspired by evolutionary multitasking, this article proposes a multiform optimization approach through evolutionary multitasking for solving the point cloud registration problems. We first construct two related registration tasks with different functional landscapes to form a multiform optimization problem. Compared with methods that only focus on a single registration attribute, the two proposed tasks focus on robustness and precision of registration, respectively. Then, a new two-stage bidirectional knowledge transfer strategy is presented, which can implement efficient knowledge transfer among two related tasks. Finally, both simulations and real experiments show the power of our method. The proposed method is robust to noise, outliers, and partial overlaps and is effective in multiple real registration scenarios, such as object registration, scene reconstruction, and simultaneous localization and mapping.

[1]  Qingfu Zhang,et al.  Multiobjective Multitask Optimization-Neighborhood as a Bridge for Knowledge Transfer , 2023, IEEE Transactions on Evolutionary Computation.

[2]  Jun Zhang,et al.  A Review on Evolutionary Multitask Optimization: Trends and Challenges , 2022, IEEE Transactions on Evolutionary Computation.

[3]  Q. Miao,et al.  Multi-View Point Cloud Registration Based on Evolutionary Multitasking With Bi-Channel Knowledge Sharing Mechanism , 2022, IEEE Transactions on Emerging Topics in Computational Intelligence.

[4]  Kai Wu,et al.  Solving Multitask Optimization Problems With Adaptive Knowledge Transfer via Anomaly Detection , 2022, IEEE Transactions on Evolutionary Computation.

[5]  Jing J. Liang,et al.  An Evolutionary Multitasking Optimization Framework for Constrained Multiobjective Optimization Problems , 2022, IEEE Transactions on Evolutionary Computation.

[6]  Zexuan Zhu,et al.  Evolutionary Many-Task Optimization Based on Multisource Knowledge Transfer , 2021, IEEE Transactions on Evolutionary Computation.

[7]  Kai Liu,et al.  A study on multiform multi-objective evolutionary optimization , 2021, Memetic Computing.

[8]  Neil Zhenqiang Gong,et al.  PointGuard: Provably Robust 3D Point Cloud Classification , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Xiaoshui Huang,et al.  A comprehensive survey on point cloud registration , 2021, ArXiv.

[10]  Xiaodong Li,et al.  Enhanced Multifactorial Evolutionary Algorithm With Meme Helper-Tasks , 2021, IEEE Transactions on Cybernetics.

[11]  Rohit Girdhar,et al.  Self-Supervised Pretraining of 3D Features on any Point-Cloud , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[12]  Nadia Nedjah,et al.  Simultaneous localization and mapping using swarm intelligence based methods , 2020, Expert Syst. Appl..

[13]  Yusheng Xu,et al.  Registration of large-scale terrestrial laser scanner point clouds: A review and benchmark , 2020 .

[14]  Zexuan Zhu,et al.  Toward Adaptive Knowledge Transfer in Multifactorial Evolutionary Computation , 2020, IEEE Transactions on Cybernetics.

[15]  Dongbo Zhang,et al.  Pointfilter: Point Cloud Filtering via Encoder-Decoder Modeling , 2020, IEEE Transactions on Visualization and Computer Graphics.

[16]  Zexuan Zhu,et al.  Multiobjective Evolutionary Multitasking With Two-Stage Adaptive Knowledge Transfer Based on Population Distribution , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[17]  Zexuan Zhu,et al.  A hybrid of genetic transform and hyper-rectangle search strategies for evolutionary multi-tasking , 2019, Expert Syst. Appl..

[18]  Abhishek Gupta,et al.  Curbing Negative Influences Online for Seamless Transfer Evolutionary Optimization , 2019, IEEE Transactions on Cybernetics.

[19]  Ping He,et al.  A point cloud registration algorithm based on normal vector and particle swarm optimization , 2019, Measurement and Control.

[20]  Chuan-Kang Ting,et al.  Evolutionary Manytasking Optimization Based on Symbiosis in Biocoenosis , 2019, AAAI.

[21]  Christoffer Heckman,et al.  Robust low-overlap 3-D point cloud registration for outlier rejection , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[22]  Yusheng Xu,et al.  Pairwise coarse registration of point clouds in urban scenes using voxel-based 4-planes congruent sets , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[23]  Yew-Soon Ong,et al.  Back to the Roots: Multi-X Evolutionary Computation , 2019, Cognitive Computation.

[24]  Xuetao Zhang,et al.  A method of partially overlapping point clouds registration based on differential evolution algorithm , 2018, PloS one.

[25]  Ping He,et al.  A three-dimensional point cloud registration based on entropy and particle swarm optimization , 2018, Advances in Mechanical Engineering.

[26]  B. Ripley,et al.  Robust Statistics , 2018, Encyclopedia of Mathematical Geosciences.

[27]  Hua Xu,et al.  Objective Reduction in Many-Objective Optimization: Evolutionary Multiobjective Approaches and Comprehensive Analysis , 2018, IEEE Transactions on Evolutionary Computation.

[28]  Simon Korman,et al.  Latent RANSAC , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[29]  Abhishek Gupta,et al.  Insights on Transfer Optimization: Because Experience is the Best Teacher , 2018, IEEE Transactions on Emerging Topics in Computational Intelligence.

[30]  Bisheng Yang,et al.  A novel binary shape context for 3D local surface description , 2017 .

[31]  Xuming Ge,et al.  Automatic markerless registration of point clouds with semantic-keypoint-based 4-points congruent sets , 2017 .

[32]  Long Quan,et al.  Fast Descriptors and Correspondence Propagation for Robust Global Point Cloud Registration , 2017, IEEE Transactions on Image Processing.

[33]  Liang Feng,et al.  Evolutionary multitasking across single and multi-objective formulations for improved problem solving , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[34]  Yew-Soon Ong,et al.  Multifactorial Evolution: Toward Evolutionary Multitasking , 2016, IEEE Transactions on Evolutionary Computation.

[35]  Yew-Soon Ong,et al.  Evolutionary Multitasking: A Computer Science View of Cognitive Multitasking , 2016, Cognitive Computation.

[36]  Vladlen Koltun,et al.  Robust reconstruction of indoor scenes , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  Per Bergström,et al.  Robust registration of point sets using iteratively reweighted least squares , 2014, Computational Optimization and Applications.

[38]  Fengmin Xu,et al.  $L_{1/2}$ Regularization: A Thresholding Representation Theory and a Fast Solver , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[39]  Radu Horaud,et al.  Projective alignment of range and parallax data , 2011, CVPR 2011.

[40]  Daniel Cohen-Or,et al.  4-points congruent sets for robust pairwise surface registration , 2008, ACM Trans. Graph..

[41]  Anikó Ekárt,et al.  Pre-registration of arbitrarily oriented 3D surfaces using a genetic algorithm , 2006, Pattern Recognit. Lett..

[42]  Petros Koumoutsakos,et al.  Reducing the Time Complexity of the Derandomized Evolution Strategy with Covariance Matrix Adaptation (CMA-ES) , 2003, Evolutionary Computation.

[43]  Kjell Brunnström,et al.  Genetic algorithms for free-form surface matching , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[44]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[45]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[46]  P. Holland,et al.  Robust regression using iteratively reweighted least-squares , 1977 .