An Accelerated Procrustean Markov Process Model With Coherent Constraint for Non-Rigid Structure From Motion

Non-Rigid Structure from Motion (NRSfM) is the task of reconstructing the 3D point set of a non-rigid object from an ensemble of images with 2D correspondences, which has been a long-lasting challenging research topic. Compared to the state-of-the-art methods for NRSfM, the Procrustean Markov Process (PMP) model has obtained a relatively good performance. However, the estimation error and the convergence time of the PMP model will increase simultaneously when noise is present. To address this problem, in this paper, a coherent constraint is constructed to suppress the noise in the initialization step of the PMP algorithm. Moreover, an Accelerated Expectation Maximization (AEM) algorithm is devised to optimize the PMP estimation model. Experimental results on several widely used sequences demonstrate that our proposed algorithm achieves state-of-the-art performance, as well as its effectiveness and feasibility.

[1]  Qiulei Dong,et al.  Latent-Smoothness Nonrigid Structure From Motion by Revisiting Multilinear Factorization , 2019, IEEE Transactions on Cybernetics.

[2]  Aleix M. Martínez,et al.  Non-rigid structure from motion with complementary rank-3 spaces , 2011, CVPR 2011.

[3]  Chong-Ho Choi,et al.  Procrustean Normal Distribution for Non-Rigid Structure from Motion , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Aaron Hertzmann,et al.  Nonrigid Structure-from-Motion: Estimating Shape and Motion with Hierarchical Priors , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Geng Yang,et al.  cGAN Based Facial Expression Recognition for Human-Robot Interaction , 2019, IEEE Access.

[6]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[7]  Francesc Moreno-Noguer,et al.  A scalable, efficient, and accurate solution to non-rigid structure from motion , 2018, Comput. Vis. Image Underst..

[8]  Takeo Kanade,et al.  Trajectory Space: A Dual Representation for Nonrigid Structure from Motion , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  J. Gower.  Generalized procrustes analysis , 1975 .

[10]  Henning Biermann,et al.  Recovering non-rigid 3D shape from image streams , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[11]  Takeo Kanade,et al.  Shape and motion from image streams under orthography: a factorization method , 1992, International Journal of Computer Vision.

[12]  Alan L. Yuille,et al.  A mathematical analysis of the motion coherence theory , 1989, International Journal of Computer Vision.

[13]  Chi-Yi Tsai,et al.  Simultaneous 3D Object Recognition and Pose Estimation Based on RGB-D Images , 2018, IEEE Access.

[14]  Chong-Ho Choi,et al.  A Procrustean Markov Process for Non-rigid Structure Recovery , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Jing Xiao,et al.  A Closed-Form Solution to Non-Rigid Shape and Motion Recovery , 2004, International Journal of Computer Vision.

[16]  Hanho Lee,et al.  High-Secure Fingerprint Authentication System Using Ring-LWE Cryptography , 2019, IEEE Access.

[17]  Sang-Youn Kim,et al.  Interacting Automultiscopic 3D With Haptic Paint Brush in Immersive Room , 2018, IEEE Access.

[18]  Bin Jiang,et al.  3D Panoramic Virtual Reality Video Quality Assessment Based on 3D Convolutional Neural Networks , 2018, IEEE Access.

[19]  Hongdong Li,et al.  A Simple Prior-Free Method for Non-rigid Structure-from-Motion Factorization , 2012, International Journal of Computer Vision.

[20]  Aleix M. Martínez,et al.  Kernel non-rigid structure from motion , 2011, 2011 International Conference on Computer Vision.

[21]  Aleix M. Martínez,et al.  Computing Smooth Time Trajectories for Camera and Deformable Shape in Structure from Motion with Occlusion , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Didier Stricker,et al.  Scalable Dense Monocular Surface Reconstruction , 2017, 2017 International Conference on 3D Vision (3DV).

[23]  Anoop Cherian,et al.  Scalable Dense Non-rigid Structure-from-Motion: A Grassmannian Perspective , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[24]  Andriy Myronenko,et al.  Point Set Registration: Coherent Point Drift , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.