3D point cloud registration denoising method for human motion image using deep learning algorithm

Aiming at the problem of 3D point cloud noise affecting the efficiency and precision of human body 3D reconstruction in complex scenes, a 3D point cloud registration denoising method for human motion image using depth learning algorithm is proposed. First, two Kinect sensors are used to collect the three-dimensional data of the human body in the scene, and the spatial alignment under the Bursa linear model is used to pre-process the background point cloud data. The depth image of the point cloud is calculated, and the depth image pair is extracted by the convolutional neural network. Furthermore, the feature difference of the depth image pair is taken as the input of the fully connected network and the point cloud registration parameter is calculated, and the above operation is performed iteratively until the registration error is less than the acceptable threshold. Then, the improved C-means algorithm is used to remove the outlier, the noise is clustered, and the large-scale outlier noise is removed. Finally, the high-frequency information is processed by the depth data bilateral filtering method. The experimental results show that compared with the traditional bilateral filtering algorithm and fuzzy C-means algorithm, the proposed method can effectively remove noise of different scales and maintain good performance on the basis of maintaining human body features. In the point cloud model of A, B, and C, the average error of the proposed method is lower than that of the traditional bilateral filtering algorithm with 15.7%, 15.9%, and 19.8%, respectively, and it is lower than that of the fuzzy C-means algorithm with 25.8%, 26.9%, and 30.2%, respectively.

[1]  Carlos Frederico de Oliveira Graeff,et al.  An open-source equipment for thin film fabrication by electrodeposition, dip coating, and SILAR , 2016, The International Journal of Advanced Manufacturing Technology.

[2]  Qinkun Xiao,et al.  Human motion retrieval based on deep learning and dynamic time warping , 2017, 2017 2nd International Conference on Robotics and Automation Engineering (ICRAE).

[3]  Anca D. Dragan,et al.  Comparing human-centric and robot-centric sampling for robot deep learning from demonstrations , 2016, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[4]  Qing Hu,et al.  A frame-level encoder rate control scheme for transform domain Wyner-Ziv video coding , 2016, Multimedia Tools and Applications.

[5]  Wenzhi Chen,et al.  An efficient approach for feature-preserving mesh denoising , 2017 .

[6]  Ming Li,et al.  A Progressive Transmission Technique for the Streaming of Point Cloud Data Using the Kinect , 2018, 2018 International Conference on Computing, Networking and Communications (ICNC).

[7]  Di Wu,et al.  Recent advances in video-based human action recognition using deep learning: A review , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[8]  Michalis A. Savelonas,et al.  Spatially sensitive statistical shape analysis for pedestrian recognition from LIDAR data , 2018, Comput. Vis. Image Underst..

[9]  In-So Kweon,et al.  Refining Geometry from Depth Sensors using IR Shading Images , 2016, International Journal of Computer Vision.

[10]  Yuxin Liu,et al.  Guided point cloud denoising via sharp feature skeletons , 2017, The Visual Computer.

[11]  Simon Choppin,et al.  Assessment of a Microsoft Kinect-based 3D scanning system for taking body segment girth measurements: a comparison to ISAK and ISO standards , 2016, Journal of sports sciences.

[12]  Kensuke Harada,et al.  Deep Learning Scooping Motion Using Bilateral Teleoperations , 2018, 2018 3rd International Conference on Advanced Robotics and Mechatronics (ICARM).

[13]  Wanggen Wan,et al.  Clustering and DCT Based Color Point Cloud Compression , 2017, J. Signal Process. Syst..

[14]  Nadia Magnenat-Thalmann Welcome to the year 2017 , 2016, The Visual Computer.

[15]  Wei Tsang Ooi,et al.  Sprite tree: an efficient image-based representation for networked virtual environments , 2017, The Visual Computer.

[16]  Lin Sun,et al.  Human Motion Classification Based on Range Information with Deep Convolutional Neural Network , 2017, 2017 4th International Conference on Information Science and Control Engineering (ICISCE).

[17]  Lei Wang,et al.  Point set surface compression based on shape pattern analysis , 2017, Multimedia Tools and Applications.

[18]  Zehui Mao,et al.  Incipient Fault Detection for Traction Motors of High-Speed Railways Using an Interval Sliding Mode Observer , 2019, IEEE Transactions on Intelligent Transportation Systems.

[19]  Weidong Min,et al.  Detection of Human Falls on Furniture Using Scene Analysis Based on Deep Learning and Activity Characteristics , 2018, IEEE Access.

[20]  Sergio Escalera,et al.  RGB-D-based Human Motion Recognition with Deep Learning: A Survey , 2017, Comput. Vis. Image Underst..

[21]  Wei Xing Zheng,et al.  Distributed $k$ -Means Algorithm and Fuzzy $c$ -Means Algorithm for Sensor Networks Based on Multiagent Consensus Theory , 2017, IEEE Transactions on Cybernetics.

[22]  Sayan Mukherjee,et al.  Fast Principal-Component Analysis Reveals Convergent Evolution of ADH1B in Europe and East Asia. , 2016, American journal of human genetics.

[23]  Fei Tao,et al.  Editorial for the special issue on big data and cloud technology for manufacturing , 2016 .

[24]  Allen R. Hanson,et al.  Surface Texture and Microstructure Extraction from Multiple Aerial Images , 2001, Comput. Vis. Image Underst..

[25]  Guohui Zhang,et al.  A Kinect-Based Approach for 3D Pavement Surface Reconstruction and Cracking Recognition , 2018, IEEE Transactions on Intelligent Transportation Systems.

[26]  A. Weinmann,et al.  Model-Based Reconstruction for Magnetic Particle Imaging in 2D and 3D , 2016, 1605.08095.

[27]  Petros Daras,et al.  An Integrated Platform for Live 3D Human Reconstruction and Motion Capturing , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[28]  Daniel Rypl,et al.  Volume preserving smoothing of triangular isotropic three-dimensional surface meshes , 2016, Adv. Eng. Softw..

[29]  Takio Kurita,et al.  Improvement of learning for CNN with ReLU activation by sparse regularization , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[30]  Susan M. Astley,et al.  Evaluation of Kinect 3D Sensor for Healthcare Imaging , 2016, Journal of medical and biological engineering.

[31]  Francesc Moreno-Noguer,et al.  3D Human Pose Tracking Priors using Geodesic Mixture Models , 2017, International Journal of Computer Vision.

[32]  Wei Wu,et al.  Rapid Delaunay triangulation for randomly distributed point cloud data using adaptive Hilbert curve , 2016, Comput. Graph..

[33]  Robert C. Wolpert,et al.  A Review of the , 1985 .

[34]  Josh Harguess,et al.  Using image quality metrics to identify adversarial imagery for deep learning networks , 2017, Defense + Security.

[35]  Suvam Bag,et al.  Motion Estimation Using Visual Odometry and Deep Learning Localization , 2017 .

[36]  Yan Li,et al.  On-line point cloud data extraction algorithm for spatial scanning measurement of irregular surface in copying manufacture , 2016 .