Autonomous positioning control of manipulator and fast surface fitting based on particle filter and point cloud library technology

The real-time calculations of the positioning error, error correction, and state analysis have always been a difficult challenge in the process of autonomous positioning. In order to solve this problem, a simple depth imaging equipment (Kinect) is used, and a particle filter based on three-frame subtraction to capture the end-effector’s motion is proposed in this article. Further, a back-propagation neural network is adopted to recognize targets. The point cloud library technology is used to collect the space coordinates of the end-effector and target. Finally, a three-dimensional mesh simplification algorithm based on the density analysis and average distance between points is proposed to carry out data compression. Accordingly, the target point cloud is fitted quickly. The experiments conducted in the article demonstrate that the proposed algorithm can detect and track the end-effector in real time. The recognition rate of 99% is achieved for a cylindrical object. The geometric center of all particles is regarded as the end-effector’s center. Furthermore, the gradual convergence of the end-effector center to the target centroid shows that the autonomous positioning is successful. Compared to traditional algorithms, both moving the end-effector and a stationary object can be extracted from image frames using a thesis. The thesis presents a simple and convenient positioning method, which adjusts the motion of the manipulator according to the error between the end-effector’s center and target centroid. The computational complexity is reduced and the camera calibration is eliminated.

[1]  R. Hartley,et al.  Multiple-View Geometry under the L 1-Norm , 2007 .

[2]  Liu Yi-guang An Neural Network for Image Object Recognition and Its Application to Car Type Recognition , 2003 .

[3]  Hao Hong Training Sample Selection Method for Neural Networks Based on Nearest Neighbor Rule , 2007 .

[4]  高伟,et al.  Batch Reconstruction from UAV Images with Prior Information , 2013 .

[5]  Andrew W. Fitzgibbon,et al.  KinectFusion: Real-time dense surface mapping and tracking , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[6]  Robert Haschke,et al.  3D scene segmentation for autonomous robot grasping , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Yanzhu Hu,et al.  3D Reconstruction of End-Effector in Autonomous Positioning Process Using Depth Imaging Device , 2016 .

[8]  Mohammed Bennamoun,et al.  A Gaussian Process Guided Particle Filter for Tracking 3D Human Pose in Video , 2013, IEEE Transactions on Image Processing.

[9]  Yu Neng-hai,et al.  Dynamic Bayesian Network Model Based Golf Swing 3D Reconstruction Using Simple Depth Imaging Device , 2015 .

[10]  Chinchen Chang,et al.  An Adaptive Median Filter for Image Denoising , 2008, 2008 Second International Symposium on Intelligent Information Technology Application.

[11]  Kenichi Kanatani,et al.  Guide to 3D Vision Computation: Geometric Analysis and Implementation , 2016 .

[12]  H.M. Wechsler,et al.  Digital image processing, 2nd ed. , 1981, Proceedings of the IEEE.

[13]  Feng Qi Image edge detection algorithm of mathematical morphology based on VC++6.0 , 2004 .

[14]  James E. Gain,et al.  Compression of dense and regular point clouds , 2006, AFRIGRAPH '06.

[15]  D. Gennery,et al.  Calibration and Orientation of Cameras in Computer Vision , 2001 .

[16]  Petter Ögren,et al.  Intrinsic camera and hand-eye calibration for a robot vision system using a point marker , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[17]  Giuseppe Carbone,et al.  Motion and Operation Planning of Robotic Systems , 2015 .

[18]  Zhu Ping-yun Ship target identification based on the wavelet transform and neural network , 2004 .

[19]  Andrew W. Fitzgibbon,et al.  KinectFusion: real-time dynamic 3D surface reconstruction and interaction , 2011, SIGGRAPH '11.

[20]  Zhu Xiaoxiao,et al.  An Improved KinectFusion 3D Reconstruction Algorithm , 2014 .

[21]  Andrew W. Fitzgibbon,et al.  KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera , 2011, UIST.

[22]  Richard I. Hartley,et al.  Multiple-View Geometry Under the {$L_\infty$}-Norm , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[24]  Kenichi Kanatani,et al.  Guide to 3D Vision Computation , 2016, Advances in Computer Vision and Pattern Recognition.

[25]  Leilei Cao,et al.  Study on the Control Strategy of Shifting Time Involving Multigroup Clutches , 2016 .

[26]  Jules Bloomenthal,et al.  An Implicit Surface Polygonizer , 1994, Graphics Gems.