Real-Time Height Measurement for Moving Pedestrians

Height measurement for moving pedestrians is quite significant in many scenarios, such as pedestrian positioning, criminal suspect tracking, and virtual reality. Although some existing height measurement methods can detect the height of the static people, it is hard to measure height accurately for moving pedestrians. Considering the height fluctuations in dynamic situation, this paper proposes a real-time height measurement based on the Time-of-Flight (TOF) camera. Depth images in a continuous sequence are addressed to obtain the real-time height of the pedestrian with moving. Firstly, a normalization equation is presented to convert the depth image into the grey image for a lower time cost and better performance. Secondly, a difference-particle swarm optimization (D-PSO) algorithm is proposed to remove the complex background and reduce the noises. Thirdly, a segmentation algorithm based on the maximally stable extremal regions (MSERs) is introduced to extract the pedestrian head region. Then, a novel multilayer iterative average algorithm (MLIA) is developed for obtaining the height of dynamic pedestrians. Finally, Kalman filtering is used to improve the measurement accuracy by combining the current measurement and the height at the last moment. In addition, the VICON system is adopted as the ground truth to verify the proposed method, and the result shows that our method can accurately measure the real-time height of moving pedestrians.

[1]  Petr Novák,et al.  Interaction with Collaborative Robot Using 2D and TOF Camera , 2018, MESAS.

[2]  Ye Gu,et al.  An Integrated Framework for Human–Robot Collaborative Manipulation , 2015, IEEE Transactions on Cybernetics.

[3]  Roque Alfredo Osornio-Rios,et al.  A new method for inpainting of depth maps from time-of-flight sensors based on a modified closing by reconstruction algorithm , 2017, J. Vis. Commun. Image Represent..

[4]  Xuelong Li,et al.  Learning Multilayer Channel Features for Pedestrian Detection , 2016, IEEE Transactions on Image Processing.

[5]  Feng-Ping An,et al.  Pedestrian Re-Recognition Algorithm Based on Optimization Deep Learning-Sequence Memory Model , 2019, Complex..

[6]  Bin Luo,et al.  Action-Based Pedestrian Identification via Hierarchical Matching Pursuit and Order Preserving Sparse Coding , 2016, Cognitive Computation.

[7]  J. L. Roux.  An Introduction to the Kalman Filter , 2003 .

[8]  Shu-Chuan Chu,et al.  A Parallel Multi-Verse Optimizer for Application in Multilevel Image Segmentation , 2020, IEEE Access.

[9]  Russell C. Eberhart,et al.  Parameter Selection in Particle Swarm Optimization , 1998, Evolutionary Programming.

[10]  David Zhang,et al.  Reinitialization-Free Level Set Evolution via Reaction Diffusion , 2011, IEEE Transactions on Image Processing.

[11]  Uwe Handmann,et al.  Hand Gesture Recognition in Automotive Human–Machine Interaction Using Depth Cameras , 2018, Sensors.

[12]  Sisi Zlatanova,et al.  A pedestrian tracking algorithm using grid-based indoor model , 2018 .

[13]  Binbin Wang,et al.  3D Reconstruction of Pedestrian Trajectory with Moving Direction Learning and Optimal Gait Recognition , 2018, Complex..

[14]  Redwan Alqasemi,et al.  A Survey on Virtual Reality for Individuals with Autism Spectrum Disorder: Design Considerations , 2018, IEEE Transactions on Learning Technologies.

[15]  Miadreza Shafie-Khah,et al.  Pattern Classification and PSO Optimal Weights Based Sky Images Cloud Motion Speed Calculation Method for Solar PV Power Forecasting , 2018, 2018 IEEE Industry Applications Society Annual Meeting (IAS).

[16]  Isaac Skog,et al.  Cooperative localization by dual foot-mounted inertial sensors and inter-agent ranging , 2013, EURASIP J. Adv. Signal Process..

[17]  Sen Qiu,et al.  Smartphone-Based 3D Indoor Pedestrian Positioning through Multi-Modal Data Fusion , 2019, Sensors.

[18]  Xiangbo Xu,et al.  Improved Pedestrian Positioning with Inertial Sensor Based on Adaptive Gradient Descent and Double-Constrained Extended Kalman Filter , 2020, Complex..

[19]  Yongji Wang,et al.  Legendre Cooperative PSO Strategies for Trajectory Optimization , 2018, Complex..

[20]  David Zhang,et al.  Two-stage image denoising by principal component analysis with local pixel grouping , 2010, Pattern Recognit..

[21]  I. Marcu,et al.  Robust pose estimation using Time-of-Flight imaging , 2019, 2019 International Semiconductor Conference (CAS).

[22]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[23]  Pedro Javier Navarro Lorente,et al.  Obstacle Detection using a Time of Flight Range Camera , 2018, 2018 IEEE International Conference on Vehicular Electronics and Safety (ICVES).

[24]  Ling Ma,et al.  An Improved Test Selection Optimization Model Based on Fault Ambiguity Group Isolation and Chaotic Discrete PSO , 2018, Complex..

[25]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[26]  Yiannos Manoli,et al.  A study on indoor pedestrian localization algorithms with foot-mounted sensors , 2012, 2012 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[27]  Fabrice Mériaudeau,et al.  Underwater 3-D Scene Reconstruction Using Kinect v2 Based on Physical Models for Refraction and Time of Flight Correction , 2017, IEEE Access.

[28]  Isaac Skog,et al.  Fusing the information from two navigation systems using an upper bound on their maximum spatial separation , 2012, 2012 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[29]  Hong Jiang,et al.  A novel Switching Unscented Kalman Filter method for remaining useful life prediction of rolling bearing , 2019, Measurement.

[30]  Z.A. Bashir,et al.  Applying Wavelets to Short-Term Load Forecasting Using PSO-Based Neural Networks , 2009, IEEE Transactions on Power Systems.

[31]  Mingyu Gao,et al.  Adaptive anchor box mechanism to improve the accuracy in the object detection system , 2019, Multimedia Tools and Applications.

[32]  Changdon Kee,et al.  Motion Recognition-Based 3D Pedestrian Navigation System Using Smartphone , 2016, IEEE Sensors Journal.

[33]  Qing Li,et al.  An Indoor Positioning Error Correction Method of Pedestrian Multi-Motions Recognized by Hybrid-Orders Fraction Domain Transformation , 2019, IEEE Access.

[34]  Shuicheng Yan,et al.  Scale-Aware Fast R-CNN for Pedestrian Detection , 2015, IEEE Transactions on Multimedia.

[35]  Jianping Wang,et al.  PTrack: Enhancing the Applicability of Pedestrian Tracking with Wearables , 2017, 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS).

[36]  Seungkyu Lee,et al.  Recovering Translucent Objects Using a Single Time-of-Flight Depth Camera , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[37]  Thomas Stützle,et al.  Frankenstein's PSO: A Composite Particle Swarm Optimization Algorithm , 2009, IEEE Transactions on Evolutionary Computation.

[38]  Satoshi Tsuji,et al.  Proximity Skin Sensor Using Time-of-Flight Sensor for Human Collaborative Robot , 2019, IEEE Sensors Journal.

[39]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.