Real-time Target Human Tracking using Camshift and LucasKanade Optical Flow Algorithm

A R T I C L E I N F O A B S T R A C T Article history: Received: 31 January, 2021 Accepted: 24 March, 2021 Online: 10 April, 2021 In this paper, a novel is proposed for real-time tracking human targets in cases of high influence from complexity environment with a normal camera. Firstly, based on Oriented FAST and Rotated BRIEF features, the Lucas-Kanade Optical Flow algorithm is used to track reliable keypoints. This method represents a valuable performance to decline the effect of the illumination or displacement of human targets. Secondly, the area of the human target in the frame is determined more precise by using the Camshift algorithm. Compared to the existing approaches, the proposed method has some merits to some extents including rapid calculations in implementation, high accuracy in case of similar objects detection, the ability to deploy easily on mobile devices. Finally, the effectiveness of the proposed tracking algorithm is demonstrated via experimental results.

[1]  Zhiwen Yu,et al.  Co-Tracking: Target Tracking via Collaborative Sensing of Stationary Cameras and Mobile Phones , 2020, IEEE Access.

[2]  Bo Du,et al.  Object Tracking in Satellite Videos Based on a Multi-Frame Optical Flow Tracker , 2018, ArXiv.

[3]  Roland Goecke,et al.  MSMCT: Multi-State Multi-Camera Tracker , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Avik Santra,et al.  Continuous Human Activity Classification With Unscented Kalman Filter Tracking Using FMCW Radar , 2020, IEEE Sensors Letters.

[5]  Changhoon Yim,et al.  Bi-Sequential Video Error Concealment Method Using Adaptive Homography-Based Registration , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Zheng Huang,et al.  Research on image feature matching algorithm based on feature optical flow and corner feature , 2020, The Journal of Engineering.

[7]  Ping Song,et al.  Occlusion-Aware Correlation Particle Filter Target Tracking Based on RGBD Data , 2018, IEEE Access.

[8]  Yutao Han,et al.  Pedestrian Motion Model Using Non-Parametric Trajectory Clustering and Discrete Transition Points , 2019, IEEE Robotics and Automation Letters.

[9]  Fuliang Li,et al.  Fast pedestrian detection and dynamic tracking for intelligent vehicles within V2V cooperative environment , 2017, IET Image Process..

[10]  Bin Cao,et al.  Area-Time Efficient Streaming Architecture for FAST and BRIEF Detector , 2019, IEEE Transactions on Circuits and Systems II: Express Briefs.

[11]  Shun-Feng Su,et al.  Pyramidal Lucas—Kanade-Based Noncontact Breath Motion Detection , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[12]  Guangming Shi,et al.  Development of a Human–Robot Hybrid Intelligent System Based on Brain Teleoperation and Deep Learning SLAM , 2019, IEEE Transactions on Automation Science and Engineering.

[13]  Yafei Wang,et al.  Multiple Vehicle Tracking Based on Labeled Multiple Bernoulli Filter Using Pre-Clustered Laser Range Finder Data , 2019, IEEE Transactions on Vehicular Technology.

[14]  Bodo Rosenhahn,et al.  Accurate Long-Term Multiple People Tracking Using Video and Body-Worn IMUs , 2020, IEEE Transactions on Image Processing.

[15]  Chao Jia,et al.  Human Motion Serialization Recognition With Through-the-Wall Radar , 2020, IEEE Access.

[16]  Hideo Saito,et al.  Synthesis of a stroboscopic image from a hand-held camera sequence for a sports analysis , 2016, Computational Visual Media.

[17]  Qing Liu,et al.  Action Prediction Based on Partial Video Observation via Context and Temporal Sequential Network With Deformable Convolution , 2020, IEEE Access.

[18]  Qian Chen,et al.  Particle filter‐based vehicle tracking via HOG features after image stabilisation in intelligent drive system , 2018, IET Intelligent Transport Systems.

[19]  Dalton Meitei Thounaojam,et al.  A SURVEY ON MOVING OBJECT TRACKING IN VIDEO , 2014 .

[20]  Sangeetha Damotharasamy,et al.  Approach to model human appearance based on sparse representation for human tracking in surveillance , 2020, IET Image Process..

[21]  Shun-Feng Su,et al.  Real time human tracking using improved CAM-shift , 2017, 2017 Joint 17th World Congress of International Fuzzy Systems Association and 9th International Conference on Soft Computing and Intelligent Systems (IFSA-SCIS).

[22]  Lin Li,et al.  A Multi-Type Features Method for Leg Detection in 2-D Laser Range Data , 2018, IEEE Sensors Journal.

[23]  Cristina Conde,et al.  Bio-Inspired Stereo Vision Calibration for Dynamic Vision Sensors , 2019, IEEE Access.

[24]  Ling Shao,et al.  2D Pose-Based Real-Time Human Action Recognition With Occlusion-Handling , 2020, IEEE Transactions on Multimedia.

[25]  Guoyin Ren,et al.  A Cross-Camera Multi-Face Tracking System Based on Double Triplet Networks , 2021, IEEE Access.

[26]  Jesús Alberto Meda Campaña,et al.  Experimental vision regulation of a quadrotor , 2015, IEEE Latin America Transactions.

[27]  Fang-Lue Zhang,et al.  Coherent video generation for multiple hand-held cameras with dynamic foreground , 2020, Comput. Vis. Media.

[28]  Xiangming Wen,et al.  From Signal to Image: Capturing Fine-Grained Human Poses With Commodity Wi-Fi , 2020, IEEE Communications Letters.

[29]  Byung-Ju Yi,et al.  Development of a Laser-Range-Finder-Based Human Tracking and Control Algorithm for a Marathoner Service Robot , 2014, IEEE/ASME Transactions on Mechatronics.

[30]  Alessia Saggese,et al.  Multi-Object Tracking by Flying Cameras Based on a Forward-Backward Interaction , 2018, IEEE Access.

[31]  Shun-Feng Su,et al.  Real-time non-contact breath detection from video using adaboost and Lucas-Kanade algorithm , 2017, 2017 Joint 17th World Congress of International Fuzzy Systems Association and 9th International Conference on Soft Computing and Intelligent Systems (IFSA-SCIS).

[32]  Zhao Xiangmo,et al.  Vehicle Ego-Localization Based on the Fusion of Optical Flow and Feature Points Matching , 2019, IEEE Access.

[33]  Yin Zhang,et al.  Detection and Tracking of Human Motion Targets in Video Images Based on Camshift Algorithms , 2020, IEEE Sensors Journal.

[34]  Shadi G. Alawneh,et al.  Predicting Pedestrian Intention to Cross the Road , 2020, IEEE Access.

[35]  Agathoniki Trigoni,et al.  Tracking People in Highly Dynamic Industrial Environments , 2017, IEEE Transactions on Mobile Computing.

[36]  Yu-Jin Zhang,et al.  Sequential Segment Networks for Action Recognition , 2017, IEEE Signal Processing Letters.