Human tracking by using multiple methods and weighted products

AbstractConventional wheelchairs are used by people who can actuate their hand, but there are conditions that cause the user cannot operate the wheelchair, such as handicapped people and amputated arms. Hence, they need an assistant to operate the wheelchair, as we know those conditions are dependent on others. An intelligent wheelchair becomes a solution to this problem by tracking and following an assistant in front of a wheelchair; it uses a camera that has been embedded there. So the assistant does not need to move it. In order to track a human, an algorithm that can detect a human or object is needed. Some algorithms with different approaches have been proposed such as SIFT, SURF, BRISK, AKAZE, KAZE, and ORB. Each algorithm has its own excess and feebleness. This research devises multiple methods for a human tracking for smart wheelchair, which aims to cover the method drawbacks with the advantages of other methods. The proposed method is performed using multiple methods mentioned above, which have sorted by investigating the method score. Subsequently, the first method is used to track a human and yield keypoints. If the keypoints detected are less than the threshold value, then the next method is used and so on until it reaches the threshold value. The threshold value is obtained from the average of keypoints detected in the first frame. This devised method has been evaluated by using 6 videos recorded by us and 10 videos from Visual Tracker Benchmark. This proposed method achieved an average accuracy up to 0.848609 on 6 videos and 0.663 on OTB dataset.

[1]  Simon Lucey,et al.  Learning Policies for Adaptive Tracking with Deep Feature Cascades , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[2]  Roland Siegwart,et al.  BRISK: Binary Robust invariant scalable keypoints , 2011, 2011 International Conference on Computer Vision.

[3]  Deepjoy Das,et al.  Implementation And Performance Evaluation Of Background Subtraction Algorithms , 2014, ArXiv.

[4]  Zhigang Wang,et al.  Real-time tracking of deformable objects based on combined matching-and-tracking , 2016, J. Electronic Imaging.

[5]  Rama Chellappa,et al.  Joint Sparse Representation and Robust Feature-Level Fusion for Multi-Cue Visual Tracking , 2015, IEEE Transactions on Image Processing.

[6]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[7]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[8]  Xuelong Li,et al.  A Biologically Inspired Appearance Model for Robust Visual Tracking , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[9]  Mostafa-Sami M. Mostafa,et al.  Performance Assessment of Feature Detector-Descriptor Combination , 2015 .

[10]  Isabela Drummond,et al.  Real-Time Ensemble-Based Tracker with Kalman Filter , 2017, 2017 30th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI).

[11]  Fitri Utaminingrum,et al.  A laser-vision based obstacle detection and distance estimation for smart wheelchair navigation , 2016, 2016 IEEE International Conference on Signal and Image Processing (ICSIP).

[12]  Fitri Utaminingrum,et al.  Fast Obstacle Distance Estimation using Laser Line Imaging Technique for Smart Wheelchair , 2016 .

[13]  Chandrashekar M. Patil,et al.  Efficient multiple moving object detection and tracking using combined background subtraction and clustering , 2018, Signal Image Video Process..

[14]  Yong-Ho Moon,et al.  Multiple Object Tracking Using SIFT Features and Location Matching , 2011 .

[15]  Adrien Bartoli,et al.  KAZE Features , 2012, ECCV.

[16]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[17]  P. Panchal,et al.  A Review on Object Detection and Tracking Methods , 2015 .

[18]  Fitri Utaminingrum,et al.  Regresi linier berbasis clustering untuk deteksi dan estimasi halangan pada smart wheelchair , 2017 .

[19]  Fitri Utaminingrum,et al.  Adaptive human tracking for smart wheelchair , 2017, 2017 5th International Symposium on Computational and Business Intelligence (ISCBI).

[20]  Hossein Pourghassem,et al.  A robust object tracking synthetic structure using regional mutual information and edge correlation-based tracking algorithm in aerial surveillance application , 2015, Signal Image Video Process..

[21]  Adrien Bartoli,et al.  Fast Explicit Diffusion for Accelerated Features in Nonlinear Scale Spaces , 2013, BMVC.

[22]  Feng Jiang,et al.  Point-to-Set Distance Metric Learning on Deep Representations for Visual Tracking , 2018, IEEE Transactions on Intelligent Transportation Systems.

[23]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..