ColourFAST: GPU-based feature point detection and tracking on mobile devices

A realtime feature point detection algorithm called ColourFAST is introduced. ColourFAST extracts vector-based feature strength and direction measures from the colour channels of any pixel in an image. The extracted information is applied to create an effective feature point tracker. These feature point and tracker algorithms have a pipeline design optimized for GPU processors. Results are provided for an implementation on mobile devices developed using programmable shaders. Its performance demonstrates several improvements over conventional FAST feature point detection and Lucas-Kanade tracking.

[1]  Nicholas J. Redding,et al.  GPU-Accelerated KLT Tracking with Monte-Carlo-Based Feature Reselection , 2008, 2008 Digital Image Computing: Techniques and Applications.

[2]  Dieter Schmalstieg,et al.  Real-Time Detection and Tracking for Augmented Reality on Mobile Phones , 2010, IEEE Transactions on Visualization and Computer Graphics.

[3]  Sungdae Cho,et al.  Implementation and optimization of image processing algorithms on handheld GPU , 2010, 2010 IEEE International Conference on Image Processing.

[4]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[5]  Stephen M. Smith,et al.  SUSAN—A New Approach to Low Level Image Processing , 1997, International Journal of Computer Vision.

[6]  Tom Drummond,et al.  Faster and Better: A Machine Learning Approach to Corner Detection , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[8]  Gaetano Borriello,et al.  Information Overlay for Camera Phones in Indoor Environments , 2007, LoCA.

[9]  Hakil Kim,et al.  A fast feature extraction in object recognition using parallel processing on CPU and GPU , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[10]  Shumin Zhai,et al.  Camera phone based motion sensing: interaction techniques, applications and performance study , 2006, UIST.

[11]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[12]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[13]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Kwang-Ting Cheng,et al.  Using mobile GPU for general-purpose computing – a case study of face recognition on smartphones , 2011, Proceedings of 2011 International Symposium on VLSI Design, Automation and Test.

[15]  Seth Hall,et al.  GPU-based Image Analysis on Mobile Devices , 2011, ArXiv.

[16]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[17]  John Hannah,et al.  IEEE International Conference on Image Processing (ICIP) , 1997 .

[18]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[19]  Ieee Xplore,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Information for Authors , 2022, IEEE Transactions on Pattern Analysis and Machine Intelligence.