Adaptive median binary patterns for fully automatic nerves tracking in ultrasound images

BACKGROUND AND OBJECTIVE In the last decade, Ultrasound-Guided Regional Anesthesia (UGRA) gained importance in surgical procedures and pain management, due to its ability to perform target delivery of local anesthetics under direct sonographic visualization. However, practicing UGRA can be challenging, since it requires high skilled and experienced operator. Among the difficult task that the operator can face, is the tracking of the nerve structure in ultrasound images. Tracking task in US images is very challenging due to the noise and other artifacts. METHODS In this paper, we introduce a new and robust tracking technique by using Adaptive Median Binary Pattern(AMBP) as texture feature for tracking algorithms (particle filter, mean-shift and Kanade-Lucas-Tomasi(KLT)). Moreover, we propose to incorporate Kalman filter as prediction and correction steps for the tracking algorithms, in order to enhance the accuracy, computational cost and handle target disappearance. RESULTS The proposed method have been applied on real data and evaluated in different situations. The obtained results show that tracking with AMBP features outperforms other descriptors and achieved best performance with 95% accuracy. CONCLUSIONS This paper presents the first fully automatic nerve tracking method in Ultrasound images. AMBP features outperforms other descriptors in all situations such as noisy and filtered images.

[1]  Aristidis Likas,et al.  Visual Tracking by Adaptive Kalman Filtering and Mean Shift , 2010, SETN.

[2]  Andrew Blake,et al.  Articulated body motion capture by annealed particle filtering , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[3]  Adel Hafiane,et al.  Computer-aided detection system for nerve identification using ultrasound images: A comparative study , 2016 .

[4]  Adel Hafiane,et al.  Adaptive Median Binary Patterns for Texture Classification , 2014, 2014 22nd International Conference on Pattern Recognition.

[5]  Petros Maragos,et al.  Tongue tracking in Ultrasound images with Active Appearance Models , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[6]  Luc Vincent,et al.  Morphological grayscale reconstruction in image analysis: applications and efficient algorithms , 1993, IEEE Trans. Image Process..

[7]  Bertrand Zavidovique,et al.  Median Binary Pattern for Textures Classification , 2007, ICIAR.

[8]  Guoying Zhao,et al.  BRINT: Binary Rotation Invariant and Noise Tolerant Texture Classification , 2014, IEEE Transactions on Image Processing.

[9]  Yasser M. Kadah,et al.  Real-time speckle reduction and coherence enhancement in ultrasound imaging via nonlinear anisotropic diffusion , 2002, IEEE Transactions on Biomedical Engineering.

[10]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[11]  J. Alison Noble,et al.  Ultrasound image segmentation: a survey , 2006, IEEE Transactions on Medical Imaging.

[12]  C. Kambhamettu,et al.  Automatic contour tracking in ultrasound images , 2005, Clinical linguistics & phonetics.

[13]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[14]  Gustavo Carneiro,et al.  Combining Multiple Dynamic Models and Deep Learning Architectures for Tracking the Left Ventricle Endocardium in Ultrasound Data , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  David Zhang,et al.  Robust Object Tracking Using Joint Color-Texture Histogram , 2009, Int. J. Pattern Recognit. Artif. Intell..

[16]  Ling Zhang,et al.  Automated breast cancer detection and classification using ultrasound images: A survey , 2015, Pattern Recognit..

[17]  Jorge S. Marques,et al.  Robust Shape Tracking With Multiple Models in Ultrasound Images , 2008, IEEE Transactions on Image Processing.

[18]  Wilson S. Geisler,et al.  Texture segmentation using Gabor modulation/demodulation , 1987, Pattern Recognit. Lett..

[19]  Chengyuan Liu,et al.  Object tracking algorithm based on particle filter with color and texture feature , 2016, CCC 2016.

[20]  Adel Hafiane,et al.  Joint Adaptive Median Binary Patterns for texture classification , 2015, Pattern Recognit..

[21]  Piotr Bilinski,et al.  Multiple object tracking with occlusions using HOG descriptors and multi resolution images , 2009, ICDP.

[22]  M. R. Turner,et al.  Texture discrimination by Gabor functions , 1986, Biological Cybernetics.

[23]  Scott T. Acton,et al.  Speckle reducing anisotropic diffusion , 2002, IEEE Trans. Image Process..

[24]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  C.P. Loizou,et al.  Comparative evaluation of despeckle filtering in ultrasound imaging of the carotid artery , 2005, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[26]  Zhenhua Guo,et al.  A Completed Modeling of Local Binary Pattern Operator for Texture Classification , 2010, IEEE Transactions on Image Processing.

[27]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Shunichi Homma,et al.  Region-based endocardium tracking on real-time three-dimensional ultrasound. , 2009, Ultrasound in medicine & biology.

[29]  Lisa Tang,et al.  Tongue Contour Tracking in Dynamic Ultrasound via Higher-order Mrfs and Ecient Fusion Moves , 2012 .

[30]  Robert D. Howe,et al.  GPU based real-time instrument tracking with three-dimensional ultrasound , 2007, Medical Image Anal..

[31]  Septimiu E. Salcudean,et al.  Real-Time Vessel Segmentation and Tracking for Ultrasound Imaging Applications , 2007, IEEE Transactions on Medical Imaging.

[32]  P. Barash Handbook of Clinical Anesthesia , 1991 .

[33]  J. Daugman Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[34]  Liwen Dong,et al.  Adaptive image denoising using wavelet thresholding , 2013, 2013 IEEE Third International Conference on Information Science and Technology (ICIST).

[35]  Bertrand Zavidovique,et al.  Rotationally Invariant Hashing of Median Binary Patterns for Texture Classification , 2008, ICIAR.

[36]  Petia Radeva,et al.  SRBF: Speckle reducing bilateral filtering. , 2010, Ultrasound in medicine & biology.