Extraction of tongue contour in real-time magnetic resonance imaging sequences

Real-time magnetic resonance imaging (rtMRI) is becoming a practical tool in speech production research and language pathology observation. It is still a challenge to extract the tongue contour accurately in rtMRI sequences, since tongue is a soft tissue and often touches other organs such as lips and upper mandible. This paper proposes a novel semiautomatic tongue contour extraction method from rtMRI sequences. The initial boundary image is obtained by combined multi-directional Sobel operators in tongue movement region; then a boundary intensity map is constructed to find the most probable tongue contour points by searching for the optimal boundary route with Viterbi algorithm; finally the tongue contour is obtained using B-Spline approximation. The proposed method could obtain accurate tongue contour from rtMRI sequences, even in the cases that some parts of tongue touch other organs. Experiments demonstrate the robustness of the proposed method.

[1]  Shrikanth Narayanan,et al.  An approach to real-time magnetic resonance imaging for speech production. , 2003, The Journal of the Acoustical Society of America.

[2]  Z. Muhl,et al.  Estimation of tongue volume from magnetic resonance imaging. , 1991, The Angle orthodontist.

[3]  Bin Liu,et al.  Estimate articulatory MRI series from acoustic signal using deep architecture , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[4]  Yoon-Chul Kim,et al.  Seeing speech: Capturing vocal tract shaping using real-time magnetic resonance imaging [Exploratory DSP] , 2008, IEEE Signal Processing Magazine.

[5]  Ravi S. Menon,et al.  Cerebral areas processing swallowing and tongue movement are overlapping but distinct: a functional magnetic resonance imaging study. , 2004, Journal of neurophysiology.

[6]  Athanasios Katsamanis,et al.  Direct Estimation of Articulatory Kinematics from Real-Time Magnetic Resonance Image Sequences , 2011, INTERSPEECH.

[7]  Jianhua Tao,et al.  Extraction of tongue contour in X-ray videos , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[8]  Athanasios Katsamanis,et al.  Rapid semi-automatic segmentation of real-time magnetic resonance images for parametric vocal tract analysis , 2010, INTERSPEECH.

[9]  Nelson D. A. Mascarenhas,et al.  Spatio-temporal resolution enhancement of vocal tract MRI sequences based on image registration , 2011, Integr. Comput. Aided Eng..

[10]  W S Levine,et al.  Modeling the motion of the internal tongue from tagged cine-MRI images. , 2001, The Journal of the Acoustical Society of America.

[11]  Ting Peng,et al.  A shape-based framework to segmentation of tongue contours from MRI data , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[12]  Shrikanth S. Narayanan,et al.  Region Segmentation in the Frequency Domain Applied to Upper Airway Real-Time Magnetic Resonance Images , 2009, IEEE Transactions on Medical Imaging.

[13]  Jerry L. Prince,et al.  emi-automatic segmentation for 3 D motion analysis of the tongue ith dynamic MRI , 2014 .

[14]  J M Unger,et al.  The oral cavity and tongue: magnetic resonance imaging. , 1985, Radiology.

[15]  Shrikanth Narayanan,et al.  Real-time magnetic resonance imaging and electromagnetic articulography database for speech production research (TC). , 2014, The Journal of the Acoustical Society of America.

[16]  Shrikanth S. Narayanan,et al.  Truncation of pharyngeal gesture in English diphthong [aɪ] , 2013, INTERSPEECH.

[17]  Jerry L. Prince,et al.  Multi-subject atlas built from structural tongue magnetic resonance images , 2013 .

[18]  Jianwu Dang,et al.  Tongue shape synthesis based on Active Shape Model , 2012, 2012 8th International Symposium on Chinese Spoken Language Processing.

[19]  Shrikanth S. Narayanan,et al.  Stable articulatory tasks and their variable formation: tamil retroflex consonants , 2013, INTERSPEECH.

[20]  Michael Proctor,et al.  Articulatory bases of sonority in English liquids , 2012 .

[21]  R F Wolf,et al.  On the relation between the dimensions and resonance characteristics of the vocal tract: a study with MRI. , 1992, Magnetic resonance imaging.

[22]  W S Levine,et al.  Modeling tongue surface contours from Cine-MRI images. , 2001, Journal of speech, language, and hearing research : JSLHR.

[23]  Kiyoshi Honda,et al.  An MRI analysis of the extrinsic tongue muscles during vowel production , 2007, Speech Commun..

[24]  V J Napadow,et al.  Demonstration of primary and secondary muscle fiber architecture of the bovine tongue by diffusion tensor magnetic resonance imaging. , 2001, Biophysical journal.