Speech Map: a statistical multimodal atlas of 4D tongue motion during speech from tagged and cine MR images

Abstract Quantitative measurement of functional and anatomical traits of 4D tongue motion in the course of speech or other lingual behaviours remains a major challenge in scientific research and clinical applications. Here, we introduce a statistical multimodal atlas of 4D tongue motion using healthy subjects, which enables a combined quantitative characterisation of tongue motion in a reference anatomical configuration. This atlas framework, termed Speech Map, combines cine- and tagged-MRI in order to provide both the anatomic reference and motion information during speech. Our approach involves a series of steps including (1) construction of a common reference anatomical configuration from cine-MRI, (2) motion estimation from tagged-MRI, (3) transformation of the motion estimations to the reference anatomical configuration, and (4) computation of motion quantities such as Lagrangian strain. Using this framework, the anatomic configuration of the tongue appears motionless, while the motion fields and associated strain measurements change over the time course of speech. In addition, to form a succinct representation of the high-dimensional and complex motion fields, principal component analysis is carried out to characterise the central tendencies and variations of motion fields of our speech tasks. Our proposed method provides a platform to quantitatively and objectively explain the differences and variability of tongue motion by illuminating internal motion and strain that have so far been intractable. The findings are used to understand how tongue function for speech is limited by abnormal internal motion and strain in glossectomy patients.

[1]  Ian Stavness,et al.  Automatic Prediction of Tongue Muscle Activations Using a Finite Element Model , 2022 .

[2]  B R Rosen,et al.  Motionless Movies of Myocardial Strain‐Rates using Stimulated Echoes , 1995, Magnetic resonance in medicine.

[3]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[4]  W. Kier,et al.  Tongues, tentacles and trunks: the biomechanics of movement in muscular‐hydrostats , 1985 .

[5]  E. McVeigh,et al.  Cardiac Tagging with Breath‐Hold Cine MRI , 1992, Magnetic resonance in medicine.

[6]  Jerry L. Prince,et al.  Incompressible Phase Registration for Motion Estimation from Tagged Magnetic Resonance Images , 2016, RAMBO+HVSMR@MICCAI.

[7]  Jerry L. Prince,et al.  A spatio-temporal atlas and statistical model of the tongue during speech from cine-MRI , 2018, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[8]  Jerry L. Prince,et al.  A high-resolution atlas and statistical model of the vocal tract from structural MRI , 2015, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[9]  Jerry L Prince,et al.  Cardiac motion tracking using CINE harmonic phase (HARP) magnetic resonance imaging , 1999, Magnetic resonance in medicine.

[10]  Paul Aljabar,et al.  A multimodal spatiotemporal cardiac motion atlas from MR and ultrasound data , 2017, Medical Image Anal..

[11]  Jerry L. Prince,et al.  Tongue muscle fiber tracking during rest and tongue protrusion with oral appliances: A preliminary study with diffusion tensor imaging , 2008 .

[12]  Jerry L. Prince,et al.  Multimodal Registration via Mutual Information Incorporating Geometric and Spatial Context , 2015, IEEE Transactions on Image Processing.

[13]  Jerry L. Prince,et al.  Relating speech production to tongue muscle compressions using tagged and high-resolution magnetic resonance imaging , 2015, Medical Imaging.

[14]  Jerry L. Prince,et al.  Structure and variability in human tongue muscle anatomy , 2018, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[15]  Jerry L Prince,et al.  Magnitude image CSPAMM reconstruction (MICSR) , 2003, Magnetic resonance in medicine.

[16]  Jerry L Prince,et al.  Measuring tongue motion from tagged cine-MRI using harmonic phase (HARP) processing. , 2007, The Journal of the Acoustical Society of America.

[17]  Arno Klein,et al.  A reproducible evaluation of ANTs similarity metric performance in brain image registration , 2011, NeuroImage.

[18]  Hervé Delingette,et al.  International Journal of Computer Vision Manuscript No. 10.1007/s11263-010-0405-z The final publication is available at www.springerlink.com iLogDemons: A Demons-Based Registration Algorithm for Tracking Incompressible Elastic Biological Tissues , 2022 .

[19]  V L Gracco,et al.  On the registration of time and the patterning of speech movements. , 1997, Journal of speech, language, and hearing research : JSLHR.

[20]  Jonghye Woo,et al.  Spatiotemporal-atlas-based dynamic speech imaging , 2016, SPIE Medical Imaging.

[21]  Jerry L Prince,et al.  Tissue-point motion tracking in the tongue from cine MRI and tagged MRI. , 2014, Journal of speech, language, and hearing research : JSLHR.

[22]  Jerry L. Prince,et al.  Reconstruction of High-Resolution Tongue Volumes From MRI , 2012, IEEE Transactions on Biomedical Engineering.

[23]  Jerry L. Prince,et al.  Phase Vector Incompressible Registration Algorithm for Motion Estimation From Tagged Magnetic Resonance Images , 2017, IEEE Transactions on Medical Imaging.

[24]  Jerry L. Prince,et al.  Construction of An Unbiased Spatio-Temporal Atlas of the Tongue During Speech , 2015, IPMI.

[25]  Zhi-Pei Liang,et al.  High‐frame‐rate full‐vocal‐tract 3D dynamic speech imaging , 2017, Magnetic resonance in medicine.

[26]  Jonghye Woo,et al.  Analysis of 3-D Tongue Motion From Tagged and Cine Magnetic Resonance Images. , 2016, Journal of speech, language, and hearing research : JSLHR.

[27]  E Fiona Bailey,et al.  Genioglossus and intrinsic electromyographic activities in impeded and unimpeded protrusion tasks. , 2009, Journal of neurophysiology.

[28]  Thomas Benner,et al.  Mapping complex myoarchitecture in the bovine tongue with diffusion-spectrum magnetic resonance imaging. , 2006, Biophysical journal.

[29]  Avishek Saha,et al.  Modeling 4D pathological changes by leveraging normative models , 2016, Comput. Vis. Image Underst..

[30]  Shrikanth Narayanan,et al.  An approach to real-time magnetic resonance imaging for speech production. , 2003, The Journal of the Acoustical Society of America.

[31]  Bostjan Likar,et al.  Manuscript Information Manuscript Files Segmentation of Tongue Muscles from Super-resolution Magnetic Resonance Images Segmentation of Tongue Muscles from Super-resolution Magnetic Resonance Images , 2022 .

[32]  Jerry L. Prince,et al.  A four-dimensional motion field atlas of the tongue from tagged and cine magnetic resonance imaging , 2017, Medical Imaging.

[33]  Paul Aljabar,et al.  Towards a multimodal cardiac motion atlas , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[34]  M. Miller Computational anatomy: shape, growth, and atrophy comparison via diffeomorphisms , 2004, NeuroImage.

[35]  Thomas Benner,et al.  Three dimensional myoarchitecture of the human tongue determined in vivo by diffusion tensor imaging with tractography , 2007, Journal of magnetic resonance imaging : JMRI.

[36]  Jerry L. Prince,et al.  Determining Functional Units of Tongue Motion via Graph-Regularized Sparse Non-negative Matrix Factorization , 2014, MICCAI.

[37]  Heinz Handels,et al.  Statistical Modeling of 4D Respiratory Lung Motion Using Diffeomorphic Image Registration , 2011, IEEE Transactions on Medical Imaging.