Realistic Dynamic Numerical Phantom for MRI of the Upper Vocal Tract

Dynamic and real-time MRI (rtMRI) of human speech is an active field of research, with interest from both the linguistics and clinical communities. At present, different research groups are investigating a range of rtMRI acquisition and reconstruction approaches to visualise the speech organs. Similar to other moving organs, it is difficult to create a physical phantom of the speech organs to optimise these approaches; therefore, the optimisation requires extensive scanner access and imaging of volunteers. As previously demonstrated in cardiac imaging, realistic numerical phantoms can be useful tools for optimising rtMRI approaches and reduce reliance on scanner access and imaging volunteers. However, currently, no such speech rtMRI phantom exists. In this work, a numerical phantom for optimising speech rtMRI approaches was developed and tested on different reconstruction schemes. The novel phantom comprised a dynamic image series and corresponding k-space data of a single mid-sagittal slice with a temporal resolution of 30 frames per second (fps). The phantom was developed based on images of a volunteer acquired at a frame rate of 10 fps. The creation of the numerical phantom involved the following steps: image acquisition, image enhancement, segmentation, mask optimisation, through-time and spatial interpolation and finally the derived k-space phantom. The phantom was used to: (1) test different k-space sampling schemes (Cartesian, radial and spiral); (2) create lower frame rate acquisitions by simulating segmented k-space acquisitions; (3) simulate parallel imaging reconstructions (SENSE and GRAPPA). This demonstrated how such a numerical phantom could be used to optimise images and test multiple sampling strategies without extensive scanner access.

[1]  Robin M Heidemann,et al.  Generalized autocalibrating partially parallel acquisitions (GRAPPA) , 2002, Magnetic resonance in medicine.

[2]  Jens Frahm,et al.  Real‐time MRI at a resolution of 20 ms , 2010, NMR in biomedicine.

[3]  Peter Boesiger,et al.  k‐t BLAST and k‐t SENSE: Dynamic MRI with high frame rate exploiting spatiotemporal correlations , 2003, Magnetic resonance in medicine.

[4]  Marc E Miquel,et al.  Recommendations for real‐time speech MRI , 2016, Journal of magnetic resonance imaging : JMRI.

[5]  António J. S. Teixeira,et al.  Unsupervised segmentation of the vocal tract from real-time MRI sequences , 2015, Comput. Speech Lang..

[6]  D. Sell,et al.  Cleft palate speech dissected: a review of current knowledge and analysis. , 1996, British journal of plastic surgery.

[7]  A. Rademaker,et al.  Speech and swallowing function after anterior tongue and floor of mouth resection with distal flap reconstruction. , 1993, Journal of speech and hearing research.

[8]  Nicholas Ayache,et al.  Model-Based Generation of Large Databases of Cardiac Images: Synthesis of Pathological Cine MR Sequences From Real Healthy Cases , 2018, IEEE Transactions on Medical Imaging.

[9]  Jens Frahm,et al.  Real‐time MRI of speaking at a resolution of 33 ms: Undersampled radial FLASH with nonlinear inverse reconstruction , 2013, Magnetic resonance in medicine.

[10]  R Todd Constable,et al.  Image distortion correction in EPI: Comparison of field mapping with point spread function mapping , 2002, Magnetic resonance in medicine.

[11]  Marc E Miquel,et al.  Real-time speech MRI: Commercial Cartesian and non-Cartesian sequences at 3T and feasibility of offline TGV reconstruction to visualise velopharyngeal motion. , 2018, Physica medica : PM : an international journal devoted to the applications of physics to medicine and biology : official journal of the Italian Association of Biomedical Physics.

[12]  Jens Frahm,et al.  Real‐time MRI of swallowing: intraoral pressure reduction supports larynx elevation , 2016, NMR in biomedicine.

[13]  Jens Frahm,et al.  Real‐time magnetic resonance imaging of normal swallowing , 2012, Journal of magnetic resonance imaging : JMRI.

[14]  J. Sundberg,et al.  Vocal tract in female registers--a dynamic real-time MRI study. , 2010, Journal of voice : official journal of the Voice Foundation.

[15]  Saiee Nithiyanantham,et al.  Quantitative analysis of fetal magnetic resonance phantoms and recommendations for an anthropomorphic motion phantom , 2019, Magnetic Resonance Materials in Physics, Biology and Medicine.

[16]  Shrikanth S Narayanan,et al.  Dynamic off‐resonance correction for spiral real‐time MRI of speech , 2019, Magnetic resonance in medicine.

[17]  Klaas P Pruessmann,et al.  Encoding and reconstruction in parallel MRI , 2006, NMR in biomedicine.

[18]  Jens Frahm,et al.  Magnetic resonance imaging in real time: Advances using radial FLASH , 2010, Journal of magnetic resonance imaging : JMRI.

[19]  Rakesh Mullick,et al.  A New Method for the Study of Velopharyngeal Function Using Gated Magnetic Resonance Imaging , 2002, Plastic and reconstructive surgery.

[20]  Jayaram K. Udupa,et al.  Automatic segmentation of vocal tract MR images , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[21]  Prasanta Kumar Ghosh,et al.  An Improved Air Tissue Boundary Segmentation Technique for Real Time Magnetic Resonance Imaging Video Using Segnet , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[22]  William G. Pearson,et al.  Visualising hyolaryngeal mechanics in swallowing using dynamic MRI , 2014, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[23]  M. G. Mack,et al.  Comparison of contrast-enhanced videofluoroscopy to unenhanced dynamic MRI in minor patients following surgical correction of velopharyngeal dysfunction , 2020, European Radiology.

[24]  Yasuhiro Morimoto,et al.  Functional evaluation of swallowing in patients with tongue cancer before and after surgery using high-speed continuous magnetic resonance imaging based on T2-weighted sequences. , 2018, Oral surgery, oral medicine, oral pathology and oral radiology.

[25]  Shrikanth Narayanan,et al.  Feasibility of through‐time spiral generalized autocalibrating partial parallel acquisition for low latency accelerated real‐time MRI of speech , 2017, Magnetic resonance in medicine.

[26]  Shinji Maeda,et al.  Stroboscopic-cine MRI study of the phasing between the tongue and the larynx in the Korean three-way phonation contrast , 2005, J. Phonetics.

[27]  Andrew D Scott,et al.  Adaptive averaging applied to dynamic imaging of the soft palate , 2013, Magnetic resonance in medicine.

[28]  Johan Sundberg,et al.  Professional Opera Tenors’ Vocal Tract Configurations in Registers , 2010, Folia Phoniatrica et Logopaedica.

[29]  Daniel Rueckert,et al.  Nonrigid registration using free-form deformations: application to breast MR images , 1999, IEEE Transactions on Medical Imaging.

[30]  Shrikanth S. Narayanan,et al.  Analysis of speech production real-time MRI , 2018, Comput. Speech Lang..

[31]  R. Schweizer,et al.  On the Physiology of Normal Swallowing as Revealed by Magnetic Resonance Imaging in Real Time , 2014, Gastroenterology research and practice.

[32]  R. Frayne,et al.  Dynamic phantom with heart, lung, and blood motion for initial validation of MRI techniques , 2011, Journal of magnetic resonance imaging : JMRI.

[33]  E R McVeigh,et al.  Segmented K-space cine breath-hold cardiovascular MR imaging: Part 1. Principles and technique. , 1997, AJR. American journal of roentgenology.

[34]  Jens Frahm,et al.  High-speed real-time magnetic resonance imaging of fast tongue movements in elite horn players. , 2015, Quantitative imaging in medicine and surgery.

[35]  Steffen E. Petersen,et al.  Comparison of Cartesian and Non-Cartesian Real-Time MRI Sequences at 1.5T to Assess Velar Motion and Velopharyngeal Closure during Speech , 2016, PloS one.

[36]  M. Buonocore,et al.  Ghost artifact reduction for echo planar imaging using image phase correction , 1997, Magnetic resonance in medicine.

[37]  John H. Esling,et al.  Illustrating the Production of the International Phonetic Alphabet Sounds Using Fast Real-Time Magnetic Resonance Imaging , 2016, INTERSPEECH.

[38]  Jamie L Perry,et al.  Can Dynamic MRI Be Used to Accurately Identify Velopharyngeal Closure Patterns? , 2018, The Cleft palate-craniofacial journal : official publication of the American Cleft Palate-Craniofacial Association.

[39]  O M Weber,et al.  Evaluation of the anatomical and functional properties of deglutition with various kinetic high‐speed MRI sequences , 2001, Journal of magnetic resonance imaging : JMRI.

[40]  Shrikanth Narayanan,et al.  A fast and flexible MRI system for the study of dynamic vocal tract shaping , 2017, Magnetic resonance in medicine.

[41]  Erol Akin,et al.  Real-time balanced turbo field echo cine-magnetic resonance imaging evaluation of tongue movements during deglutition in subjects with anterior open bite. , 2006, American journal of orthodontics and dentofacial orthopedics : official publication of the American Association of Orthodontists, its constituent societies, and the American Board of Orthodontics.

[42]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[43]  Dana M Hartl,et al.  Cine-MRI swallowing evaluation after tongue reconstruction. , 2010, European journal of radiology.

[44]  Bryson Dietz,et al.  Nomenclature for real‐time magnetic resonance imaging , 2018, Magnetic resonance in medicine.

[45]  Zhi-Pei Liang,et al.  High‐frame‐rate full‐vocal‐tract 3D dynamic speech imaging , 2017, Magnetic resonance in medicine.

[46]  Zhi-Pei Liang,et al.  High‐resolution dynamic speech imaging with joint low‐rank and sparsity constraints , 2015, Magnetic resonance in medicine.

[47]  Daniel Carey,et al.  Vocal Tract Images Reveal Neural Representations of Sensorimotor Transformation During Speech Imitation , 2017, Cerebral cortex.

[48]  Fang-Fang Yin,et al.  Development of a Computerized 4-D MRI Phantom for Liver Motion Study , 2017, Technology in cancer research & treatment.

[49]  R. Boubertakh,et al.  Towards clinical assessment of velopharyngeal closure using MRI: evaluation of real-time MRI sequences at 1.5 and 3 T. , 2012, The British journal of radiology.

[50]  Shrikanth Narayanan,et al.  3D dynamic MRI of the vocal tract during natural speech , 2018, Magnetic resonance in medicine.

[51]  Pedro F Ferreira,et al.  Myocardial first-pass perfusion imaging with hybrid-EPI: frequency-offsets and potential artefacts , 2012, Journal of Cardiovascular Magnetic Resonance.

[52]  Prasanta Kumar Ghosh,et al.  Air-tissue Boundary Segmentation in Real Time Magnetic Resonance Imaging Video Using a Convolutional Encoder-decoder Network , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[53]  Shrikanth S. Narayanan,et al.  Evaluation of swallow function after tongue cancer treatment using real-time magnetic resonance imaging: a pilot study. , 2013, JAMA otolaryngology-- head & neck surgery.

[54]  Shrikanth S. Narayanan,et al.  Flexible retrospective selection of temporal resolution in real‐time speech MRI using a golden‐ratio spiral view order , 2011, Magnetic resonance in medicine.

[55]  Jeffrey A Fessler,et al.  On NUFFT-based gridding for non-Cartesian MRI. , 2007, Journal of magnetic resonance.

[56]  Marzena Wylezinska,et al.  Evaluating velopharyngeal closure with real-time MRI , 2015, Pediatric Radiology.

[57]  Victor R. Basili,et al.  Iterative enhancement: A practical technique for software development , 1975, IEEE Transactions on Software Engineering.

[58]  A. Alwan,et al.  A nonlinear dynamical systems analysis of fricative consonants. , 1995, The Journal of the Acoustical Society of America.

[59]  M. Echternach,et al.  Morphometric Differences of Vocal Tract Articulators in Different Loudness Conditions in Singing , 2016, PloS one.

[60]  Yves Laprie,et al.  Measurement of Tongue Tip Velocity from Real-Time MRI and Phase-Contrast Cine-MRI in Consonant Production , 2020, J. Imaging.

[61]  R. McKinstry,et al.  Principles and applications of echo-planar imaging: a review for the general radiologist. , 2001, Radiographics : a review publication of the Radiological Society of North America, Inc.

[62]  D. Geddes,et al.  Imaging the breastfeeding swallow: Pilot study utilizing real‐time MRI , 2020, Laryngoscope investigative otolaryngology.

[63]  Shrikanth S. Narayanan,et al.  Vocal Tract Articulatory Contour Detection in Real-Time Magnetic Resonance Images Using Spatio-Temporal Context , 2020, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[64]  W. Segars,et al.  MRXCAT: Realistic numerical phantoms for cardiovascular magnetic resonance , 2014, Journal of Cardiovascular Magnetic Resonance.

[65]  Craig H Meyer,et al.  Assessment of velopharyngeal function with dual‐planar high‐resolution real‐time spiral dynamic MRI , 2018, Magnetic resonance in medicine.

[66]  Yun Jiang,et al.  Realistic 4D MRI abdominal phantom for the evaluation and comparison of acquisition and reconstruction techniques , 2018, Magnetic resonance in medicine.

[67]  Shinobu Masaki,et al.  Dynamic Analysis of Articulatory Movement Using Magnetic Resonance Imaging Movies: Methods and Implications in Cleft Lip and Palate , 2005, The Cleft palate-craniofacial journal : official publication of the American Cleft Palate-Craniofacial Association.

[68]  Maureen Stone,et al.  Analysis of speech and tongue motion in normal and post-glossectomy speaker using cine MRI , 2016, Journal of applied oral science : revista FOB.

[69]  Shrikanth S. Narayanan,et al.  Region Segmentation in the Frequency Domain Applied to Upper Airway Real-Time Magnetic Resonance Images , 2009, IEEE Transactions on Medical Imaging.

[70]  Marzena Wylezinska,et al.  Speech MRI: morphology and function. , 2014, Physica medica : PM : an international journal devoted to the applications of physics to medicine and biology : official journal of the Italian Association of Biomedical Physics.

[71]  Marzena Wylezinska,et al.  Impact of orthodontic appliances on the quality of craniofacial anatomical magnetic resonance imaging and real-time speech imaging. , 2015, European journal of orthodontics.

[72]  E R McVeigh,et al.  Quantification and reduction of ghosting artifacts in interleaved echo‐planar imaging , 1997, Magnetic resonance in medicine.

[73]  Thoralf Niendorf,et al.  Design, construction, and evaluation of a dynamic MR compatible cardiac left ventricle model. , 2012, Medical physics.

[74]  Robert Sader,et al.  Dynamic near‐real‐time magnetic resonance imaging for analyzing the velopharyngeal closure in comparison with videofluoroscopy , 2004, Journal of magnetic resonance imaging : JMRI.

[75]  Jacqueline Vaissière,et al.  Vocal tract area function for vowels using three-dimensional magnetic resonance imaging. A preliminary study. , 2007, Journal of voice : official journal of the Voice Foundation.

[76]  Roy Santosham,et al.  Assessment of swallowing and its disorders-a dynamic MRI study. , 2013, European journal of radiology.

[77]  A. Lacroix Speech production-physics, models and prospective applications , 2001, ISPA 2001. Proceedings of the 2nd International Symposium on Image and Signal Processing and Analysis. In conjunction with 23rd International Conference on Information Technology Interfaces (IEEE Cat..

[78]  Prasanta Kumar Ghosh,et al.  Air-Tissue Boundary Segmentation in Real-Time Magnetic Resonance Imaging Video Using Semantic Segmentation with Fully Convolutional Networks , 2018, INTERSPEECH.

[79]  Halil Arslan,et al.  Evaluation of Dynamic Magnetic Resonance Imaging in Assessing Velopharyngeal Insufficiency During Phonation , 2008, The Journal of craniofacial surgery.

[80]  Shrikanth S. Narayanan,et al.  Dynamic 3-D Visualization of Vocal Tract Shaping During Speech , 2013, IEEE Transactions on Medical Imaging.

[81]  Tarek El Banoby,et al.  Role of static MRI in assessment of velopharyngeal insufficiency , 2020 .

[82]  Shrikanth S. Narayanan,et al.  Semantic Edge Detection for Tracking Vocal Tract Air-Tissue Boundaries in Real-Time Magnetic Resonance Images , 2017, INTERSPEECH.

[83]  C. Czerny,et al.  Dynamic 1.5-T vs 3-T true fast imaging with steady-state precession (trueFISP)-MRI sequences for assessment of velopharyngeal function. , 2015, Dento maxillo facial radiology.

[84]  M. Echternach,et al.  Motor functions in trumpet playing—a real-time MRI analysis , 2013, Neuroradiology.

[85]  Nicole Seiberlich,et al.  Parallel MR imaging , 2012, Journal of magnetic resonance imaging : JMRI.

[86]  C. Drissi,et al.  Feasibility of dynamic MRI for evaluating velopharyngeal insufficiency in children , 2011, European Radiology.

[87]  Jens Frahm,et al.  Real-time MRI comparisons of brass players: A methodological pilot study. , 2015, Human movement science.

[88]  Louis-Jean Boë,et al.  Automatic segmentation of speech articulators from real-time midsagittal MRI based on supervised learning , 2018, Speech Commun..

[89]  S. Cappa,et al.  Connected Speech in Neurodegenerative Language Disorders: A Review , 2017, Front. Psychol..

[90]  Barry D. Van Veen,et al.  Development of Anatomically Realistic Numerical Breast Phantoms With Accurate Dielectric Properties for Modeling Microwave Interactions With the Human Breast , 2008, IEEE Transactions on Biomedical Engineering.

[91]  Richard Kijowski,et al.  Fast Realistic MRI Simulations Based on Generalized Multi-Pool Exchange Tissue Model , 2016, IEEE Transactions on Medical Imaging.

[92]  Marc E Miquel,et al.  Application of radial GRAPPA techniques to single‐ and multislice dynamic speech MRI using a 16‐channel neurovascular coil , 2019, Magnetic resonance in medicine.

[93]  Yuvi Kahana,et al.  Recording high quality speech during tagged cine‐MRI studies using a fiber optic microphone , 2006, Journal of magnetic resonance imaging : JMRI.

[94]  Jack J Jiang,et al.  Chaotic vibrations of a vocal fold model with a unilateral polyp. , 2004, The Journal of the Acoustical Society of America.

[95]  Krishna S. Nayak Response to Letter to the Editor: “Nomenclature for real‐time magnetic resonance imaging” , 2019, Magnetic resonance in medicine.