Discriminative Learning for Automatic Staging of Placental Maturity via Multi-layer Fisher Vector

Currently, placental maturity is performed using subjective evaluation, which can be unreliable as it is highly dependent on the observations and experiences of clinicians. To address this problem, this paper proposes a method to automatically stage placenta maturity from B-mode ultrasound (US) images based on dense sampling and novel feature descriptors. Specifically, our proposed method first densely extracts features with a regular grid based on dense sampling instead of a few unreliable interest points. Followed by, these features are clustered using generative Gaussian mixture model (GMM) to obtain high order statistics of the features. The clustering representatives (i.e., cluster means) are encoded by Fisher vector (FV) for staging accuracy enhancement. Differing from the previous studies, a multi-layer FV is investigated to exploit the spatial information rather than the single layer FV. Experimental results show that the proposed method with the dense FV has achieved an area under the receiver of characteristics (AUC) of 96.77%, sensitivity and specificity of 98.04% and 93.75% for the placental maturity staging, respectively. Our experimental results also demonstrate that the dense feature outperforms the traditional sparse feature for placental maturity staging.

[1]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[2]  John Ryan,et al.  3D Power Doppler ultrasound and computerised placental assessment in normal pregnancy , 2014 .

[3]  Thomas Mensink,et al.  Image Classification with the Fisher Vector: Theory and Practice , 2013, International Journal of Computer Vision.

[4]  Myra Spiliopoulou,et al.  Learning and inspecting classification rules from longitudinal epidemiological data to identify predictive features on hepatic steatosis , 2014, Expert Syst. Appl..

[5]  Ying Zhang,et al.  Notice of Violation of IEEE Publication PrinciplesBag-of-Features Based Medical Image Retrieval via Multiple Assignment and Visual Words Weighting , 2011, IEEE Transactions on Medical Imaging.

[6]  V. Feldstein,et al.  Ultrasound of the Placenta and Umbilical Cord: A Review , 2011, Ultrasound quarterly.

[7]  B. Roald,et al.  A new, clinically oriented, unifying and simple placental classification system. , 2012, Placenta.

[8]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[9]  Roy E. Welsch,et al.  Experimenting Liver Fibrosis Diagnostic by Two Photon Excitation Microscopy and Bag-of-Features Image Classification , 2014, Scientific Reports.

[10]  Herong Zheng,et al.  Application of Multi-Classification Support Vector Machine in the B-Placenta Image Classification , 2009, 2009 International Conference on Computational Intelligence and Software Engineering.

[11]  Florent Perronnin,et al.  Fisher Kernels on Visual Vocabularies for Image Categorization , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Tai-Lang Jong,et al.  Evaluation of placental maturity by the sonographic textures , 2011, Archives of Gynecology and Obstetrics.

[13]  A Franx,et al.  Placental pathology in early intrauterine growth restriction associated with maternal hypertension. , 2014, Placenta.

[14]  Yuan Yao,et al.  Automatic grading of placental maturity based on LIOP and fisher vector , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[15]  Hakan Mutlu,et al.  Evaluation of the placenta with relative apparent diffusion coefficient and T2 signal intensity analysis. , 2013, Diagnostic and interventional radiology.

[16]  Fikret S. Gürgen,et al.  Intrauterine growth restriction (IUGR) risk decision based on support vector machines , 2010, Expert Syst. Appl..

[17]  Ming-Huwi Horng Performance evaluation of multiple classification of the ultrasonic supraspinatus images by using ML, RBFNN and SVM classifiers , 2010, Expert Syst. Appl..

[18]  Cordelia Schmid,et al.  Scale & Affine Invariant Interest Point Detectors , 2004, International Journal of Computer Vision.

[19]  F. Mcauliffe,et al.  Imaging and assessment of placental function , 2011, Journal of clinical ultrasound : JCU.

[20]  Ee-Leng Tan,et al.  Saliency-driven image classification method based on histogram mining and image score , 2015, Pattern Recognit..

[21]  John Ryan,et al.  Computerized assessment of placental calcification post‐ultrasound: a novel software tool , 2013, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[22]  Dong Ni,et al.  Automatic Recognition of Fetal Facial Standard Plane in Ultrasound Image via Fisher Vector , 2015, PloS one.

[23]  Dong Ni,et al.  Automatic staging of placental maturity based on dense descriptor. , 2014, Bio-medical materials and engineering.

[24]  Cordelia Schmid,et al.  Aggregating Local Image Descriptors into Compact Codes , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  J. Sheeder,et al.  Rapid repeat pregnancy in adolescents: do immediate postpartum contraceptive implants make a difference? , 2012, American journal of obstetrics and gynecology.

[26]  Bernadette Sharp,et al.  Image analysis of histological features in molar pregnancies , 2013, Expert Syst. Appl..

[27]  Ulas Bagci,et al.  Synergistic combination of clinical and imaging features predicts abnormal imaging patterns of pulmonary infections , 2013, Comput. Biol. Medicine.

[28]  Vincent Lepetit,et al.  DAISY: An Efficient Dense Descriptor Applied to Wide-Baseline Stereo , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  K H Chen,et al.  Exploring the relationship between preterm placental calcification and adverse maternal and fetal outcome , 2011, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[30]  Yong Man Ro,et al.  Multiple ROI selection based focal liver lesion classification in ultrasound images , 2013, Expert Syst. Appl..

[31]  Bin Fan,et al.  Local Intensity Order Pattern for feature description , 2011, 2011 International Conference on Computer Vision.

[32]  G. Zombori,et al.  Novel placental ultrasound assessment: potential role in pre-gestational diabetic pregnancy. , 2014, Placenta.

[33]  Eduard Gratacós,et al.  Performance of an automatic quantitative ultrasound analysis of the fetal lung to predict fetal lung maturity. , 2012, American journal of obstetrics and gynecology.

[34]  Georgina Stegmayer,et al.  Automatic recognition of quarantine citrus diseases , 2013, Expert Syst. Appl..

[35]  Shumei Wei,et al.  Double contrast-enhanced ultrasonography in preoperative Borrmann classification of advanced gastric carcinoma: comparison with histopathology , 2013, Scientific Reports.

[36]  Dianfu Ma,et al.  Multiview Locally Linear Embedding for Effective Medical Image Retrieval , 2013, PloS one.

[37]  Carla E. Brodley,et al.  Unsupervised Feature Selection Applied to Content-Based Retrieval of Lung Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Jaap Oosterlaan,et al.  Placental pathology and long-term neurodevelopment of very preterm infants. , 2012, American journal of obstetrics and gynecology.

[39]  Mark Hewko,et al.  Collagen morphology and texture analysis: from statistics to classification , 2013, Scientific Reports.

[40]  Woo Kyung Moon,et al.  Combining support vector machine with genetic algorithm to classify ultrasound breast tumor images , 2012, Comput. Medical Imaging Graph..

[41]  Norman D. Black,et al.  Feature selection for the characterization of ultrasonic images of the placenta using texture classification , 2004, 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro (IEEE Cat No. 04EX821).

[42]  R L Berkowitz,et al.  The ultrasonic changes in the maturing placenta and their relation to fetal pulmonic maturity. , 1979, American journal of obstetrics and gynecology.