MCA-NN: Multiple Correspondence Analysis Based Neural Network for Disaster Information Detection

This paper proposes a semantic content analysis framework for reliable video event detection. In this work, we target to improve the concept detection results by feeding the learnt results from individual shallow learning models into a generic model to dig out of the similarities in deeper layers. Compared to the deep learning models, the shallow learning models are memorizing rather than understanding the features. The proposed framework tackles the issue in shallow learning by integrating the strength of Multiple Correspondence Analysis (MCA) and Multilayer Perceptron (MLP) neural network. The low-level features are taken as the initial inputs for MCA-based models to abstract higher-level feature values. The output values further involve interaction in the neural network for better understanding. It earns the ability to put forward the arguments. The framework provides final decisions of video classifications by analyzing the decisions of every single frame from the network outputs.

[1]  Shu-Ching Chen,et al.  Rule-Based Semantic Concept Classification from Large-Scale Video Collections , 2013, Int. J. Multim. Data Eng. Manag..

[2]  Jay F. Nunamaker,et al.  A Knowledge Management Framework for the Support of Decision Making in Humanitarian Assistance/Disaster Relief , 2002, Knowledge and Information Systems.

[3]  Min Chen,et al.  Spatio-Temporal Analysis for Human Action Detection and Recognition in Uncontrolled Environments , 2015, Int. J. Multim. Data Eng. Manag..

[4]  Min Chen,et al.  Correlation-based re-ranking for semantic concept detection , 2014, Proceedings of the 2014 IEEE 15th International Conference on Information Reuse and Integration (IEEE IRI 2014).

[5]  Shu-Ching Chen,et al.  Feature Selection Using Correlation and Reliability Based Scoring Metric for Video Semantic Detection , 2010, 2010 IEEE Fourth International Conference on Semantic Computing.

[6]  Min Chen,et al.  Image database retrieval utilizing affinity relationships , 2003, MMDB '03.

[7]  Shu-Ching Chen,et al.  A Visual Analytics Multimedia Mobile System for Emergency Response , 2011, 2011 IEEE International Symposium on Multimedia.

[8]  Shu-Ching Chen,et al.  Hierarchical disaster image classification for situation report enhancement , 2011, 2011 IEEE International Conference on Information Reuse & Integration.

[9]  Hsin-Yu Ha,et al.  A Multimedia Semantic Retrieval Mobile System Based on HCFGs , 2014, IEEE MultiMedia.

[10]  Mei-Ling Shyu,et al.  Discriminative learning- assisted video semantic concept classification , 2017 .

[11]  Shu-Ching Chen,et al.  Video Semantic Concept Discovery using Multimodal-Based Association Classification , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[12]  Yi Deng,et al.  urvey of data management and analysis in disaster situations , 2010 .

[13]  Shu-Ching Chen,et al.  A Video-Aided Semantic Analytics System for Disaster Information Integration , 2017, 2017 IEEE Third International Conference on Multimedia Big Data (BigMM).

[14]  Graham W. Taylor,et al.  Adaptive deconvolutional networks for mid and high level feature learning , 2011, 2011 International Conference on Computer Vision.

[15]  Choochart Haruechaiyasak,et al.  Category cluster discovery from distributed WWW directories , 2003, Inf. Sci..

[16]  Hong-Ren Su,et al.  Automatic Detection and Removal of Visible Image Watermarks , 2017 .

[17]  J. Fan,et al.  Semantic video classification and feature subset selection under context and concept uncertainty , 2004, Proceedings of the 2004 Joint ACM/IEEE Conference on Digital Libraries, 2004..

[18]  Rainer Lienhart,et al.  An extended set of Haar-like features for rapid object detection , 2002, Proceedings. International Conference on Image Processing.

[19]  Rangasami L. Kashyap,et al.  Identifying Overlapped Objects for Video Indexing and Modeling in Multimedia Database Systems , 2001, Int. J. Artif. Intell. Tools.

[20]  Shu-Ching Chen,et al.  Correlation-Based Deep Learning for Multimedia Semantic Concept Detection , 2015, WISE.

[21]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[22]  Rong Yan,et al.  Cross-domain video concept detection using adaptive svms , 2007, ACM Multimedia.

[23]  Rangasami L. Kashyap,et al.  Semantic Models for Multimedia Database Searching and Browsing , 2000, Advances in Database Systems.

[24]  Tao Li,et al.  MADIS: A Multimedia-Aided Disaster information Integration System for emergency management , 2012, 8th International Conference on Collaborative Computing: Networking, Applications and Worksharing (CollaborateCom).

[25]  Xue-wen Chen,et al.  FAST: a roc-based feature selection metric for small samples and imbalanced data classification problems , 2008, KDD.

[26]  David A. Landgrebe,et al.  A survey of decision tree classifier methodology , 1991, IEEE Trans. Syst. Man Cybern..

[27]  Shu-Ching Chen,et al.  Correlation-Based Video Semantic Concept Detection Using Multiple Correspondence Analysis , 2008, 2008 Tenth IEEE International Symposium on Multimedia.

[28]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[29]  John S. Boreczky,et al.  Comparison of video shot boundary detection techniques , 1996, Electronic Imaging.

[30]  Shamik Sural,et al.  Segmentation and histogram generation using the HSV color space for image retrieval , 2002, Proceedings. International Conference on Image Processing.

[31]  Shu-Ching Chen,et al.  Disaster Image Filtering and Summarization Based on Multi-layered Affinity Propagation , 2012, 2012 IEEE International Symposium on Multimedia.

[32]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[33]  Yiannis S. Boutalis,et al.  CEDD: Color and Edge Directivity Descriptor: A Compact Descriptor for Image Indexing and Retrieval , 2008, ICVS.

[34]  Rangasami L. Kashyap,et al.  Temporal And Spatial Semantic Models For Multimedia Presentations , 1997 .

[35]  Ian H. Witten,et al.  WEKA: a machine learning workbench , 1994, Proceedings of ANZIIS '94 - Australian New Zealnd Intelligent Information Systems Conference.

[36]  Xin Huang,et al.  User Concept Pattern Discovery Using Relevance Feedback And Multiple Instance Learning For Content-Based Image Retrieval , 2002, MDM/KDD.

[37]  Chao Chen,et al.  Weighted Subspace Filtering and Ranking Algorithms for Video Concept Retrieval , 2011, IEEE MultiMedia.

[38]  P. GALLINARI,et al.  On the relations between discriminant analysis and multilayer perceptrons , 1991, Neural Networks.

[39]  Shu-Ching Chen,et al.  Multimedia Databases and Data Management: A Survey , 2010, Int. J. Multim. Data Eng. Manag..