Automatic Text Summarization Using Customizable Fuzzy Features and Attention on the Context and Vocabulary

Nowadays, as the users of the internet are increasingly ensnared by information overload, the significance of automatic text summarization becomes more and more evident. Thus far, the performance of the proposed approaches to automatically summarize complex articles, e.g. news articles and technical documents, have been far away from application levels to produce humanlike summaries, especially when the complexity of such articles are increased by discussing multiple topics. In this research, we present a novel automatic, yet more applicable, approach for text summarization using customizable fuzzy features and neural sequence-to-sequence model with attention mechanism on the word distribution both in the context and vocabulary. We assess the performance of our model on CNN/Daily Mail summarization task, through multiple devised evalution schemes comparing its applicability and summaries' quality with the state-of-the-art models.

[1]  Shahab Mehraeen,et al.  Effective Scheduling of Reconfigurable Microgrids With Dynamic Thermal Line Rating , 2019, IEEE Transactions on Industrial Electronics.

[2]  Berat A. Erol,et al.  Proposed testbed for the modeling and control of a system of autonomous vehicles , 2016, 2016 11th System of Systems Engineering Conference (SoSE).

[3]  Lee H. Keel,et al.  Secured formation control for multi-agent systems under DoS attacks , 2016, 2016 IEEE Symposium on Technologies for Homeland Security (HST).

[4]  Mahdi Bahaghighat,et al.  Text-dependent Speaker Recognition by Combination of LBG VQ and DTW for Persian Language , 2012 .

[5]  Morteza Dabbaghjamanesh,et al.  Design of networked polynomial control systems with random delays: sum of squares approach , 2016, Int. J. Autom. Control..

[6]  Hamed Bouzary,et al.  Service optimal selection and composition in cloud manufacturing: a comprehensive survey , 2018 .

[7]  Bowen Zhou,et al.  SummaRuNNer: A Recurrent Neural Network Based Sequence Model for Extractive Summarization of Documents , 2016, AAAI.

[8]  Alireza Kazemi,et al.  Vision-Based Hierarchical Fuzzy Controller and Real Time Results for a Wheeled Autonomous Robot , 2010 .

[9]  Berat A. Erol,et al.  Cloud-based control and vSLAM through cooperative Mapping and Localization , 2016, 2016 World Automation Congress (WAC).

[10]  P. Shahmaleki,et al.  Real time experimental study of truck backer upper problem with fuzzy controller , 2008, 2008 World Automation Congress.

[11]  Majid Poshtan,et al.  Experimental validation on stator fault detection via fuzzy logic , 2013, 2013 3rd International Conference on Electric Power and Energy Conversion Systems.

[12]  Phil Blunsom,et al.  Language as a Latent Variable: Discrete Generative Models for Sentence Compression , 2016, EMNLP.

[13]  Farshid Sahba,et al.  The diagnosis of lumbar disc disorder by MR image processing and data mining , 2016, 2016 World Automation Congress (WAC).

[14]  Naoaki Okazaki,et al.  Neural Headline Generation on Abstract Meaning Representation , 2016, EMNLP.

[15]  Mo Jamshidi,et al.  Big Data Analytic via Soft Computing Paradigms , 2015 .

[16]  Amin Sahba,et al.  Hypercube based clusters in Cloud Computing , 2016, 2016 World Automation Congress (WAC).

[17]  Morteza Dabbaghjamanesh,et al.  Applying the modified TLBO algorithm to solve the unit commitment problem , 2016, 2016 World Automation Congress (WAC).

[18]  Berat A. Erol,et al.  Improved Deep Neural Network Object Tracking System for Applications in Home Robotics , 2018 .

[19]  Javad Poshtan,et al.  Simulative and experimental investigation on stator winding turn and unbalanced supply voltage fault diagnosis in induction motors using Artificial Neural Networks. , 2015, ISA transactions.

[20]  Mehdi Madani,et al.  Real time object detection using a novel adaptive color thresholding method , 2011, Ubi-MUI '11.

[21]  P. Shahmaleki,et al.  Designing a hierarchical fuzzy controller for backing-up a four wheel autonomous robot , 2008, 2008 American Control Conference.

[22]  Naomie Salim,et al.  Fuzzy Logic Based Method for Improving Text Summarization , 2009, ArXiv.

[23]  Lee H. Keel,et al.  Model-based resilient control for a multi-agent system against Denial of Service attacks , 2016, 2016 World Automation Congress (WAC).

[24]  Regina Barzilay,et al.  Using Lexical Chains for Text Summarization , 1997 .

[25]  Fuji Ren,et al.  GA, MR, FFNN, PNN and GMM based models for automatic text summarization , 2009, Comput. Speech Lang..

[26]  Bowen Zhou,et al.  Abstractive Text Summarization using Sequence-to-sequence RNNs and Beyond , 2016, CoNLL.

[27]  Yilin Zhang,et al.  A Real-Time Per-Thread IQ-Capping Technique for Simultaneous Multi-threading (SMT) Processors , 2014, 2014 11th International Conference on Information Technology: New Generations.

[28]  Mehdi Roopaei Applied Cloud Deep Semantic Recognition: Advanced Anomaly Detection , 2018 .

[29]  H. Kaplan,et al.  Modeling of system of systems via data analytics — Case for “Big Data” in SoS , 2013, 2013 8th International Conference on System of Systems Engineering.

[30]  Simone Paolo Ponzetto,et al.  Cascaded filtering for topic-driven multi-document summarization , 2007 .

[31]  Farshid Sahba,et al.  Museum automation with RFID , 2014, 2014 World Automation Congress (WAC).

[32]  Mojtaba Mahzoon,et al.  Designing Fuzzy Controller and Real Time Experimental Studies on a Nonholonomic Robot , 2009, CTS 2009.

[33]  Eric SanJuan,et al.  A New Hybrid Summarizer Based on Vector Space Model, Statistical Physics and Linguistics , 2007, MICAI.

[34]  Hui Lin,et al.  Multi-agent System for Detecting False Data Injection Attacks Against the Power Grid , 2016, ICSS '16.

[35]  Naomie Salim,et al.  Fuzzy Swarm Based Text Summarization , 2009 .

[36]  Farshid Sahba Wireless Sensors and RFID in Garden Automation , 2014 .

[37]  Paul Rad,et al.  A Distributed Secure Machine-Learning Cloud Architecture for Semantic Analysis , 2018 .

[38]  Farshid Sahba,et al.  Smart tractors in pistachio orchards equipped with RFID , 2016, 2016 World Automation Congress (WAC).

[39]  Paul Rad,et al.  AI Thinking for Cloud Education Platform with Personalized Learning , 2018, HICSS.

[40]  Paul Rad,et al.  Deep learning control for complex and large scale cloud systems , 2017, Intell. Autom. Soft Comput..

[41]  Alexander M. Rush,et al.  Abstractive Sentence Summarization with Attentive Recurrent Neural Networks , 2016, NAACL.

[42]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[43]  Jade Goldstein-Stewart,et al.  The Use of MMR, Diversity-Based Reranking for Reordering Documents and Producing Summaries , 1998, SIGIR Forum.

[44]  Naomie Salim,et al.  Swarm Diversity Based Text Summarization , 2009, ICONIP.

[45]  Hang Li,et al.  “ Tony ” DNN Embedding for “ Tony ” Selective Read for “ Tony ” ( a ) Attention-based Encoder-Decoder ( RNNSearch ) ( c ) State Update s 4 SourceVocabulary Softmax Prob , 2016 .

[46]  Dianne P. O'Leary,et al.  Text summarization via hidden Markov models , 2001, SIGIR '01.

[47]  Javad Poshtan,et al.  Induction motor stator fault detection via fuzzy logic , 2013, 2013 21st Iranian Conference on Electrical Engineering (ICEE).