Recent Advances in Neural Question Generation

Emerging research in Neural Question Generation (NQG) has started to integrate a larger variety of inputs, and generating questions requiring higher levels of cognition. These trends point to NQG as a bellwether for NLP, about how human intelligence embodies the skills of curiosity and integration. We present a comprehensive survey of neural question generation, examining the corpora, methodologies, and evaluation methods. From this, we elaborate on what we see as emerging on NQG's trend: in terms of the learning paradigms, input modalities, and cognitive levels considered by NQG. We end by pointing out the potential directions ahead.

[1]  Xinya Du,et al.  Harvesting Paragraph-level Question-Answer Pairs from Wikipedia , 2018, ACL.

[2]  B. Bloom,et al.  Taxonomy of Educational Objectives. Handbook I: Cognitive Domain , 1966 .

[3]  Ming Liu,et al.  G-Asks: An Intelligent Automatic Question Generation System for Academic Writing Support , 2012, Dialogue Discourse.

[4]  Yanjun Ma,et al.  Answer-focused and Position-aware Neural Question Generation , 2018, EMNLP.

[5]  Bowen Zhou,et al.  Pointing the Unknown Words , 2016, ACL.

[6]  Ming Zhou,et al.  Gated Self-Matching Networks for Reading Comprehension and Question Answering , 2017, ACL.

[7]  Noah A. Smith,et al.  Automatic factual question generation from text , 2011 .

[8]  D. Krathwohl.  A Taxonomy for Learning, Teaching and Assessing: , 2008 .

[9]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[10]  Margaret Mitchell,et al.  Generating Natural Questions About an Image , 2016, ACL.

[11]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[12]  Arthur C. Graesser,et al.  Experiments on Generating Questions About Facts , 2009, CICLing.

[13]  Ming Zhou,et al.  Learning to Collaborate for Question Answering and Asking , 2018, NAACL.

[14]  Jian Zhang,et al.  SQuAD: 100,000+ Questions for Machine Comprehension of Text , 2016, EMNLP.

[15]  Hai Zhao,et al.  Attention Is All You Need for Chinese Word Segmentation , 2019, EMNLP.

[16]  Jianfeng Gao,et al.  A Human Generated MAchine Reading COmprehension Dataset , 2018 .

[17]  Ming Zhou,et al.  Neural Question Generation from Text: A Preliminary Study , 2017, NLPCC.

[18]  Ming Liu,et al.  Automatic Question Generation for Literature Review Writing Support , 2010, Intelligent Tutoring Systems.

[19]  Samuel R. Bowman,et al.  Ruminating Reader: Reasoning with Gated Multi-hop Attention , 2017, QA@ACL.

[20]  Christophe Gravier,et al.  Zero-Shot Question Generation from Knowledge Graphs for Unseen Predicates and Entity Types , 2018, NAACL.

[21]  Tong Wang,et al.  A Joint Model for Question Answering and Question Generation , 2017, ArXiv.

[22]  Gary Geunbae Lee,et al.  Recent Approaches to Dialog Management for Spoken Dialog Systems , 2010, J. Comput. Sci. Eng..

[23]  Ming Zhou,et al.  Question Generation from SQL Queries Improves Neural Semantic Parsing , 2018, EMNLP.

[24]  Joelle Pineau,et al.  How NOT To Evaluate Your Dialogue System: An Empirical Study of Unsupervised Evaluation Metrics for Dialogue Response Generation , 2016, EMNLP.

[25]  Rayid Ghani,et al.  Analyzing the effectiveness and applicability of co-training , 2000, CIKM '00.

[26]  Lantao Yu,et al.  SeqGAN: Sequence Generative Adversarial Nets with Policy Gradient , 2016, AAAI.

[27]  Kyomin Jung,et al.  Improving Neural Question Generation using Answer Separation , 2018, AAAI.

[28]  Richard G. Baraniuk,et al.  QG-net: a data-driven question generation model for educational content , 2018, L@S.

[29]  Jie Yang,et al.  LearningQ: A Large-Scale Dataset for Educational Question Generation , 2018, ICWSM.

[30]  Ganesh Ramakrishnan,et al.  Automating Reading Comprehension by Generating Question and Answer Pairs , 2018, PAKDD.

[31]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[32]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[33]  Mitesh M. Khapra,et al.  Generating Natural Language Question-Answer Pairs from a Knowledge Graph Using a RNN Based Question Generation Model , 2017, EACL.

[34]  John C. Nesbit,et al.  Generating Natural Language Questions to Support Learning On-Line , 2013, ENLG.

[35]  Marilyn A. Walker,et al.  Neural Generation of Diverse Questions using Answer Focus, Contextual and Linguistic Features , 2018, INLG.

[36]  Benjamin S. Bloom,et al.  A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives , 2000 .

[37]  Paul Piwek,et al.  The First Question Generation Shared Task Evaluation Challenge , 2010, Dialogue Discourse.

[38]  Shaodi You,et al.  Automatic Generation of Grounded Visual Questions , 2016, IJCAI.

[39]  Vasile Rus,et al.  Question Generation Shared Task and Evaluation Challenge – Status Report , 2011, ENLG.

[40]  Rodney D. Nielsen,et al.  Linguistic Considerations in Automatic Question Generation , 2014, ACL.

[41]  Sadid A. Hasan,et al.  Automation of Question Generation From Sentences , 2011 .

[42]  Xinya Du,et al.  Learning to Ask: Neural Question Generation for Reading Comprehension , 2017, ACL.

[43]  Seung-won Hwang,et al.  KBQA: Learning Question Answering over QA Corpora and Knowledge Bases , 2019, Proc. VLDB Endow..

[44]  Guokun Lai,et al.  RACE: Large-scale ReAding Comprehension Dataset From Examinations , 2017, EMNLP.

[45]  Xuchen Yao,et al.  Question Generation with Minimal Recursion Semantics , 2010 .

[46]  Yao Zhao,et al.  Paragraph-level Neural Question Generation with Maxout Pointer and Gated Self-attention Networks , 2018, EMNLP.

[47]  Ganesh Ramakrishnan,et al.  A framework for automatic question generation from text using deep reinforcement learning , 2018, ArXiv.

[48]  Bowen Zhou,et al.  A Structured Self-attentive Sentence Embedding , 2017, ICLR.

[49]  Todd M. Gureckis,et al.  Question Asking as Program Generation , 2017, NIPS.

[50]  Philip Bachman,et al.  Machine Comprehension by Text-to-Text Neural Question Generation , 2017, Rep4NLP@ACL.

[51]  Philipp Koehn,et al.  Re-evaluating the Role of Bleu in Machine Translation Research , 2006, EACL.

[52]  Eric P. Xing,et al.  Self-Training for Jointly Learning to Ask and Answer Questions , 2018, NAACL.

[53]  Alexander G. Schwing,et al.  Creativity: Generating Diverse Questions Using Variational Autoencoders , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[54]  Yong Yu,et al.  Long Text Generation via Adversarial Training with Leaked Information , 2017, AAAI.

[55]  Sadid A. Hasan,et al.  Towards Topic-to-Question Generation , 2015, CL.

[56]  Jason Weston,et al.  Translating Embeddings for Modeling Multi-relational Data , 2013, NIPS.

[57]  Michael S. Bernstein,et al.  Visual7W: Grounded Question Answering in Images , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[58]  Idan Szpektor,et al.  Generating Synthetic Comparable Questions for News Articles , 2013, ACL.

[59]  Vasile Rus,et al.  The 2nd Workshop on Question Generation , 2009, AIED.

[60]  Noah A. Smith,et al.  Good Question! Statistical Ranking for Question Generation , 2010, NAACL.

[61]  Alon Lavie,et al.  The Meteor metric for automatic evaluation of machine translation , 2009, Machine Translation.

[62]  Ramakanth Pasunuru,et al.  Soft Layer-Specific Multi-Task Summarization with Entailment and Question Generation , 2018, ACL.

[63]  Mark T. Maybury,et al.  Advances in Automatic Text Summarization , 1999 .

[64]  Gregory Aist,et al.  Generating Questions Automatically from Informational Text , 2009 .

[65]  Arthur C. Graesser,et al.  Question Generation from Concept Maps , 2012, Dialogue Discourse.

[66]  Chin-Yew Lin,et al.  ROUGE: A Package for Automatic Evaluation of Summaries , 2004, ACL 2004.

[67]  Yi Zhang,et al.  Semantics-based Question Generation and Implementation , 2012, Dialogue Discourse.

[68]  Yue Zhang,et al.  Leveraging Context Information for Natural Question Generation , 2018, NAACL.

[69]  Philip Bachman,et al.  NewsQA: A Machine Comprehension Dataset , 2016, Rep4NLP@ACL.

[70]  Salim Roukos,et al.  Bleu: a Method for Automatic Evaluation of Machine Translation , 2002, ACL.

[71]  Chris Dyer,et al.  The NarrativeQA Reading Comprehension Challenge , 2017, TACL.

[72]  Tong Wang,et al.  Neural Models for Key Phrase Extraction and Question Generation , 2017, QA@ACL.

[73]  Margaret Mitchell,et al.  VQA: Visual Question Answering , 2015, International Journal of Computer Vision.

[74]  David Grangier,et al.  Neural Text Generation from Structured Data with Application to the Biography Domain , 2016, EMNLP.

[75]  Richard S. Zemel,et al.  Exploring Models and Data for Image Question Answering , 2015, NIPS.

[76]  Ming Zhou,et al.  Question Generation for Question Answering , 2017, EMNLP.

[77]  Igor Labutov,et al.  Deep Questions without Deep Understanding , 2015, ACL.

[78]  Samy Bengio,et al.  Show and tell: A neural image caption generator , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[79]  Mitesh M. Khapra,et al.  Towards a Better Metric for Evaluating Question Generation Systems , 2018, EMNLP.

[80]  Xinya Du,et al.  Identifying Where to Focus in Reading Comprehension for Neural Question Generation , 2017, EMNLP.

[81]  A. Graesser,et al.  Question Asking During Tutoring , 1994 .