Multi-task reading for intelligent legal services

Abstract Since legal data contains both structured data and unstructured data, it is a great challenge to implement machine reading comprehension technology in empirical analysis of law. This paper proposes a multi-tasking reading for intelligent legal services, which applies statistical analysis and machine reading comprehension techniques, and can process both structured and unstructured data. At the same time, this paper proposes a machine reading comprehension model that can perform multi-task learning, LegalSelfReader, which can solve the problem of diversity of questions. In the experiment of the legal reading comprehension dataset CJRC, the model proposed in this paper is far superior to the two classic models of BIDAF and Bert in three evaluation indicators. And our model is also better than some models published by HFL(Harbin Institute of Technology and iFly Joint Lab), and has also achieved lower consumption in training costs. At the same time, in the experiment of visualizing the attention value, it also demonstrates that the model proposed in this paper has a stronger ability to extract evidence.

[1]  Susan W. van den Braak,et al.  Legal Logistics: A Framework to Unify Data Centric Services for Smart and Open Justice , 2018 .

[2]  Maosong Sun,et al.  ERNIE: Enhanced Language Representation with Informative Entities , 2019, ACL.

[3]  Wanxiang Che,et al.  Pre-Training with Whole Word Masking for Chinese BERT , 2019, ArXiv.

[4]  Mireille Hildebrandt,et al.  Law As Computation in the Era of Artificial Legal Intelligence. Speaking Law to the Power of Statistics , 2017 .

[5]  Danqi Chen,et al.  A Thorough Examination of the CNN/Daily Mail Reading Comprehension Task , 2016, ACL.

[6]  Jianfeng Gao,et al.  A Human Generated MAchine Reading COmprehension Dataset , 2018 .

[7]  D. Katz.  Quantitative Legal Prediction – or – How I Learned to Stop Worrying and Start Preparing for the Data Driven Future of the Legal Services Industry , 2012 .

[8]  Phil Blunsom,et al.  Teaching Machines to Read and Comprehend , 2015, NIPS.

[9]  Ming Zhou,et al.  Reinforced Mnemonic Reader for Machine Reading Comprehension , 2017, IJCAI.

[10]  Gürsel Serpen,et al.  Validation of a bayesian belief network representation for posterior probability calculations on national crime victimization survey , 2008, Artificial Intelligence and Law.

[11]  Rudolf Kadlec,et al.  Text Understanding with the Attention Sum Reader Network , 2016, ACL.

[12]  Josh Blackman,et al.  Predicting the Behavior of the Supreme Court of the United States: A General Approach , 2014, ArXiv.

[13]  Ali Farhadi,et al.  Bidirectional Attention Flow for Machine Comprehension , 2016, ICLR.

[14]  N. Weiner,et al.  The Use of Peremptory Challenges in Capital Murder Trials: A Legal and Empirical Analysis , 2001 .

[15]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.