Applying an Interactive Machine Learning Approach to Statutory Analysis

Statutory analysis is a significant component of research on almost any legal issue and determining if a statutory provision applies is an integral part of the analysis. In this paper we present the initial results from an attempt to support the applicability assessment in situations where the number of statutory provisions to be considered is large. We propose the use of a framework in which a single human expert cooperates with a machine learning text classification algorithm. Our experiments show that an adoption of the approach leads to a better performance during the relevance assessment. In addition, we suggest how to re-use a classification model trained during one statutory analysis for another related analysis. This points to a new way of capturing and re-using knowledge produced in the course of statutory analysis. Our experiments confirm the viability of this approach.

[1]  Burr Settles,et al.  Active Learning Literature Survey , 2009 .

[2]  Kevin D. Ashley,et al.  Transfer of predictive models for classification of statutory texts in multi-jurisdictional settings , 2015, ICAIL.

[3]  Dieter Merkl,et al.  A learning technique for legal document analysis , 1999, ICAIL '99.

[4]  Kevin D. Ashley,et al.  Mining Information from Statutory Texts in Multi-Jurisdictional Settings , 2014, JURIX.

[5]  Thorsten Joachims,et al.  Making large scale SVM learning practical , 1998 .

[6]  Chen Wang,et al.  Introducing LUIMA: an experiment in legal conceptual retrieval of vaccine injury decisions using a UIMA type system and tools , 2015, ICAIL.

[7]  Ian Langmore,et al.  Flexible Processing and Classification for eDiscovery , 2013, JURIX.

[8]  Jianlin CHENG,et al.  Soft Labeling for Multi-Pass Document Review , 2013 .

[9]  Desney S. Tan,et al.  Effective End-User Interaction with Machine Learning , 2011, AAAI.

[10]  Gordon V. Cormack,et al.  Faster , better , cheaper legal document review , pipe dream or reality ? Using statistical sampling , quality control and predictive coding to improve accuracy and efficiency , 2011 .

[11]  Aniket Kittur,et al.  Apolo: making sense of large network data by combining rich user interaction and machine learning , 2011, CHI.

[12]  Dieter Merkl,et al.  The exploration of legal text corpora with hierarchical neural networks: a guided tour in public international law , 1997, ICAIL '97.

[13]  Dan Brassil,et al.  Human-aided computer cognition for e-discovery , 2009, ICAIL.

[14]  Thomas Ertl,et al.  Visual Classifier Training for Text Document Retrieval , 2012, IEEE Transactions on Visualization and Computer Graphics.

[15]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[16]  Radboud Winkels,et al.  Towards a Legal Recommender System , 2014, JURIX.

[17]  Ryan Shaun Joazeiro de Baker,et al.  Case studies in the use of ROC curve analysis for sensor-based estimates in human computer interaction , 2005, Graphics Interface.

[18]  Hinrich Schütze,et al.  Introduction to information retrieval , 2008 .

[19]  Jerry Alan Fails,et al.  Interactive machine learning , 2003, IUI '03.

[20]  Gaurav Trivedi,et al.  Clinical Text Analysis Using Interactive Natural Language Processing , 2015, IUI Companion.

[21]  Paulo Quaresma,et al.  A collaborative legal information retrieval system using dynamic logic programming , 1999, ICAIL '99.

[22]  Marie-Francine Moens,et al.  What Information Retrieval Can Learn from Case-Based Reasoning , 2002 .