Learning Users' Intention of Legal Consultation through Pattern-Oriented Tensor Decomposition with Bi-LSTM

Online legal consultation plays an increasingly important role in the modern rule-of-law society. This study aims to understand the intention of legal consultation of users with different language expressions and legal knowledge background. A critical issue is a method through which users’ legal consultation data are classified and the feature of each category is extracted. Traditional classification methods rely considerably on lexical and syntactic features and frequently require strict sentence formatting, which eliminates substantial energy and may not be universally applicable. We aim to extract the patterns of users’ consultation on different categories, which minimally depend on lexical, syntax, and sentence formatting. However, research in this area has rarely been conducted in previous legal advisory service studies. In this study, a classification approach for multiclass users’ intention based on pattern-oriented tensor decomposition and Bi-LSTM is proposed, and each user’s legal consulting statement is expressed as a tensor. Moreover, we propose a pattern-oriented tensor decomposition method that can obtain a core tensor that approximates the patterns of users’ consultation. These patterns can improve the accuracy of classifying users’ intention of legal consultation. We use Bi-LSTM to automatically learn and optimize these patterns. Evidently, Bi-LSTM with a pattern-oriented tensor decomposition layer performs better than a recurrent neural network only. Results show that our method is more accurate than the previous work, and the factor matrix and core tensor calculated by the pattern-oriented tensor decomposition are interpretable.

[1]  A. Cichocki,et al.  Tensor decompositions for feature extraction and classification of high dimensional datasets , 2010 .

[2]  Sebastian Thrun,et al.  Text Classification from Labeled and Unlabeled Documents using EM , 2000, Machine Learning.

[3]  Radboud Winkels,et al.  Machine Learning versus Knowledge Based Classification of Legal Texts , 2010, JURIX.

[4]  Leon O. Chua,et al.  The CNN paradigm , 1993 .

[5]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[6]  Tao Chen,et al.  Expert Systems With Applications , 2022 .

[7]  Peng Wang,et al.  Semantic expansion using word embedding clustering and convolutional neural network for improving short text classification , 2016, Neurocomputing.

[8]  Graham Greenleaf,et al.  Generating legal arguments , 1989, Knowl. Based Syst..

[9]  Ivan V. Oseledets,et al.  Grid-based electronic structure calculations: The tensor decomposition approach , 2015, J. Comput. Phys..

[10]  Y-H Taguchi,et al.  Identification of candidate drugs using tensor-decomposition-based unsupervised feature extraction in integrated analysis of gene expression between diseases and DrugMatrix datasets , 2017, Scientific Reports.

[11]  Alper Kursat Uysal,et al.  An improved global feature selection scheme for text classification , 2016, Expert Syst. Appl..

[12]  Andrew McCallum,et al.  Ask the GRU: Multi-task Learning for Deep Text Recommendations , 2016, RecSys.

[13]  Pierre Comon,et al.  General tensor decomposition, moment matrices and applications , 2013, J. Symb. Comput..

[14]  Ran El-Yaniv,et al.  How to Better Use Expert Advice , 2004, Machine Learning.

[15]  James A. Hendler,et al.  Semantic sensitive tensor factorization , 2016, Artif. Intell..

[16]  Achim G. Hoffmann,et al.  LEXA: Towards Automatic Legal Citation Classification , 2010, Australasian Conference on Artificial Intelligence.

[17]  Josef van Genabith,et al.  Exploring the Use of Text Classification in the Legal Domain , 2017, ASAIL@ICAIL.

[18]  Y-H Taguchi,et al.  Tensor decomposition-based unsupervised feature extraction applied to matrix products for multi-view data processing , 2017, PloS one.

[19]  Ivan Oseledets,et al.  Tensor-Train Decomposition , 2011, SIAM J. Sci. Comput..

[20]  Vito Pirrelli,et al.  Automatic Classification and Analysis of Provisions in Italian Legal Texts: A Case Study , 2004, OTM Workshops.

[21]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[22]  Brian M. Gaff,et al.  Do I Need A Lawyer? If You Have to Ask, You Probably Do , 2012, Computer.

[23]  Keith Kirkpatrick.  Legal advice on the smartphone , 2016, Commun. ACM.

[24]  Alejandro López-Ortiz,et al.  On the Advice Complexity of the k-server Problem Under Sparse Metrics , 2013, Theory of Computing Systems.

[25]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[26]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[27]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[28]  Imran Sarwar Bajwa,et al.  A Semi Supervised Approach for Catchphrase Classification in Legal Text Documents , 2017, J. Comput..

[29]  Trevor Darrell,et al.  Long-term recurrent convolutional networks for visual recognition and description , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Huachun Tan,et al.  Robust tensor decomposition based on Cauchy distribution and its applications , 2017, Neurocomputing.