Nonet at SemEval-2023 Task 6: Methodologies for Legal Evaluation

This paper describes our submission to the SemEval-2023 for Task 6 on LegalEval: Understanding Legal Texts. Our submission concentrated on three subtasks: Legal Named Entity Recognition (L-NER) for Task-B, Legal Judgment Prediction (LJP) for Task-C1, and Court Judgment Prediction with Explanation (CJPE) for Task-C2. We conducted various experiments on these subtasks and presented the results in detail, including data statistics and methodology. It is worth noting that legal tasks, such as those tackled in this research, have been gaining importance due to the increasing need to automate legal analysis and support. Our team obtained competitive rankings of 15th, 11th, and 1st in Task-B, Task-C1, and Task-C2, respectively, as reported on the leaderboard.

[1]  S. Karn,et al.  SemEval-2023 Task 6: LegalEval - Understanding Legal Texts , 2023, SEMEVAL.

[2]  S. Karn,et al.  Named Entity Recognition in Indian court judgments , 2022, NLLP.

[3]  Avishek Anand,et al.  Explainable Information Retrieval: A Survey , 2022, ArXiv.

[4]  P. Kumaraguru,et al.  HLDC: Hindi Legal Documents Corpus , 2022, FINDINGS.

[5]  Sayantan Polley,et al.  Towards Trustworthiness in the Context of Explainable Search , 2021, SIGIR.

[6]  Arnab Bhattacharya,et al.  ILDC for CJPE: Indian Legal Documents Corpus for Court Judgment Prediction and Explanation , 2021, ACL.

[7]  Ali Oskooei,et al.  Named Entity Recognition in the Legal Domain using a Pointer Generator Network , 2020, ArXiv.

[8]  Ion Androutsopoulos,et al.  LEGAL-BERT: “Preparing the Muppets for Court’” , 2020, FINDINGS.

[9]  Kripabandhu Ghosh,et al.  Identification of Rhetorical Roles of Sentences in Indian Legal Judgments , 2019, JURIX.

[10]  Omer Levy,et al.  RoBERTa: A Robustly Optimized BERT Pretraining Approach , 2019, ArXiv.

[11]  Yiming Yang,et al.  XLNet: Generalized Autoregressive Pretraining for Language Understanding , 2019, NeurIPS.

[12]  Ion Androutsopoulos,et al.  Neural Legal Judgment Prediction in English , 2019, ACL.

[13]  Zhiyuan Liu,et al.  CAIL2018: A Large-Scale Legal Dataset for Judgment Prediction , 2018, ArXiv.

[14]  Scott Lundberg,et al.  A Unified Approach to Interpreting Model Predictions , 2017, NIPS.

[15]  Ankur Taly,et al.  Axiomatic Attribution for Deep Networks , 2017, ICML.

[16]  Ruihong Huang,et al.  CaseSummarizer: A System for Automated Summarization of Legal Texts , 2016, COLING.

[17]  Carlos Guestrin,et al.  "Why Should I Trust You?": Explaining the Predictions of Any Classifier , 2016, ArXiv.

[18]  P. Langlais,et al.  Conditional Abstractive Summarization of Court Decisions for Laymen and Insights from Human Evaluation , 2022, JURIX.

[19]  Pawan Goyal,et al.  Pre-training Transformers on Indian Legal Text , 2022, ArXiv.

[20]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.