Applied Data Science in Financial Industry - Natural Language Processing Techniques for Bank Policies

In a time when the employment of Natural Language Processing techniques in domains such as biomedicine, national security, finance and law, is flourishing, this study takes a deep look in its application in policy documents. Besides providing an overview of the current state of the literature that treats these concepts, the study at hand implements a set of unprecedented Natural Language Processing techniques on internal bank policies. The implementation of these techniques, together with the results that derive from the experiment and the experts’ evaluation, introduce a Meta-Algorithmic Modelling framework for processing internal business policies. This framework relies on three Natural Language Processing techniques, namely information extraction, automatic summarization and automatic keyword extraction. For the reference extraction and keyword extraction tasks we calculated Precision, Recall and F-scores. For the former we obtained 0.99, 0.84, and 0.89; for the latter we obtained 0.79, 0.87 and 0.83, respectively. Finally, our summary extraction approach was positively evaluated using a qualitative assessment.

[1]  Claes Wohlin,et al.  Guidelines for snowballing in systematic literature studies and a replication in software engineering , 2014, EASE '14.

[2]  Marco R. Spruit,et al.  Measuring Syntactic Variation in Dutch Dialects , 2006, Lit. Linguistic Comput..

[3]  Miltiadis D. Lytras,et al.  Applied data science in patient-centric healthcare: Adaptive analytic systems for empowering physicians and patients , 2018, Telematics Informatics.

[4]  David M. W. Powers,et al.  Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation , 2011, ArXiv.

[5]  Annie I. Antón,et al.  Financial privacy policies and the need for standardization , 2004, IEEE Security & Privacy Magazine.

[6]  Annie I. Antón,et al.  A requirements taxonomy for reducing Web site privacy vulnerabilities , 2004, Requirements Engineering.

[7]  M F Sanner,et al.  Python: a programming language for software integration and development. , 1999, Journal of molecular graphics & modelling.

[8]  Beatrice Santorini,et al.  Building a Large Annotated Corpus of English: The Penn Treebank , 1993, CL.

[9]  Feifan Liu,et al.  Unsupervised Approaches for Automatic Keyword Extraction Using Meeting Transcripts , 2009, NAACL.

[10]  Inge van de Weerd,et al.  Meta-Modeling for Situational Analysis and Design Methods , 2009 .

[11]  Anette Hulth,et al.  A Study on Automatically Extracted Keywords in Text Categorization , 2006, ACL.

[12]  Rada Mihalcea,et al.  TextRank: Bringing Order into Text , 2004, EMNLP.

[13]  Alan R. Hevner,et al.  Design Science in Information Systems Research , 2004, MIS Q..

[14]  George Hripcsak,et al.  Technical Brief: Agreement, the F-Measure, and Reliability in Information Retrieval , 2005, J. Am. Medical Informatics Assoc..

[15]  Nick Cramer,et al.  Automatic Keyword Extraction from Individual Documents , 2010 .

[16]  J Starren,et al.  Architectural requirements for a multipurpose natural language processor in the clinical environment. , 1995, Proceedings. Symposium on Computer Applications in Medical Care.

[17]  Chengzhi Zhang,et al.  Automatic Keyword Extraction from Documents Using Conditional Random Fields , 2008 .

[18]  Richard C. Wilson,et al.  Levenshtein distance for graph spectral features , 2004, ICPR 2004.

[19]  Catherine Blake,et al.  Text mining , 2011, Annu. Rev. Inf. Sci. Technol..

[20]  Vladimir I. Levenshtein,et al.  Binary codes capable of correcting deletions, insertions, and reversals , 1965 .

[21]  Sjaak Brinkkemper,et al.  Method engineering: engineering of information systems development methods and tools , 1996, Inf. Softw. Technol..

[22]  Kai Yang,et al.  Improved Automatic Keyword Extraction Given More Semantic Knowledge , 2016, DASFAA Workshops.

[23]  Ingrid Renz,et al.  Keyword Extraction for Text Characterization , 2003, NLDB.

[24]  Weiguo Fan,et al.  Tapping the power of text mining , 2006, CACM.

[25]  Marco R. Spruit,et al.  Power to the People! - Meta-Algorithmic Modelling in Applied Data Science , 2016, KDIR.

[26]  P. Haug,et al.  Computerized extraction of coded findings from free-text radiologic reports. Work in progress. , 1990, Radiology.

[27]  Ralph Weischedel,et al.  PERFORMANCE MEASURES FOR INFORMATION EXTRACTION , 2007 .

[28]  David Bholat,et al.  Text Mining for Central Banks , 2015 .