Development and Validation of a Functional Behavioural Assessment Ontology to Support Behavioural Health Interventions

Background In the cognitive-behavioral approach, Functional Behavioural Assessment is one of the most effective methods to identify the variables that determine a problem behavior. In this context, the use of modern technologies can encourage the collection and sharing of behavioral patterns, effective intervention strategies, and statistical evidence about antecedents and consequences of clusters of problem behaviors, encouraging the designing of function-based interventions. Objective The paper describes the development and validation process used to design a specific Functional Behavioural Assessment Ontology (FBA-Ontology). The FBA-Ontology is a semantic representation of the variables that intervene in a behavioral observation process, facilitating the systematic collection of behavioral data, the consequential planning of treatment strategies and, indirectly, the scientific advancement in this field of study. Methods The ontology has been developed deducing concepts and relationships of the ontology from a gold standard and then performing a machine-based validation and a human-based assessment to validate the Functional Behavioural Assessment Ontology. These validation and verification processes were aimed to verify how much the ontology is conceptually well founded and semantically and syntactically correct. Results The Pellet reasoner checked the logical consistency and the integrity of classes and properties defined in the ontology, not detecting any violation of constraints in the ontology definition. To assess whether the ontology definition is coherent with the knowledge domain, human evaluation of the ontology was performed asking 84 people to fill in a questionnaire composed by 13 questions assessing concepts, relations between concepts, and concepts’ attributes. The response rate for the survey was 29/84 (34.52%). The domain experts confirmed that the concepts, the attributes, and the relationships between concepts defined in the FBA-Ontology are valid and well represent the Functional Behavioural Assessment process. Conclusions The new ontology developed could be a useful tool to design new evidence-based systems in the Behavioral Interventions practices, encouraging the link with other Linked Open Data datasets and repositories to provide users with new models of eHealth focused on the management of problem behaviors. Therefore, new research is needed to develop and implement innovative strategies to improve the poor reproducibility and translatability of basic research findings in the field of behavioral assessment.

[1]  Mike Uschold,et al.  Building Ontologies: Towards a Unified Methodology , 1996 .

[2]  Asunción Gómez-Pérez,et al.  Evaluation of ontologies , 2001, International Journal of Intelligent Systems.

[3]  Rachel Hershenberg,et al.  An opportunity to bridge the gap between clinical research and clinical practice: implications for clinical training. , 2012, Psychotherapy.

[4]  Johanna Völker,et al.  Knowledge Engineering and Knowledge Management , 2012, Lecture Notes in Computer Science.

[5]  Jesse Dallery,et al.  Optimizing behavioral health interventions with single-case designs: from development to dissemination , 2014, Translational behavioral medicine.

[6]  Marta Sabou,et al.  Ontology (Network) Evaluation , 2012, Ontology Engineering in a Networked World.

[7]  Hyun-Young Kim,et al.  Development of an Obesity Management Ontology Based on the Nursing Process for the Mobile-Device Domain , 2013, Journal of medical Internet research.

[8]  Yarden Katz,et al.  Pellet: A practical OWL-DL reasoner , 2007, J. Web Semant..

[9]  Frank M. Gresham,et al.  Functional Behavioral Assessment: Principles, Procedures, and Future Directions , 2001 .

[10]  W. Pelham,et al.  Empirically supported psychosocial treatments for attention deficit hyperactivity disorder. , 1998, Journal of clinical child psychology.

[11]  Pascal Hitzler,et al.  String Similarity Metrics for Ontology Alignment , 2013, SEMWEB.

[12]  Grant Jones,et al.  Structuration, Integrity And The Ethical Discourse In Organisations , 2011 .

[13]  Rachel L. Richesson,et al.  Introduction to Clinical Research Informatics , 2019, Health Informatics.

[14]  Andrea Chronis-Tuscano,et al.  A meta-analysis of behavioral treatments for attention-deficit/hyperactivity disorder. , 2009, Clinical psychology review.

[15]  Nuria Casellas.  Ontology Evaluation through Usability Measures , 2009, OTM Workshops.

[16]  B. Skinner.  Operant Behavior , 2021, Encyclopedia of Evolutionary Psychological Science.

[17]  Violeta Vidacek-Hains,et al.  Use Of Ontologies In Monitoring Mental Retardation Rehabilitation Process , 2010 .

[18]  Rui Jiang,et al.  From Ontology to Semantic Similarity: Calculation of Ontology-Based Semantic Similarity , 2013, TheScientificWorldJournal.

[19]  George A. Vouros,et al.  Gold Standard Evaluation of Ontology Learning Methods through Ontology Transformation and Alignment , 2011, IEEE Transactions on Knowledge and Data Engineering.

[20]  Vijayan Sugumaran,et al.  A semiotic metrics suite for assessing the quality of ontologies , 2005, Data Knowl. Eng..

[21]  Aldo Gangemi,et al.  Pattern-Based Ontology Design , 2012, Ontology Engineering in a Networked World.

[22]  L Eugene Arnold,et al.  Psychopharmacological and other treatments in preschool children with attention-deficit/hyperactivity disorder: current evidence and practice. , 2008, Journal of child and adolescent psychopharmacology.

[23]  Michael Gruninger,et al.  Methodology for the Design and Evaluation of Ontologies , 1995, IJCAI 1995.

[24]  Davide Taibi,et al.  An ontology to support evidence-based Functional Behavioral Assessments , 2015 .

[25]  Mark A. Musen,et al.  Modern architectures for intelligent systems: reusable ontologies and problem-solving methods , 1998, AMIA.

[26]  Jérôme Euzenat,et al.  Ontology Matching: State of the Art and Future Challenges , 2013, IEEE Transactions on Knowledge and Data Engineering.

[27]  Robert Stevens,et al.  Evaluating the Emotion Ontology through use in the self-reporting of emotional responses at an academic conference , 2014, Journal of Biomedical Semantics.

[28]  Terrance M. Scott,et al.  Examining the case for functional behavior assessment as an evidence-based practice for students with emotional and behavioral disorders in general education classrooms , 2017 .

[29]  Brian A. Nosek,et al.  Promoting an open research culture , 2015, Science.

[30]  D. Sackett,et al.  Evidence based medicine: what it is and what it isn't , 1996, BMJ.

[31]  Steffen Staab,et al.  Measuring Similarity between Ontologies , 2002, EKAW.

[32]  Susan Michie,et al.  Behavior change interventions: the potential of ontologies for advancing science and practice , 2017, Journal of Behavioral Medicine.

[33]  R. Porzel,et al.  A Task-based Approach for Ontology Evaluation , 2022 .

[34]  B. Iwata,et al.  TOWARD A FUNCTIONAL ANALYSIS OF SELF‐INJURY , 1994 .

[35]  Yorick Wilks,et al.  Data Driven Ontology Evaluation , 2004, LREC.

[36]  Gregory P Hanley,et al.  Functional Assessment of Problem Behavior: Dispelling Myths, Overcoming Implementation Obstacles, and Developing New Lore , 2012, Behavior analysis in practice.

[37]  Alexa T. McCray,et al.  Modeling the Autism Spectrum Disorder Phenotype , 2013, Neuroinformatics.

[38]  Pascale Gaudet,et al.  The Gene Ontology , 2019, Encyclopedia of Bioinformatics and Computational Biology.

[39]  Werner Ceusters,et al.  Representing Mental Functioning: Ontologies for Mental Health and Disease , 2012 .

[40]  Martin L. King,et al.  Towards a Methodology for Building Ontologies , 1995 .

[41]  Marko Grobelnik,et al.  A SURVEY OF ONTOLOGY EVALUATION TECHNIQUES , 2005 .

[42]  Anil Chacko,et al.  Nonpharmacological Interventions for Preschool ADHD: State of the Evidence and Implications for Practice , 2012 .

[43]  Karen A. Harper,et al.  Towards a Common Ontology for Improved Traceability of Human Behavior Models , 2004 .

[44]  Fumiaki Toyoshima,et al.  Towards an Ontology of Schizophrenia , 2016, ICBO/BioCreative.

[45]  Maria Lundin,et al.  Sequence complementarity of U2 snRNA and U2A' intron predicts intron function , 2005, Genome Biology.

[46]  Enrico Motta,et al.  What Makes a Good Ontology? A Case-Study in Fine-Grained Knowledge Reuse , 2009, ASWC.

[47]  Asunción Gómez-Pérez,et al.  Knowledge Engineering and Knowledge Management: Ontologies and the Semantic Web , 2002, Lecture Notes in Computer Science.

[48]  Alan E Kazdin,et al.  Evidence-based treatment and practice: new opportunities to bridge clinical research and practice, enhance the knowledge base, and improve patient care. , 2008, The American psychologist.

[49]  Asunción Gómez-Pérez,et al.  Overview and analysis of methodologies for building ontologies , 2002, The Knowledge Engineering Review.

[50]  Asunción Gómez-Pérez,et al.  ONTOMETRIC: A Method to Choose the Appropriate Ontology , 2004, J. Database Manag..

[51]  Panagiotis Bamidis,et al.  WHAAM: A mobile application for ubiquitous monitoring of ADHD behaviors , 2014, 2014 International Conference on Interactive Mobile Communication Technologies and Learning (IMCL2014).

[52]  Katie Wolfe,et al.  The Evidence-Based Practice of Applied Behavior Analysis , 2014, The Behavior Analyst.

[53]  Chunhua Weng,et al.  Combining expert knowledge and knowledge automatically acquired from electronic data sources for continued ontology evaluation and improvement , 2015, J. Biomed. Informatics.

[54]  K. Bretonnel Cohen,et al.  BioHackathon series in 2011 and 2012: penetration of ontology and linked data in life science domains , 2014, Journal of Biomedical Semantics.

[55]  William E. Pelham,et al.  Evidence-Based Psychosocial Treatments for Attention-Deficit/Hyperactivity Disorder , 2008, Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53.

[56]  R. Horner,et al.  Functional assessment: Contributions and future directions. , 1994, Journal of applied behavior analysis.

[57]  A. Rector,et al.  Relations in biomedical ontologies , 2005, Genome Biology.

[58]  Frederico Luiz Gonçalves de Freitas,et al.  Evaluating Ontologies with Competency Questions , 2013, 2013 IEEE/WIC/ACM International Joint Conferences on Web Intelligence (WI) and Intelligent Agent Technologies (IAT).

[59]  Johnny L. Matson,et al.  Interview and Observation Methods in Functional Assessment , 2012 .

[60]  Asunción Gómez-Pérez,et al.  Validating Ontologies with OOPS! , 2012, EKAW.

[61]  Maria Adler,et al.  Science and human behavior , 2017 .

[62]  Takako Takai,et al.  Development of clinical ontology for mood disorder with combination of psychomedical information. , 2009, Journal of medical and dental sciences.

[63]  J. Euzenat,et al.  Ontology Matching , 2007, Springer Berlin Heidelberg.

[64]  Tharam S. Dillon,et al.  Towards the Mental Health Ontology , 2008, 2008 IEEE International Conference on Bioinformatics and Biomedicine.