Graphical Retrieval and Analysis of Temporal Information Systems (GRATIS): An Integrative Mixed Methodology and Open-Access Software to Analyze the (Non-)Linear Chronological Evolution of Information Embedded in Textual/Qualitative Data

Like a video that reveals much more than a single photo, the incorporation of time to the analysis of qualitative evidence promotes contextualized understandings and allows research participants and readers to interactively review the processes and rationale that researchers followed to craft their findings and conclusions. However, mixed methods and qualitative methodologies available today forfeit the nuances gained by analyzing the chronological/temporal evolution of processes. We contribute to mixed methods research by introducing graphical retrieval and analysis of temporal information systems (GRATIS), a methodology (and open-access software) designed to visualize and analyze the time-based richness embedded in all qualitative/textual data. GRATIS employs dynamic network visualizations and data science mining/retrieval tools to combat the assumption that longitudinal studies require large timespans. We showcase how all qualitatively- or machine-learning-coded textual data may be analyzed with no extra feature engineering (i.e., data cleaning or preparation), rendering fully integrative/interactive outputs that strengthen the transparency of our findings and conclusions and open the “analytic black box” that characterizes most of mixed methods and qualitative studies to date. GRATIS contributes to democratizing data science by removing financial and computer programming barriers to benefit from data science applications. All data and software to replicate the analyses are provided with this submission.

[1]  Manuel S. González Canché Latent Code Identification (LACOID): A Machine Learning-Based Integrative Framework [and Open-Source Software] to Classify Big Textual Data, Rebuild Contextualized/Unaltered Meanings, and Avoid Aggregation Bias , 2023, International Journal of Qualitative Methods.

[2]  Manuel S. González Canché Machine Driven Classification of Open-ended Responses (MDCOR): An Analytic Framework and Free Software Application to Classify Longitudinal and Cross-sectional Text Responses in Survey and Social Media Research , 2022, Expert Systems with Applications.

[3]  Manuel S. González Canché Mapping, Organizing, and Visualizing Interdependent Events (MOVIE): A rigorous analytic framework and cost-free software application designed to model temporal and dynamic complex realist structures in social research settings , 2022, Methodological Innovations.

[4]  Manuel S. González Canché Network Analysis of Qualitative Data: An Integrative Software Application to Visualize and Assess Similarities in Participants’ Qualitative Contributions , 2021, Journal of Mixed Methods Research.

[5]  Lorraine R. Buis,et al.  Accelerating Mixed Methods Research With Natural Language Processing of Big Text Data , 2021 .

[6]  M. Brauer,et al.  A Mixed Methods Study of Public Perception of Social Distancing: Integrating Qualitative and Computational Analyses for Text Data , 2021 .

[7]  Alexandra M. Aquilina,et al.  Using Data Mining for Rapid Complex Case Study Descriptions: Example of Public Health Briefings During the Onset of the COVID-19 Pandemic , 2021, Journal of Mixed Methods Research.

[8]  T. Lynam,et al.  Reframing Integration for Mixed Methods Research , 2020, Journal of Mixed Methods Research.

[9]  Eric D. Kolaczyk,et al.  Statistical Analysis of Network Data with R , 2020, Use R!.

[10]  M. G. Canché,et al.  Test-Flexible Admissions Policies and Student Enrollment Demographics: Examining a Public Research University , 2019, The Review of Higher Education.

[11]  Philip Adu,et al.  A Step-by-Step Guide to Qualitative Data Coding , 2019 .

[12]  Dawn Freshwater,et al.  Publishing a Methodological Mixed Methods Research Article , 2015 .

[13]  Dawn Freshwater,et al.  The 1 + 1 = 3 Integration Challenge , 2015 .

[14]  R. Guimerà,et al.  Complex Systems View of Educational Policy Research , 2010, Science.

[15]  Stefano Spaccapietra,et al.  Evolving objects in temporal information systems , 2007, Annals of Mathematics and Artificial Intelligence.

[16]  Melanie Mitchell,et al.  Complex systems: Network thinking , 2006, Artif. Intell..

[17]  T. Green,et al.  Cognitive dimensions: Achievements, new directions, and open questions , 2006, J. Vis. Lang. Comput..

[18]  Stephen P. Borgatti,et al.  Identifying sets of key players in a social network , 2006, Comput. Math. Organ. Theory.

[19]  Mark Steyvers,et al.  Finding scientific topics , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[20]  Pericles Loucopoulos,et al.  A conceptual modelling formalism for temporal database applications , 1991, Inf. Syst..

[21]  Martin J. Eppler,et al.  Visual Replay Methodology: A Mixed Methods Approach for Group Discussion Analysis , 2019 .

[22]  L. Freeman Centrality in social networks conceptual clarification , 1978 .

[23]  V. Braun,et al.  Please Scroll down for Article Qualitative Research in Psychology Using Thematic Analysis in Psychology , 2022 .