Using Bayesian Nonparametric Hidden Semi-Markov Models to Disentangle Affect Processes during Marital Interaction

Sequential affect dynamics generated during the interaction of intimate dyads, such as married couples, are associated with a cascade of effects—some good and some bad—on each partner, close family members, and other social contacts. Although the effects are well documented, the probabilistic structures associated with micro-social processes connected to the varied outcomes remain enigmatic. Using extant data we developed a method of classifying and subsequently generating couple dynamics using a Hierarchical Dirichlet Process Hidden semi-Markov Model (HDP-HSMM). Our findings indicate that several key aspects of existing models of marital interaction are inadequate: affect state emissions and their durations, along with the expected variability differences between distressed and nondistressed couples are present but highly nuanced; and most surprisingly, heterogeneity among highly satisfied couples necessitate that they be divided into subgroups. We review how this unsupervised learning technique generates plausible dyadic sequences that are sensitive to relationship quality and provide a natural mechanism for computational models of behavioral and affective micro-social processes.

[1]  Michael I. Jordan,et al.  An HDP-HMM for systems with state persistence , 2008, ICML '08.

[2]  J. H. Ward Hierarchical Grouping to Optimize an Objective Function , 1963 .

[3]  S. Venkatasubramanian,et al.  An Information-Theoretic Approach to Detecting Changes in Multi-Dimensional Data Streams , 2006 .

[4]  H. Locke,et al.  SHORT MARITAL ADJUSTMENT AND PREDICTION TESTS: THEIR RELIABILITY AND VALIDITY , 1959 .

[5]  Ath. Kehagias,et al.  A hidden Markov model segmentation procedure for hydrological and environmental time series , 2004 .

[6]  John D. Lafferty,et al.  Dynamic topic models , 2006, ICML.

[7]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[8]  Meinard Müller,et al.  Information retrieval for music and motion , 2007 .

[9]  J. Sethuraman A CONSTRUCTIVE DEFINITION OF DIRICHLET PRIORS , 1991 .

[10]  Michael I. Jordan,et al.  Hierarchical Bayesian Nonparametric Models with Applications , 2008 .

[11]  Cees H. Elzinga,et al.  Distance, Similarity and Sequence Comparison , 2014 .

[12]  J. Larson,et al.  Assessing Marital Quality with Distressed and Nondistressed Couples : A Comparison and Equivalency Table for Three Frequently Used Measures , 2005 .

[13]  T. Ferguson A Bayesian Analysis of Some Nonparametric Problems , 1973 .

[14]  Toni Giorgino,et al.  Computing and Visualizing Dynamic Time Warping Alignments in R: The dtw Package , 2009 .

[15]  H. Jeffreys An invariant form for the prior probability in estimation problems , 1946, Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences.

[16]  Korbinian Strimmer,et al.  Entropy Inference and the James-Stein Estimator, with Application to Nonlinear Gene Association Networks , 2008, J. Mach. Learn. Res..

[17]  Byung-Jun Yoon,et al.  Hidden Markov Models and their Applications in Biological Sequence Analysis , 2009, Current genomics.

[18]  J. Hosking L‐Moments: Analysis and Estimation of Distributions Using Linear Combinations of Order Statistics , 1990 .

[19]  Yee Whye Teh,et al.  Bayesian Nonparametric Models , 2010, Encyclopedia of Machine Learning.

[20]  J. Kiecolt-Glaser,et al.  Marriage and health: his and hers. , 2001, Psychological bulletin.

[21]  D. Dunson Bayesian dynamic modeling of latent trait distributions. , 2006, Biostatistics.

[22]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[23]  Matthew J. Johnson,et al.  Bayesian nonparametric hidden semi-Markov models , 2012, J. Mach. Learn. Res..

[24]  Michael I. Jordan,et al.  Hierarchical Dirichlet Processes , 2006 .

[25]  David B. Dunson,et al.  The dynamic hierarchical Dirichlet process , 2008, ICML '08.

[26]  J. Gottman Marital Interaction: Experimental Investigations , 1980 .

[27]  J. Gottman,et al.  A valid procedure for obtaining self-report of affect in marital interaction. , 1985, Journal of consulting and clinical psychology.

[28]  Yee Whye Teh,et al.  Infinite Hierarchical Hidden Markov Models , 2009, AISTATS.

[29]  Y. Guédon Estimating Hidden Semi-Markov Chains From Discrete Sequences , 2003 .

[30]  Etienne B. Roesch,et al.  A Blueprint for Affective Computing: A Sourcebook and Manual , 2010 .

[31]  Rafael A. Calvo,et al.  Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications , 2010, IEEE Transactions on Affective Computing.

[32]  Gilbert Ritschard,et al.  Discrepancy Analysis of State Sequences , 2011 .

[33]  Daniel McDuff,et al.  Exploring Temporal Patterns in Classifying Frustrated and Delighted Smiles , 2012, IEEE Trans. Affect. Comput..

[34]  G. Dagne,et al.  Bayesian hierarchical duration model for repeated events: an application to behavioral observations , 2009, Journal of applied statistics.

[35]  Jianhua Lin,et al.  Divergence measures based on the Shannon entropy , 1991, IEEE Trans. Inf. Theory.

[36]  John M. Gottman,et al.  Sequential Analysis: The timetable and the contextual design , 1990 .

[37]  G. Dagne,et al.  Multilevel methods for modeling observed sequences of family interaction. , 2005, Journal of family psychology : JFP : journal of the Division of Family Psychology of the American Psychological Association.

[38]  Jean-Marc Odobez,et al.  Extracting and locating temporal motifs in video scenes using a hierarchical non parametric Bayesian model , 2011, CVPR 2011.

[39]  Justin A. Lavner,et al.  How can we improve preventive and educational interventions for intimate relationships? , 2012, Behavior therapy.

[40]  Stephanie L. Dickinson,et al.  Hostile marital interactions, proinflammatory cytokine production, and wound healing. , 2005, Archives of general psychiatry.

[41]  L. L'Abate,et al.  Sourcebook Of Marriage And Family Evaluation , 1993 .

[42]  Raphail E. Krichevsky,et al.  The performance of universal encoding , 1981, IEEE Trans. Inf. Theory.

[43]  John K Kruschke,et al.  Bayesian data analysis. , 2010, Wiley interdisciplinary reviews. Cognitive science.

[44]  R. Heyman,et al.  Observation of couple conflicts: clinical assessment applications, stubborn truths, and shaky foundations. , 2001, Psychological assessment.

[45]  Shunzheng Yu,et al.  Hidden semi-Markov models , 2010, Artif. Intell..

[46]  J. Kiecolt-Glaser,et al.  Relationships and Inflammation across the Lifespan: Social Developmental Pathways to Disease. , 2011, Social and personality psychology compass.

[47]  Samuel J. Gershman,et al.  A Tutorial on Bayesian Nonparametric Models , 2011, 1106.2697.

[48]  Carl E. Rasmussen,et al.  Factorial Hidden Markov Models , 1997 .

[49]  D. Bagarozzi Family measurement techniques: Locke marital adjustment scale and the dyadic adjustment scale , 1985 .

[50]  J. Kruschke Bayesian estimation supersedes the t test. , 2013, Journal of experimental psychology. General.

[51]  John M. Gottman,et al.  Sequential Analysis: Frontmatter , 1990 .

[52]  W. Griffin Transitions from negative affect during marital interaction: Husband and wife differences. , 1993 .

[53]  Rajeev K. Azad,et al.  Generalization of Entropy Based Divergence Measures for Symbolic Sequence Analysis , 2014, PloS one.

[54]  W. Griffin Affect Pattern Recognition , 2002 .

[55]  Laura Ferreira,et al.  A Comparison of Hierarchical Methods for Clustering Functional Data , 2009, Commun. Stat. Simul. Comput..

[56]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[57]  John M. Gottman,et al.  The mathematics of marital conflict : Dynamic mathematical nonlinear modeling of newlywed marital interaction , 1999 .

[58]  Laurent Lesnard,et al.  Setting Cost in Optimal Matching to Uncover Contemporaneous Socio-Temporal Patterns , 2010 .

[59]  Michael I. Jordan,et al.  Bayesian Nonparametrics: Hierarchical Bayesian nonparametric models with applications , 2010 .