Modeling Intensive Polytomous Time-Series Eye-Tracking Data: A Dynamic Tree-Based Item Response Model

This paper presents a dynamic tree-based item response (IRTree) model as a novel extension of the autoregressive generalized linear mixed effect model (dynamic GLMM). We illustrate the unique utility of the dynamic IRTree model in its capability of modeling differentiated processes indicated by intensive polytomous time-series eye-tracking data. The dynamic IRTree was inspired by but is distinct from the dynamic GLMM which was previously presented by Cho, Brown-Schmidt, and Lee (Psychometrika 83(3):751–771, 2018). Unlike the dynamic IRTree, the dynamic GLMM is suitable for modeling intensive binary time-series eye-tracking data to identify visual attention to a single interest area over all other possible fixation locations. The dynamic IRTree model is a general modeling framework which can be used to model change processes (trend and autocorrelation) and which allows for decomposing data into various sources of heterogeneity. The dynamic IRTree model was illustrated using an experimental study that employed the visual-world eye-tracking technique. The results of a simulation study showed that parameter recovery of the model was satisfactory and that ignoring trend and autoregressive effects resulted in biased estimates of experimental condition effects in the same conditions found in the empirical study.

[1]  Julie C. Sedivy,et al.  Evidence of Perspective-Taking Constraints in Children's On-Line Reference Resolution , 2002, Psychological science.

[2]  N. Merali,et al.  Eye-Tracking Technology in Surgical Training , 2019, Journal of investigative surgery : the official journal of the Academy of Surgical Research.

[3]  Paul De Boeck,et al.  IRTrees: Tree-Based Item Response Models of the GLMM Family , 2012 .

[4]  B. Muthén,et al.  The multilevel latent covariate model: a new, more reliable approach to group-level effects in contextual studies. , 2008, Psychological methods.

[5]  Joyce Yue Chai,et al.  An Exploration of Eye Gaze in Spoken Language Processing for Multimodal Conversational Interfaces , 2007, HLT-NAACL.

[6]  David M. Riefer,et al.  Theoretical and empirical review of multinomial process tree modeling , 1999, Psychonomic bulletin & review.

[7]  P. Kuppens,et al.  Getting stuck in depression: The roles of rumination and emotional inertia , 2012, Cognition & emotion.

[8]  Julie C. Sedivy,et al.  Implicature During Real Time Conversation: A View from Language Processing Research , 2007 .

[9]  P. Kuppens,et al.  Emotional Inertia and Psychological Maladjustment , 2010, Psychological science.

[10]  Minjeong Jeon,et al.  A generalized item response tree model for psychological assessments , 2016, Behavior research methods.

[11]  Sarah Brown-Schmidt,et al.  How Do I Remember That I Know You Know That I Know? , 2011, Psychological science.

[12]  E. Wagenmakers,et al.  Bayesian Estimation of Multinomial Processing Tree Models with Heterogeneity in Participants and Items , 2013, Psychometrika.

[13]  L. Fahrmeir.  Posterior Mode Estimation by Extended Kalman Filtering for Multivariate Dynamic Generalized Linear Models , 1992 .

[14]  Ellen L. Hamaker,et al.  UvA-DARE ( Digital Academic Repository ) To center or not to center ? Investigating inertia with a multilevel autoregressive model , 2014 .

[15]  Peter F. Craigmile,et al.  Detrending Response Time Series , 2010 .

[16]  D. Gamerman.  Markov chain Monte Carlo for dynamic generalised linear models , 1998 .

[17]  D. Barr,et al.  Random effects structure for confirmatory hypothesis testing: Keep it maximal. , 2013, Journal of memory and language.

[18]  S. Brown-Schmidt,et al.  The role of executive function in perspective taking during online language comprehension , 2009, Psychonomic bulletin & review.

[19]  D. Rubin.  INFERENCE AND MISSING DATA , 1975 .

[20]  Radford M. Neal.  MCMC Using Hamiltonian Dynamics , 2011, 1206.1901.

[21]  Kenneth A. Bollen,et al.  The best of both worlds: Combining autoregressive and latent curve models. , 2001 .

[22]  Grant M. Walker,et al.  A Cognitive Psychometric Model for Assessment of Picture Naming Abilities in Aphasia , 2018, Psychological assessment.

[23]  Taehun Lee,et al.  Disaggregating within-person and between-person effects in multilevel and structural equation growth models. , 2012 .

[24]  T. Jaeger,et al.  Categorical Data Analysis: Away from ANOVAs (transformation or not) and towards Logit Mixed Models. , 2008, Journal of memory and language.

[25]  David R. Anderson,et al.  Model selection and multimodel inference : a practical information-theoretic approach , 2003 .

[26]  Sung Hee Lee,et al.  Individual differences in online spoken word recognition: Implications for SLI , 2010, Cognitive Psychology.

[27]  David M. Riefer,et al.  Multinomial Modeling and the Measurement of Cognitive Processes. , 1988 .

[28]  Francesco Bartolucci,et al.  A Dynamic Model for Binary Panel Data With Unobserved Heterogeneity Admitting a √n‐Consistent Conditional Estimator , 2007 .

[29]  G. Tutz.  Sequential item response models with an ordered response , 1990 .

[30]  H. Bergh,et al.  Examples of Mixed-Effects Modeling with Crossed Random Effects and with Binomial Data. , 2008 .

[31]  Chris Chatfield,et al.  The Analysis of Time Series: An Introduction , 1981 .

[32]  R. Baayen,et al.  Mixed-effects modeling with crossed random effects for subjects and items , 2008 .

[33]  Jiqiang Guo,et al.  Stan: A Probabilistic Programming Language. , 2017, Journal of statistical software.

[34]  A Note on N in Bayesian Information Criterion for Item Response Models , 2018, Applied psychological measurement.

[35]  K. C. Klauer,et al.  Hierarchical Multinomial Processing Tree Models: A Latent-Trait Approach , 2006 .

[36]  Peter C. M. Molenaar,et al.  A dynamic factor model for the analysis of multivariate time series , 1985 .

[37]  M. Tanenhaus,et al.  The effects of common ground and perspective on domains of referential interpretation , 2003 .

[38]  D. Rubin,et al.  Inference from Iterative Simulation Using Multiple Sequences , 1992 .

[39]  William H. Batchelder,et al.  Multinomial processing tree models of factorial categorization , 1997 .

[40]  Sarah Brown-Schmidt,et al.  Addressees distinguish shared from private information when interpreting questions during interactive conversation , 2008, Cognition.

[41]  Ying Hung,et al.  Binary Time Series Modeling With Application to Adhesion Frequency Experiments , 2008, Journal of the American Statistical Association.

[42]  Craig G. Chambers,et al.  Privileged versus shared knowledge about object identity in real-time referential processing , 2015, Cognition.

[43]  Sarah Brown-Schmidt,et al.  Autoregressive Generalized Linear Mixed Effect Models with Crossed Random Effects: An Application to Intensive Binary Time Series Eye-Tracking Data , 2018, Psychometrika.

[44]  Ulf Böckenholt,et al.  Measuring Response Styles in Likert Items , 2017, Psychological methods.

[45]  T. Trull,et al.  Analysis of affective instability in ecological momentary assessment: Indices using successive difference and group comparison via multilevel modeling. , 2008, Psychological methods.

[46]  Julie C. Sedivy,et al.  Subject Terms: Linguistics Language Eyes & eyesight Cognition & reasoning , 1995 .

[47]  Stephen Nickell,et al.  Biases in Dynamic Models with Fixed Effects , 1981 .

[48]  H. H. Clark.  The language-as-fixed-effect fallacy: A critique of language statistics in psychological research. , 1973 .

[49]  Daniel C. Richardson,et al.  Eye Tracking: Characteristics And Methods , 2004 .

[50]  U. Böckenholt.  Modeling multiple response processes in judgment and choice. , 2012, Psychological methods.

[51]  M. Crocker,et al.  Investigating joint attention mechanisms through spoken human–robot interaction , 2011, Cognition.

[52]  J. F. C. Kingman,et al.  The analysis of binary data , 1971 .

[53]  B. McMurray,et al.  A real-time mechanism underlying lexical deficits in developmental language disorder: Between-word inhibition , 2019, Cognition.

[54]  Maryellen C. MacDonald,et al.  How language production shapes language form and comprehension , 2012, Front. Psychol..

[55]  Cheng Hsiao,et al.  Analysis of Panel Data , 1987 .

[56]  Paul D. Allopenna,et al.  Tracking the Time Course of Spoken Word Recognition Using Eye Movements: Evidence for Continuous Mapping Models , 1998 .

[57]  D. Barr.  Pragmatic expectations and linguistic evidence: Listeners anticipate but do not integrate common ground , 2008, Cognition.

[58]  S. Greven,et al.  On the behaviour of marginal and conditional AIC in linear mixed models , 2010 .

[59]  S. Rabe-Hesketh,et al.  An autoregressive growth model for longitudinal item analysis , 2016, Psychometrika.

[60]  Sarah Brown-Schmidt,et al.  Journal of Experimental Psychology : General Perspective-Taking in Comprehension , Production , and Memory : An Individual Differences Approach , 2015 .

[61]  John K Kruschke,et al.  Bayesian data analysis. , 2010, Wiley interdisciplinary reviews. Cognitive science.

[62]  Dave Kleinschmidt,et al.  Immediate effects of anticipatory coarticulation in spoken-word recognition. , 2014, Journal of memory and language.

[63]  Andrew Gelman,et al.  The No-U-turn sampler: adaptively setting path lengths in Hamiltonian Monte Carlo , 2011, J. Mach. Learn. Res..

[64]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[65]  R. Baillargeon,et al.  Early false-belief understanding in traditional non-Western societies , 2013, Proceedings of the Royal Society B: Biological Sciences.

[66]  S. Brown-Schmidt,et al.  Partner-specific interpretation of maintained referential precedents during interactive dialog. , 2009, Journal of memory and language.

[67]  Francis Tuerlinckx,et al.  Changing Dynamics: Time-Varying Autoregressive Models Using Generalized Additive Modeling , 2017, Psychological methods.

[68]  S. Brown-Schmidt,et al.  Beyond common and privileged: Gradient representations of common ground in real-time language use , 2012 .

[69]  M. West,et al.  Dynamic Generalized Linear Models and Bayesian Forecasting , 1985 .

[70]  G. Altmann,et al.  Incremental interpretation at verbs: restricting the domain of subsequent reference , 1999, Cognition.

[71]  S. Embretson,et al.  Item response theory for psychologists , 2000 .

[72]  E. Hamaker,et al.  Investigating inter-individual differences in short-term intra-individual variability. , 2012, Psychological methods.

[73]  D. Barr.  Analyzing ‘visual world’ eyetracking data using multilevel logistic regression , 2008 .

[74]  Linda M. Collins,et al.  New methods for the analysis of change , 2001 .