Modeling Transfer Learning in Human Categorization with the Hierarchical Dirichlet Process

Transfer learning can be described as the distillation of abstract knowledge from one learning domain or task and the reuse of that knowledge in a related domain or task. In categorization settings, transfer learning is the modification by past experience of prior expectations about what types of categories are likely to exist in the world. While transfer learning is an important and active research topic in machine learning, there have been few studies of transfer learning in human categorization. We propose an explanation for transfer learning effects in human categorization, implementing a model from the statistical machine learning literature – the hierarchical Dirichlet process (HDP) – to make empirical evaluations of its ability to explain these effects. We present two laboratory experiments which measure the degree to which people engage in transfer learning in a controlled setting, and we compare our model to their performance. We find that the HDP provides a good explanation for transfer learning exhibited by human learners.

[1]  R. Nosofsky Attention, similarity, and the identification-categorization relationship. , 1986, Journal of experimental psychology. General.

[2]  F. Ashby,et al.  Categorization as probability density estimation , 1995 .

[3]  C A Nelson,et al.  Learning to Learn , 2017, Encyclopedia of Machine Learning and Data Mining.

[4]  Adam N. Sanborn,et al.  Categorization as nonparametric Bayesian density estimation , 2008 .

[5]  Bart Ons,et al.  A varying abstraction model for categorization , 2005 .

[6]  Yasuaki Sakamoto,et al.  Schematic influences on category learning and recognition memory. , 2004, Journal of experimental psychology. General.

[7]  D. Medin,et al.  SUSTAIN: a network model of category learning. , 2004, Psychological review.

[8]  Ann L. Brown,et al.  Preschool children can learn to transfer: Learning to learn and learning from example , 1988, Cognitive Psychology.

[9]  J. Tenenbaum,et al.  Learning to learn categories , 2009 .

[10]  John R. Anderson The Adaptive Character of Thought , 1990 .

[11]  École d'été de probabilités de Saint-Flour,et al.  École d'été de probabilités de Saint-Flour XIII - 1983 , 1985 .

[12]  Adam N. Sanborn,et al.  Uncovering mental representations with Markov chain Monte Carlo , 2010, Cognitive Psychology.

[13]  Adam N. Sanborn,et al.  Unifying rational models of categorization via the hierarchical Dirichlet process , 2019 .

[14]  John R. Anderson,et al.  The Adaptive Nature of Human Categorization , 1991 .

[15]  Stephen K. Reed,et al.  Pattern recognition and categorization , 1972 .

[16]  Michael I. Jordan,et al.  Hierarchical Dirichlet Processes , 2006 .

[17]  J. Pitman Combinatorial Stochastic Processes , 2006 .

[18]  D. Aldous Exchangeability and related topics , 1985 .

[19]  J. Kruschke,et al.  ALCOVE: an exemplar-based connectionist model of category learning. , 1992, Psychological review.

[20]  Y. Rosseel Mixture models of categorization , 2002 .

[21]  Jonathan Baxter,et al.  A Bayesian/Information Theoretic Model of Learning to Learn via Multiple Task Sampling , 1997, Machine Learning.

[22]  Douglas L. Medin,et al.  Context theory of classification learning. , 1978 .