Using Cognitive Models to Train Big Data Models with Small Data

Modeling and predicting human behavior pose a difficult challenge for AI and other related fields. Some current techniques (e.g., cognitive architectures) are able to model people’s goals and actions from little data, but have poor predictive capabilities. Other methods (e.g., deep networks) have strong predictive capabilities but require large amounts of data to train the model; such abundant empirical data on human performance is not available for many human-based tasks. We show a novel and general method of generating copious synthetic data of human behavior using a cognitive architecture, and then use the data to train a deep network classifier to predict ensuing human actions. We test our approach by predicting human actions on a supervisory control task; the results show that our approach provides superior prediction when compared to training a classifier with only (limited) empirical data.

[1]  J. Gregory Trafton,et al.  Human modeling for human–robot collaboration , 2017, Int. J. Robotics Res..

[2]  Scott D. Brown,et al.  Diffusion Decision Model: Current Issues and History , 2016, Trends in Cognitive Sciences.

[3]  J. Gregory Trafton,et al.  Accommodating Human Variability in Human-Robot Teams through Theory of Mind , 2011, IJCAI.

[4]  Susan Bell Trickett,et al.  "I Don't Know What's Going on There": The Use of Spatial Transformations to Deal With and Resolve Uncertainty in Complex Visualizations , 2007 .

[5]  Glenn Gunzelmann,et al.  Sleep Deprivation and Sustained Attention Performance: Integrating Mathematical and Cognitive Modeling , 2009, Cogn. Sci..

[6]  David E. Meyer,et al.  Demystification of cognitive insight: Opportunistic assimilation and the prepared-mind hypothesis , 1994 .

[7]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[8]  Paul S. Rosenbloom,et al.  The Sigma cognitive architecture and system , 2013 .

[9]  J. Gregory Trafton,et al.  Dynamic Operator Overload: A Model for Predicting Workload During Supervisory Control , 2014, IEEE Transactions on Human-Machine Systems.

[10]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[11]  M. Cummings,et al.  Behavioral Recognition and Prediction of an Operator Supervising Multiple Heterogeneous Unmanned Vehicles , 2008 .

[12]  Patrick J. Grother,et al.  NIST Special Database 19 Handprinted Forms and Characters Database , 1995 .

[13]  J. G. Trafton,et al.  An activation-based model of memory for goals , 2002 .

[14]  J. Gregory Trafton,et al.  ACT-R/E , 2013, HRI 2013.

[15]  Panagiotis G. Ipeirotis,et al.  Running Experiments on Amazon Mechanical Turk , 2010, Judgment and Decision Making.

[16]  Orit Hazzan,et al.  Problem-solving strategies , 1986 .

[17]  Dorothea P. Simon,et al.  Expert and Novice Performance in Solving Physics Problems , 1980, Science.

[18]  Erik Cambria,et al.  Recent Trends in Deep Learning Based Natural Language Processing , 2017, IEEE Comput. Intell. Mag..

[19]  John R Anderson,et al.  An integrated theory of the mind. , 2004, Psychological review.

[20]  Joshua B. Tenenbaum,et al.  Human-level concept learning through probabilistic program induction , 2015, Science.

[21]  David E. Kieras,et al.  The GOMS family of user interface analysis techniques: comparison and contrast , 1996, TCHI.

[22]  Tomohiro Shirakawa,et al.  A machine learning model with human cognitive biases capable of learning from small and biased datasets , 2018, Scientific Reports.

[23]  John R. Anderson How Can the Human Mind Occur in the Physical Universe , 2007 .

[24]  B. Bertenthal Perception and action. , 2012, Attention, perception & psychophysics.

[25]  P. Johnson-Laird,et al.  Theories of the syllogism: A meta-analysis. , 2012, Psychological bulletin.

[26]  John E. Laird,et al.  The Soar Cognitive Architecture , 2012 .

[27]  Sung Wook Baik,et al.  Action Recognition in Video Sequences using Deep Bi-Directional LSTM With CNN Features , 2018, IEEE Access.

[28]  Thomas L. Griffiths,et al.  Cognitive Model Priors for Predicting Human Decisions , 2019, ICML.

[29]  Hilda M. Fehd,et al.  Eye movements during multiple object tracking: Where do participants look? , 2008, Cognition.

[30]  John E. Laird,et al.  An Architecture Approach to Modeling the Remote Associates Test , 2018 .

[31]  Takaki Makino,et al.  Apprenticeship Learning for Model Parameters of Partially Observable Environments , 2012, ICML.

[32]  Barbara Hayes-Roth,et al.  A Cognitive Model of Planning , 1979, Cogn. Sci..