Physical problem solving: Joint planning with symbolic, geometric, and dynamic constraints

In this paper, we present a new task that investigates how people interact with and make judgments about towers of blocks. In Experiment~1, participants in the lab solved a series of problems in which they had to re-configure three blocks from an initial to a final configuration. We recorded whether they used one hand or two hands to do so. In Experiment~2, we asked participants online to judge whether they think the person in the lab used one or two hands. The results revealed a close correspondence between participants' actions in the lab, and the mental simulations of participants online. To explain participants' actions and mental simulations, we develop a model that plans over a symbolic representation of the situation, executes the plan using a geometric solver, and checks the plan's feasibility by taking into account the physical constraints of the scene. Our model explains participants' actions and judgments to a high degree of quantitative accuracy.

[1]  Allen Newell,et al.  Elements of a theory of human problem solving. , 1958 .

[2]  John R. Anderson.  The Adaptive Character of Thought , 1990 .

[3]  Sharlene D. Newman,et al.  Frontal and parietal participation in problem solving in the Tower of London: fMRI and computational modeling of planning and high-level perception , 2003, Neuropsychologia.

[4]  Daniel A. Braun,et al.  Optimal Control Predicts Human Performance on Objects with Internal Degrees of Freedom , 2009, PLoS Comput. Biol..

[5]  L. Carlson,et al.  Spatial Reasoning , 2010 .

[6]  David W. Franklin,et al.  Computational Mechanisms of Sensorimotor Control , 2011, Neuron.

[7]  H. A. Ruger.  The Psychology Of Efficiency: An Experimental Study Of The Processes Involved In The Solution Of Mechanical Puzzles And In The Acquisition Of Skill In Their Manipulation... , 2012 .

[8]  Helge J. Ritter,et al.  Physical Bongard Problems , 2012, AIAI.

[9]  Jessica B. Hamrick,et al.  Simulation as an engine of physical scene understanding , 2013, Proceedings of the National Academy of Sciences.

[10]  Marc Toussaint,et al.  Newton methods for k-order Markov Constrained Motion Problems , 2014, ArXiv.

[11]  Marc Toussaint,et al.  Logic-Geometric Programming: An Optimization-Based Approach to Combined Task and Motion Planning , 2015, IJCAI.

[12]  Geoffrey P. Goodwin,et al.  Logic, probability, and human reasoning , 2015, Trends in Cognitive Sciences.

[13]  Tom Schaul,et al.  The Predictron: End-To-End Learning and Planning , 2016, ICML.