Experimental Analysis of Human Control Strategies in Contact Manipulation Tasks

Here, we present insights into human contact-control strategies by defining conditions to determine whether a human controls a contact state, empirically analyzing object-to-environment contact geometry data obtained from human demonstrations in a haptic simulation environment, and testing hypothesess about underlying human contact-control strategies. Using haptic demonstration data from eleven subjects who inserted non-convex objects into occluded holes, we tested the following human contact-control hypotheses: (h1) humans follow a task trajectory that tracks pre-planned contact-state waypoints organized in a contact-state graph (contact-waypoint hypothesis); (h2) humans traverse the contact-state graph, explicitly controlling some contact states or subsets of contact states, in addition to the pre-determined initial and final goal states (controlled subgraph hypothesis); (h3) humans use a control policy where the only controlled states are the starting state for the task and the goal state (state policy hypothesis). Notably, we found that humans tend to visit a select few contact states once they enter each state’s vicinity in the graph, which is evidence against h3. Yet humans do not always visit said states (visit probability \(<40\%\)), which is, in addition, evidence against h1 provided different humans adopt similar strategies. We show that a classifier to determine when humans control their trajectories to visit specific contact states, when parameterized correctly, is invariant to graph aggregation operations across the false-positive to false-negative tradeoff spectrum. This indicates our results are robust given the data we obtained and suggests that efforts to characterize human motion should focus on h2.

[1]  Matthew T. Mason,et al.  Compliance and Force Control for Computer Controlled Manipulators , 1981, IEEE Transactions on Systems, Man, and Cybernetics.

[2]  B. Efron,et al.  The Jackknife: The Bootstrap and Other Resampling Plans. , 1983 .

[3]  Daniel E. Whitney,et al.  Historical Perspective and State of the Art in Robot Force Control , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[4]  Oussama Khatib,et al.  The Potential Field Approach And Operational Space Formulation In Robot Control , 1986 .

[5]  Neville Hogan,et al.  Stable execution of contact tasks using impedance control , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[6]  B. Efron The jackknife, the bootstrap, and other resampling plans , 1987 .

[7]  Jing Xiao,et al.  Automatic determination of topological contacts in the presence of sensing uncertainties , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[8]  Hong Z. Tan,et al.  HUMAN FACTORS FOR THE DESIGN OF FORCE-REFLECTING HAPTIC INTERFACES , 1994 .

[9]  Joris De Schutter,et al.  Specification of force-controlled actions in the "task frame formalism"-a synthesis , 1996, IEEE Trans. Robotics Autom..

[10]  Kunikatsu Takase,et al.  Assembly motion teaching system using position/force simulator-generating control program , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[11]  James J. Troy,et al.  Six degree-of-freedom haptic rendering using voxel sampling , 1999, SIGGRAPH '99.

[12]  Oussama Khatib,et al.  A general contact model for dynamically-decoupled force/motion control , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[13]  Richard A. Volz,et al.  Acquiring robust, force-based assembly skills from human demonstration , 2000, IEEE Trans. Robotics Autom..

[14]  Oussama Khatib,et al.  A framework for multi-contact multi-body dynamic simulation and haptic display , 2000 .

[15]  Xuerong Ji,et al.  Automatic Generation of High-Level Contact State Space , 2001, Int. J. Robotics Res..

[16]  Oussama Khatib,et al.  Haptic display for human interaction with virtual dynamic environments , 2001, J. Field Robotics.

[17]  Jing Xiao,et al.  Planning Motions Compliant to Complex Contact States , 2001, Int. J. Robotics Res..

[18]  S. Schultz Principles of Neural Science, 4th ed. , 2001 .

[19]  Jun Nakanishi,et al.  Learning Movement Primitives , 2005, ISRR.

[20]  John Kenneth Salisbury,et al.  Haptic Rendering: Introductory Concepts , 2004, IEEE Computer Graphics and Applications.

[21]  Jon Rigelsford Touch in Virtual Environments and Haptics , 2004 .

[22]  Joris De Schutter,et al.  Integration of planning and execution in force controlled compliant motion , 2005, IROS.

[23]  Herman Bruyninckx,et al.  Bayesian Hybrid Model-State Estimation Applied to Simultaneous Contact Formation Recognition and Geometrical Parameter Estimation , 2005, Int. J. Robotics Res..

[24]  Oussama Khatib,et al.  A Haptic Teleoperation Approach Based on Contact Force Control , 2006, Int. J. Robotics Res..

[25]  Katherine J. Kuchenbecker,et al.  Improving contact realism through event-based haptic feedback , 2006, IEEE Transactions on Visualization and Computer Graphics.

[26]  Joris De Schutter,et al.  Contact State Segmentation Using Particle Filters for Programming by Human Demonstration in Compliant Motion Tasks , 2006, ISER.

[27]  山田 祐,et al.  Open Dynamics Engine を用いたスノーボードロボットシミュレータの開発 , 2007 .

[28]  Tsutomu Hasegawa,et al.  Generating a contact state graph of polyhedral objects for robotic application , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[29]  Alin Albu-Schäffer,et al.  The sigma.7 haptic interface for MiroSurge: A new bi-manual surgical console , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[30]  Xin Zhang,et al.  Configuration-based optimization for six degree-of-freedom haptic rendering for fine manipulation. , 2013, IEEE transactions on haptics.

[31]  Oussama Khatib,et al.  Using haptics to probe human contact control strategies for six degree-of-freedom tasks , 2014, 2014 IEEE Haptics Symposium (HAPTICS).