Cognition-enabled robotic wiping: Representation, planning, execution, and interpretation

Abstract Advanced cognitive capabilities enable humans to solve even complex tasks by representing and processing internal models of manipulation actions and their effects. Consequently, humans are able to plan the effect of their motions before execution and validate the performance afterwards. In this work, we derive an analog approach for robotic wiping actions which are fundamental for some of the most frequent household chores including vacuuming the floor, sweeping dust, and cleaning windows. We describe wiping actions and their effects based on a qualitative particle distribution model. This representation enables a robot to plan goal-oriented wiping motions for the prototypical wiping actions of absorbing, collecting and skimming. The particle representation is utilized to simulate the task outcome before execution and infer the real performance afterwards based on haptic perception. This way, the robot is able to estimate the task performance and schedule additional motions if necessary. We evaluate our methods in simulated scenarios, as well as in real experiments with the humanoid service robot Rollin’ Justin.

[1]  Stefan Schaal,et al.  Skill learning and task outcome prediction for manipulation , 2011, 2011 IEEE International Conference on Robotics and Automation.

[2]  Ronald L. Graham,et al.  On the History of the Minimum Spanning Tree Problem , 1985, Annals of the History of Computing.

[3]  Ville Kyrki,et al.  Reinforcement learning for improving imitated in-contact skills , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[4]  Nils J. Nilsson,et al.  A Formal Basis for the Heuristic Determination of Minimum Cost Paths , 1968, IEEE Trans. Syst. Sci. Cybern..

[5]  Fulvio Mastrogiovanni,et al.  Towards the creation of tactile maps for robots and their use in robot contact motion control , 2015, Robotics Auton. Syst..

[6]  Daniel Leidner,et al.  Knowledge-enabled parameterization of whole-body control strategies for compliant service robots , 2016, Auton. Robots.

[7]  Michael Beetz,et al.  Multidimensional Time-Series Shapelets Reliably Detect and Classify Contact Events in Force Measurements of Wiping Actions , 2018, IEEE Robotics and Automation Letters.

[8]  Carme Torras,et al.  Planning robot manipulation to clean planar surfaces , 2015, Eng. Appl. Artif. Intell..

[9]  Paolo Traverso,et al.  Automated planning - theory and practice , 2004 .

[10]  J. Gibson.  Observations on active touch. , 1962, Psychological review.

[11]  Jun Morimoto,et al.  Adaptation and coaching of periodic motion primitives through physical and visual interaction , 2016, Robotics Auton. Syst..

[12]  Jean-Claude Latombe,et al.  Robot motion planning , 1970, The Kluwer international series in engineering and computer science.

[13]  Michael Beetz,et al.  Action recognition and interpretation from virtual demonstrations , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[14]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[15]  Gerd Hirzinger,et al.  Inverse kinematics with closed form solutions for highly redundant robotic systems , 2009, 2009 IEEE International Conference on Robotics and Automation.

[16]  Kenneth D. Forbus.  Qualitative Process Theory , 1984, Artif. Intell..

[17]  Elon Rimon,et al.  Spanning-tree based coverage of continuous areas by a mobile robot , 2004, Annals of Mathematics and Artificial Intelligence.

[18]  Miles C. Bowman,et al.  Control strategies in object manipulation tasks , 2006, Current Opinion in Neurobiology.

[19]  David H. D. Warren,et al.  Prolog - the language and its implementation compared with Lisp , 1977, Artificial Intelligence and Programming Languages.

[20]  D. Norman,et al.  Attention to Action: Willed and Automatic Control of Behavior Technical Report No. 8006. , 1980 .

[21]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[22]  Alexander Dietrich,et al.  Reactive Whole-Body Control: Dynamic Mobile Manipulation Using a Large Number of Actuated Degrees of Freedom , 2012, IEEE Robotics & Automation Magazine.

[23]  Takeo Kanade,et al.  Automated Construction of Robotic Manipulation Programs , 2010 .

[24]  Andrej Gams,et al.  On-line periodic movement and force-profile learning for adaptation to new surfaces , 2010, 2010 10th IEEE-RAS International Conference on Humanoid Robots.

[25]  Alin Albu-Schäffer,et al.  The DLR lightweight robot: design and control concepts for robots in human environments , 2007, Ind. Robot.