A Collaborative Robotic Approach to Autonomous Pallet Jack Transportation and Positioning

This paper proposes a novel loco-manipulation control framework for the execution of complex tasks with kinodynamic constraints using mobile manipulators. As a representative example, we consider the handling and re-positioning of pallet jacks (or lifts/carriers with similar characteristics) in unstructured environments. This task is associated with significant challenges in terms of locomotion, due to the mobility constraints that are imposed by their limited kinematics while moving, and manipulation, due to the existence of dynamic uncertainties while grasping and handling of pallet jacks. To tackle these challenges, our solution enables the robotic platform to autonomously reach a pallet jack location while avoiding the obstacles, and to detect and manipulate its handle by fusing the perception and the contact force data. Subsequently, the transportation of the pallet jack is achieved through a whole-body impedance controller and a trajectory planner which takes into account the mobility constraints of the robot-pallet jack chain. We demonstrate the effectiveness of the proposed solution in reaching and displacing the pallets to desired locations through simulation studies and experimental results. While these results reveal with a proof-of-concept the effectiveness of the proposed framework, they also demonstrate the high potential of mobile manipulators for relieving human workers from such repetitive and labor intensive tasks. We believe that this extended functionality can contribute to increasing the usability of mobile manipulators in different application scenarios.

[1]  Se-Jong Oh,et al.  A New Concave Hull Algorithm and Concaveness Measure for n-dimensional Datasets , 2012, J. Inf. Sci. Eng..

[2]  Rita Cucchiara,et al.  Focus based Feature Extraction for Pallets Recognition , 2000, BMVC.

[3]  Oussama Khatib,et al.  Inertial Properties in Robotic Manipulation: An Object-Level Framework , 1995, Int. J. Robotics Res..

[4]  Oussama Khatib,et al.  A unified approach for motion and force control of robot manipulators: The operational space formulation , 1987, IEEE J. Robotics Autom..

[5]  Fei Zhao,et al.  A Teleoperation Interface for Loco-Manipulation Control of Mobile Collaborative Robotic Assistant , 2019, IEEE Robotics and Automation Letters.

[6]  Federico Tombari,et al.  A combined texture-shape descriptor for enhanced 3D feature matching , 2011, 2011 18th IEEE International Conference on Image Processing.

[7]  Keum-Shik Hong,et al.  Configuration Control of an Autonomous Vehicle under Nonholonomic and Field-of-View Constraints , 2015 .

[8]  Vinicio Tincani,et al.  The Next Step in Robot Commissioning: Autonomous Picking and Palletizing , 2016, IEEE Robotics and Automation Letters.

[9]  Alexander Dietrich,et al.  Whole-body impedance control of wheeled mobile manipulators , 2016, Auton. Robots.

[10]  Keum-Shik Hong,et al.  A path following control of an unmanned autonomous forklift , 2009 .

[11]  B. Faverjon,et al.  Probabilistic Roadmaps for Path Planning in High-Dimensional Con(cid:12)guration Spaces , 1996 .

[12]  Debjit Roy,et al.  Robotized and Automated Warehouse Systems: Review and Recent Developments , 2019, Transp. Sci..

[13]  Roger V. Bostelman,et al.  Visualization of pallets , 2006, SPIE Optics East.

[14]  Christian Schlegel,et al.  Towards a robot fleet for intra-logistic tasks: Combining free robot navigation with multi-robot coordination at bottlenecks , 2016, 2016 IEEE 21st International Conference on Emerging Technologies and Factory Automation (ETFA).

[15]  Wenguang Wang,et al.  Pedestrian Detection with Lidar Point Clouds Based on Single Template Matching , 2019, Electronics.

[16]  Zhilu Zhang,et al.  The Influence of Cargo Moving and Sliding Mode Control Strategy for Forklift , 2020, IEEE Access.

[17]  Gülçin Büyüközkan,et al.  Digital Supply Chain: Literature review and a proposed framework for future research , 2018, Comput. Ind..

[18]  Vincent Lepetit,et al.  Multimodal templates for real-time detection of texture-less objects in heavily cluttered scenes , 2011, 2011 International Conference on Computer Vision.

[19]  Tara N. Sainath,et al.  A voice-commandable robotic forklift working alongside humans in minimally-prepared outdoor environments , 2010, 2010 IEEE International Conference on Robotics and Automation.

[20]  Kazuhiro Kosuge,et al.  Progress and prospects of the human–robot collaboration , 2017, Autonomous Robots.

[21]  Richard Bloss,et al.  Collaborative robots are rapidly providing major improvements in productivity, safety, programing ease, portability and cost while addressing many new applications , 2016, Ind. Robot.

[22]  Sanghyun Kim,et al.  Whole-body Control of Non-holonomic Mobile Manipulator Based on Hierarchical Quadratic Programming and Continuous Task Transition , 2019, 2019 IEEE 4th International Conference on Advanced Robotics and Mechatronics (ICARM).

[23]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[24]  Michael Seelinger,et al.  Automatic visual guidance of a forklift engaging a pallet , 2006, Robotics Auton. Syst..

[25]  Arash Ajoudani,et al.  Towards an Intelligent Collaborative Robotic System for Mixed Case Palletizing , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[26]  Hui Chen,et al.  3D free-form object recognition in range images using local surface patches , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[27]  Yuqiang Wu,et al.  Towards Ergonomic Control of Collaborative Effort in Multi-human Mobile-robot Teams , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[28]  Torsten Bertram,et al.  Integrated online trajectory planning and optimization in distinctive topologies , 2017, Robotics Auton. Syst..

[29]  Peter I. Corke,et al.  Robotics, Vision and Control - Fundamental Algorithms in MATLAB® , 2011, Springer Tracts in Advanced Robotics.

[30]  Torsten Bertram,et al.  Planning of multiple robot trajectories in distinctive topologies , 2015, 2015 European Conference on Mobile Robots (ECMR).

[31]  Bernardo Wagner,et al.  Variable Pallet Pick-Up for Automatic Guided Vehicles in Industrial Environments , 2006, 2006 IEEE Conference on Emerging Technologies and Factory Automation.

[32]  Juan Chen,et al.  Collision-Free Route Planning for Multiple AGVs in an Automated Warehouse Based on Collision Classification , 2018, IEEE Access.