Robotic Guide Dog: Leading a Human with Leash-Guided Hybrid Physical Interaction

An autonomous robot that is able to physically guide humans through narrow and cluttered spaces could be a big boon to the visually-impaired. Most prior robotic guiding systems are based on wheeled platforms with large bases with actuated rigid guiding canes. The large bases and the actuated arms limit these prior approaches from operating in narrow and cluttered environments. We propose a method that introduces a quadrupedal robot with a leash to enable the robot-guidinghuman system to change its intrinsic dimension (by letting the leash go slack) in order to fit into narrow spaces. We propose a hybrid physical Human Robot Interaction model that involves leash tension to describe the dynamical relationship in the robot-guiding-human system. This hybrid model is utilized in a mixed-integer programming problem to develop a reactive planner that is able to utilize slack-taut switching to guide a blind-folded person to safely travel in a confined space. The proposed leash-guided robot framework is deployed on a Mini Cheetah quadrupedal robot and validated in experiments (Video 1)

[1]  Koushil Sreenath,et al.  Differential Flatness Based Path Planning With Direct Collocation on Hybrid Modes for a Quadrotor With a Cable-Suspended Payload , 2020, IEEE Robotics and Automation Letters.

[2]  Alessandro De Luca,et al.  Hybrid force/velocity control for physical human-robot collaboration tasks , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[3]  Sangbae Kim,et al.  Dynamic Locomotion in the MIT Cheetah 3 Through Convex Model-Predictive Control , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[4]  Nikolaos G. Bourbakis,et al.  Wearable Obstacle Avoidance Electronic Travel Aids for Blind: A Survey , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[5]  Vijay Kumar,et al.  Mixed Integer Quadratic Program trajectory generation for a quadrotor with a cable-suspended payload , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Stefan Kohlbrecher,et al.  A flexible and scalable SLAM system with full 3D motion estimation , 2011, 2011 IEEE International Symposium on Safety, Security, and Rescue Robotics.

[7]  Cang Ye,et al.  Co-Robotic Cane: A New Robotic Navigation Aid for the Visually Impaired , 2016, IEEE Systems, Man, and Cybernetics Magazine.

[8]  Laura Giarré,et al.  Deep Trail-Following Robotic Guide Dog in Pedestrian Environments for People who are Blind and Visually Impaired - Learning from Virtual and Real Worlds , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[9]  Sebastian Thrun,et al.  A robotic walker that provides guidance , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[10]  Moritz Diehl,et al.  CasADi: a software framework for nonlinear optimization and optimal control , 2018, Mathematical Programming Computation.

[11]  Donghyun Kim,et al.  Highly Dynamic Quadruped Locomotion via Whole-Body Impulse Control and Model Predictive Control , 2019, ArXiv.

[12]  Koushil Sreenath,et al.  Geometric Control and Differential Flatness of a Quadrotor UAV with Load Suspended from a Pulley , 2019, 2019 American Control Conference (ACC).

[13]  Yury Gorbachev,et al.  OpenVINO Deep Learning Workbench: Comprehensive Analysis and Tuning of Neural Networks Inference , 2019, 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW).

[14]  José Luis Pons Rovira,et al.  Online Assessment of Human-Robot Interaction for Hybrid Control of Walking , 2011, Sensors.

[15]  Antonis A. Argyros,et al.  Navigation assistance and guidance of older adults across complex public spaces: the DALi approach , 2015, Intell. Serv. Robotics.

[16]  Daniela Rus,et al.  Safe Local Navigation for Visually Impaired Users With a Time-of-Flight and Haptic Feedback Device , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[17]  Wolfram Burgard,et al.  Monte Carlo Localization: Efficient Position Estimation for Mobile Robots , 1999, AAAI/IAAI.

[18]  Sangbae Kim,et al.  Mini Cheetah: A Platform for Pushing the Limits of Dynamic Quadruped Control , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[19]  Zhongyu Li,et al.  Toward A Ballbot for Physically Leading People: A Human-Centered Approach , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[20]  Iwan Ulrich,et al.  The GuideCane-a computerized travel aid for the active guidance of blind pedestrians , 1997, Proceedings of International Conference on Robotics and Automation.

[21]  Davide Scaramuzza,et al.  Fast Trajectory Optimization for Agile Quadrotor Maneuvers with a Cable-Suspended Payload , 2017, Robotics: Science and Systems.

[22]  Wolfram Burgard,et al.  Navigating blind people with walking impairments using a smart walker , 2017, Auton. Robots.

[23]  Iwan Ulrich,et al.  VFH/sup */: local obstacle avoidance with look-ahead verification , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[24]  Victor M. Zavala,et al.  Large-scale nonlinear programming using IPOPT: An integrating framework for enterprise-wide dynamic optimization , 2009, Comput. Chem. Eng..

[25]  NicholsonJohn,et al.  Robot-assisted wayfinding for the visually impaired in structured indoor environments , 2006 .

[26]  Avideh Zakhor,et al.  Indoor Query System for the Visually Impaired , 2020, ICCHP.

[27]  Jeha Ryu,et al.  Safe physical human robot interaction-past, present and future , 2008 .