Autonomous Collision-Free Navigation of Microvehicles in Complex and Dynamically Changing Environments.

Self-propelled micro- and nanoscale robots represent a rapidly emerging and fascinating robotics research area. However, designing autonomous and adaptive control systems for operating micro/nanorobotics in complex and dynamically changing environments, which is a highly demanding feature, is still an unmet challenge. Here we describe a smart microvehicle for precise autonomous navigation in complicated environments and traffic scenarios. The fully autonomous navigation system of the smart microvehicle is composed of a microscope-coupled CCD camera, an artificial intelligence planner, and a magnetic field generator. The microscope-coupled CCD camera provides real-time localization of the chemically powered Janus microsphere vehicle and environmental detection for path planning to generate optimal collision-free routes, while the moving direction of the microrobot toward a reference position is determined by the external electromagnetic torque. Real-time object detection offers adaptive path planning in response to dynamically changing environments. We demonstrate that the autonomous navigation system can guide the vehicle movement in complex patterns, in the presence of dynamically changing obstacles, and in complex biological environments. Such a navigation system for micro/nanoscale vehicles, relying on vision-based close-loop control and path planning, is highly promising for their autonomous operation in complex dynamic settings and unpredictable scenarios expected in a variety of realistic nanoscale scenarios.

[1]  Wei Gao,et al.  Turning erythrocytes into functional micromotors. , 2014, ACS nano.

[2]  Oliver G. Schmidt,et al.  Rolled-up nanotech on polymers: from basic perception to self-propelled catalytic microengines. , 2011, Chemical Society reviews.

[3]  Wei Gao,et al.  Organized self-assembly of Janus micromotors with hydrophobic hemispheres. , 2013, Journal of the American Chemical Society.

[4]  Salvador Pané,et al.  Catalytic Locomotion of Core-Shell Nanowire Motors. , 2016, ACS nano.

[5]  Joseph Wang,et al.  Vapor-Driven Propulsion of Catalytic Micromotors , 2015, Scientific Reports.

[6]  Zhiguang Wu,et al.  Cell‐Membrane‐Coated Synthetic Nanomotors for Effective Biodetoxification , 2015 .

[7]  Joseph Wang,et al.  Motion control at the nanoscale. , 2010, Small.

[8]  Wei Gao,et al.  Fuel‐Free Synthetic Micro‐/Nanomachines , 2017, Advanced materials.

[9]  Salvador Pané,et al.  Real-Time Holographic Tracking and Control of Microrobots , 2016, IEEE Robotics and Automation Letters.

[10]  Yang Fang,et al.  Automated Particle Collection for Protein Crystal Harvesting , 2017, IEEE Robotics and Automation Letters.

[11]  Wei Li,et al.  Light‐Steered Isotropic Semiconductor Micromotors , 2017, Advanced materials.

[12]  Islam S. M. Khalil,et al.  The Control of Self-Propelled Microjets Inside a Microchannel With Time-Varying Flow Rates , 2014, IEEE Transactions on Robotics.

[13]  Salvador Pané,et al.  Robotically controlled microprey to resolve initial attack modes preceding phagocytosis , 2017, Science Robotics.

[14]  Wei Wang,et al.  Autonomous motion of metallic microrods propelled by ultrasound. , 2012, ACS nano.

[15]  Joseph Wang,et al.  Micro/nanorobots for biomedicine: Delivery, surgery, sensing, and detoxification , 2017, Science Robotics.

[16]  Salvador Pané,et al.  Recent developments in magnetically driven micro- and nanorobots , 2017 .

[17]  Bradley J. Nelson,et al.  Robust Electromagnetic Control of Microrobots Under Force and Localization Uncertainties , 2014, IEEE Transactions on Automation Science and Engineering.

[18]  Martin Pumera,et al.  Self-propelled autonomous nanomotors meet microfluidics. , 2016, Nanoscale.

[19]  Peter W. Eklund,et al.  A dynamic multi-source Dijkstra's algorithm for vehicle routing , 1996, 1996 Australian New Zealand Conference on Intelligent Information Systems. Proceedings. ANZIIS 96.

[20]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Sukhan Lee,et al.  Cellular robotic collision-free path planning , 1991, Fifth International Conference on Advanced Robotics 'Robots in Unstructured Environments.

[22]  Manuela M. Veloso,et al.  Real-Time Randomized Path Planning for Robot Navigation , 2002, RoboCup.

[23]  Mingli Xu,et al.  Micromotors Spontaneously Neutralize Gastric Acid for pH-Responsive Payload Release. , 2017, Angewandte Chemie.

[24]  Meng Wang,et al.  Fuzzy logic based robot path planning in unknown environment , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[25]  A. Leshansky,et al.  Swimming by reciprocal motion at low Reynolds number , 2014, Nature Communications.

[26]  Wei Gao,et al.  Reversible swarming and separation of self-propelled chemically powered nanomotors under acoustic fields. , 2015, Journal of the American Chemical Society.

[27]  Martin Pumera,et al.  Fabrication of Micro/Nanoscale Motors. , 2015, Chemical reviews.

[28]  David J. Pine,et al.  Living Crystals of Light-Activated Colloidal Surfers , 2013, Science.

[29]  Joseph Wang,et al.  Swimming Microrobot Optical Nanoscopy. , 2016, Nano letters.

[30]  Hsi-Wen Tung,et al.  Navigation of a rolling microrobot in cluttered environments for automated crystal harvesting , 2015, IROS 2015.

[31]  O. Khatib,et al.  Real-Time Obstacle Avoidance for Manipulators and Mobile Robots , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[32]  Wei Wang,et al.  Acoustic propulsion of nanorod motors inside living cells. , 2014, Angewandte Chemie.

[33]  Horacio Martinez-Alfaro,et al.  Mobile robot path planning and tracking using simulated annealing and fuzzy logic control , 1998 .

[34]  Alessandro Saffiotti,et al.  The uses of fuzzy logic in autonomous robot navigation , 1997, Soft Comput..

[35]  S. Sánchez,et al.  Catalytic Mesoporous Janus Nanomotors for Active Cargo Delivery , 2015, Journal of the American Chemical Society.

[36]  J. Ross,et al.  The impacts of molecular motor traffic jams , 2012, Proceedings of the National Academy of Sciences.

[37]  Xiaomiao Feng,et al.  Seawater-driven magnesium based Janus micromotors for environmental remediation. , 2013, Nanoscale.

[38]  Samuel Sánchez,et al.  Motion Control of Urea-Powered Biocompatible Hollow Microcapsules. , 2016, ACS nano.

[39]  Islam S. M. Khalil,et al.  Three-dimensional closed-loop control of self-propelled microjets , 2013 .

[40]  Longqiu Li,et al.  Self-Propelled Multilayered Microrockets for Pollutants Purification , 2015 .

[41]  Longqiu Li,et al.  Magnetically Propelled Fish-Like Nanoswimmers. , 2016, Small.

[42]  Sirilak Sattayasamitsathit,et al.  Water-driven micromotors for rapid photocatalytic degradation of biological and chemical warfare agents. , 2014, ACS nano.

[43]  Salvador Pané,et al.  Multiwavelength Light-Responsive Au/B-TiO2 Janus Micromotors. , 2017, ACS nano.

[44]  Samuel Sánchez,et al.  Chemically powered micro- and nanomotors. , 2015, Angewandte Chemie.

[45]  Wei Gao,et al.  Visible-Light-Driven BiOI-Based Janus Micromotor in Pure Water. , 2017, Journal of the American Chemical Society.

[46]  Xiaoming Hu,et al.  Path planning and navigation of mobile robots in unknown environments , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[47]  Islam S. M. Khalil,et al.  Wireless Magnetic-Based Closed-Loop Control of Self-Propelled Microjets , 2014, PloS one.