Ultrasound Imaging and Tracking of Micro/Nanorobots: From Individual to Collectives

The rapid development of untethered micro/nanorobots enables them to be applied in biomedical tasks, such as targeted delivery, localized diagnostics, and minimally invasive surgery. However, many challenges remain before applying these tiny machines to perform therapeutics and intervention in a living body. Among them, one critical issue is the integration of medical imaging systems with micro/nanorobotics to acquire precise feedback in vivo. Ultrasound imaging, as one of the widely used mature imaging technologies, shows great potential for providing real-time feedback of micro/nanorobots in 2-D and 3-D space. In this mini-review, the recent progress and challenges on the imaging and tracking of micro/nanorobots using established medical ultrasound imaging technologies are surveyed and summarized. The limitations together with future research opportunities in the real-time navigation of micro/nanorobots in vivo and their collectives are discussed.

[1]  Dengfeng Li,et al.  A fast and powerful swimming microrobot with a serrated tail enhanced propulsion interface. , 2018, Nanoscale.

[2]  Guang-Zhong Yang,et al.  From Passive Tool Holders to Microsurgeons: Safer, Smaller, Smarter Surgical Robots , 2014, IEEE Transactions on Biomedical Engineering.

[3]  Wei Gao,et al.  A microrobotic system guided by photoacoustic computed tomography for targeted navigation in intestines in vivo , 2019, Science Robotics.

[4]  Mingjun Xuan,et al.  Self‐Propelled Micro‐/Nanomotors Based on Controlled Assembled Architectures , 2016, Advanced materials.

[5]  Yanlei Hu,et al.  Botanical‐Inspired 4D Printing of Hydrogel at the Microscale , 2019, Advanced Functional Materials.

[6]  O. Schmidt,et al.  Catalytic microtubular jet engines self-propelled by accumulated gas bubbles. , 2009, Small.

[7]  Kun Liu,et al.  Micro-/Nanomotors toward Biomedical Applications: The Recent Progress in Biocompatibility. , 2020, Small.

[8]  Salvador Pané,et al.  Soft Micro- and Nanorobotics , 2018, Annu. Rev. Control. Robotics Auton. Syst..

[9]  Angelo S. Mao,et al.  An Integrated Microrobotic Platform for On‐Demand, Targeted Therapeutic Interventions , 2014, Advanced materials.

[10]  Metin Sitti,et al.  Mobile microrobots for bioengineering applications. , 2017, Lab on a chip.

[11]  Conghui Liu,et al.  Controllable Swarming and Assembly of Micro/Nanomachines , 2017, Micromachines.

[12]  Lidong Yang,et al.  Disassembly and spreading of magnetic nanoparticle clusters on uneven surfaces , 2020 .

[13]  D. Diamond,et al.  Fabrication of soft, stimulus-responsive structures with sub-micron resolution via two-photon polymerization of poly(ionic liquid)s , 2018, Materials Today.

[14]  Li Zhang,et al.  Model-Free Trajectory Tracking Control of Two-Particle Magnetic Microrobot , 2018, IEEE Transactions on Nanotechnology.

[15]  H-W Huang,et al.  Adaptive locomotion of artificial microswimmers , 2019, Science Advances.

[16]  Guang-Zhong Yang,et al.  Floating magnetic microrobots for fiber functionalization , 2019, Science Robotics.

[17]  P. Tierno,et al.  Dipolar Rings of Microscopic Ellipsoids: Magnetic Manipulation and Cell Entrapment , 2016, 1604.03895.

[18]  Carmen C. Mayorga-Martinez,et al.  Photocatalytic Micromotors Activated by UV to Visible Light for Environmental Remediation, Micropumps, Reversible Assembly, Transportation, and Biomimicry. , 2020, Small.

[19]  Metin Sitti,et al.  Rubbing Against Blood Clots Using Helical Robots: Modeling and In Vitro Experimental Validation , 2017, IEEE Robotics and Automation Letters.

[20]  T. Porter,et al.  Differences in definity and optison microbubble destruction rates at a similar mechanical index with different real-time perfusion systems. , 2003, Journal of the American Society of Echocardiography : official publication of the American Society of Echocardiography.

[21]  Jordi Llop,et al.  Medical Imaging for the Tracking of Micromotors. , 2018, ACS nano.

[22]  Yuechao Wang,et al.  Modeling and analysis of bio-syncretic micro-swimmers for cardiomyocyte-based actuation , 2016, Bioinspiration & biomimetics.

[23]  Alonso Sánchez,et al.  Magnetic control of self-propelled microjets under ultrasound image guidance , 2014, 5th IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics.

[24]  Nicolas Carraro,et al.  Faculty of 1000 evaluation for Acoustic reporter genes for noninvasive imaging of microorganisms in mammalian hosts. , 2018 .

[25]  B. Nelson,et al.  Small‐Scale Machines Driven by External Power Sources , 2018, Advanced materials.

[26]  Ben Wang,et al.  Reconfigurable Swarms of Ferromagnetic Colloids for Enhanced Local Hyperthermia , 2018 .

[27]  M. Sitti,et al.  Translational prospects of untethered medical microrobots , 2019, Progress in Biomedical Engineering.

[28]  T. Nelson,et al.  Three-dimensional ultrasound imaging. , 1998, Ultrasound in medicine & biology.

[29]  Yong-Ping Zheng,et al.  Automatic Measurement of Spine Curvature on 3-D Ultrasound Volume Projection Image With Phase Features , 2017, IEEE Transactions on Medical Imaging.

[30]  Peter R Hoskins,et al.  Simulation and validation of arterial ultrasound imaging and blood flow. , 2008, Ultrasound in medicine & biology.

[31]  Krzysztof K. Krawczyk,et al.  Magnetic Helical Micromachines: Fabrication, Controlled Swimming, and Cargo Transport , 2012, Advanced materials.

[32]  Allison M. Okamura,et al.  3-D Ultrasound-Guided Robotic Needle Steering in Biological Tissue , 2014, IEEE Transactions on Biomedical Engineering.

[33]  Ben Wang,et al.  Reconfigurable Magnetic Microswarm for Thrombolysis under Ultrasound Imaging , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[34]  F. Qiu,et al.  Controlled In Vivo Swimming of a Swarm of Bacteria‐Like Microrobotic Flagella , 2015, Advanced materials.

[35]  Toshio Fukuda,et al.  Grand Challenges in Bioengineered Nanorobotics for Cancer Therapy , 2013, IEEE Transactions on Biomedical Engineering.

[36]  Vijay Kumar,et al.  Automated biomanipulation of single cells using magnetic microrobots , 2013, Int. J. Robotics Res..

[37]  J D Thomas,et al.  Localization of needle tip with color doppler during pericardiocentesis: In vitro validation and initial clinical application. , 2001, Journal of the American Society of Echocardiography : official publication of the American Society of Echocardiography.

[38]  Wei Gao,et al.  Reversible swarming and separation of self-propelled chemically powered nanomotors under acoustic fields. , 2015, Journal of the American Chemical Society.

[39]  Aaron T. Becker,et al.  Exploiting Nonslip Wall Contacts to Position Two Particles Using the Same Control Input , 2019, IEEE Transactions on Robotics.

[40]  Oliver G Schmidt,et al.  Cellular Cargo Delivery: Toward Assisted Fertilization by Sperm-Carrying Micromotors. , 2016, Nano letters.

[41]  Shawn A. Chester,et al.  Printing ferromagnetic domains for untethered fast-transforming soft materials , 2018, Nature.

[42]  Alexey Snezhko,et al.  Manipulation of emergent vortices in swarms of magnetic rollers , 2018, Nature Communications.

[43]  R. Golestanian,et al.  Tunable self-healing of magnetically propelling colloidal carpets , 2019, Nature Communications.

[44]  P. Wolf,et al.  Vibrating interventional device detection using real-time 3-D color Doppler , 2008, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[45]  Liangfang Zhang,et al.  Artificial Micromotors in the Mouse’s Stomach: A Step toward in Vivo Use of Synthetic Motors , 2014, ACS nano.

[46]  Dongdong Jin,et al.  Active generation and magnetic actuation of microrobotic swarms in bio-fluids , 2019, Nature Communications.

[47]  Paolo Dario,et al.  Biohybrid actuators for robotics: A review of devices actuated by living cells , 2017, Science Robotics.

[48]  Yong Wang,et al.  Self-Propelled Micro/Nanomotors for On-Demand Biomedical Cargo Transportation. , 2020, Small.

[49]  Qiang He,et al.  Reconfigurable magnetic microrobot swarm: Multimode transformation, locomotion, and manipulation , 2019, Science Robotics.

[50]  Metin Sitti,et al.  Miniature soft robots — road to the clinic , 2018, Nature Reviews Materials.

[51]  Jake J. Abbott,et al.  Five-degree-of-freedom manipulation of an untethered magnetic device in fluid using a single permanent magnet with application in stomach capsule endoscopy , 2016, Int. J. Robotics Res..

[52]  Lidong Yang,et al.  Statistics-Based Automated Control for a Swarm of Paramagnetic Nanoparticles in 2-D Space , 2020, IEEE Transactions on Robotics.

[53]  Qi Zhou,et al.  Multifunctional biohybrid magnetite microrobots for imaging-guided therapy , 2017, Science Robotics.

[54]  Tianqi Xu,et al.  Millimeter-scale flexible robots with programmable three-dimensional magnetization and motions , 2019, Science Robotics.

[55]  Ran Wang,et al.  Development of a magnetic microrobot for carrying and delivering targeted cells , 2018, Science Robotics.

[56]  Metin Sitti,et al.  Multifunctional magnetic hairbot for untethered osteogenesis, ultrasound contrast imaging and drug delivery. , 2019, Biomaterials.

[57]  Vijay Kumar,et al.  The grand challenges of Science Robotics , 2018, Science Robotics.

[58]  Eric Diller,et al.  Biomedical Applications of Untethered Mobile Milli/Microrobots , 2015, Proceedings of the IEEE.

[59]  Joseph Wang,et al.  Micro/nanorobots for biomedicine: Delivery, surgery, sensing, and detoxification , 2017, Science Robotics.

[60]  Chao Liu,et al.  Characterizing Nanoparticle Swarms With Tuneable Concentrations for Enhanced Imaging Contrast , 2019, IEEE Robotics and Automation Letters.

[61]  Lidong Yang,et al.  Real-time tracking of fluorescent magnetic spore–based microrobots for remote detection of C. diff toxins , 2019, Science Advances.

[62]  A. Escarpa,et al.  Magnetic Reduced Graphene Oxide/Nickel/Platinum Nanoparticles Micromotors for Mycotoxin Analysis. , 2018, Chemistry.

[63]  Sara Nocentini,et al.  Photonic Microhand with Autonomous Action , 2017, Advanced materials.

[64]  Mohammad Eghtedari,et al.  Toward in vivo detection of hydrogen peroxide with ultrasound molecular imaging. , 2013, Biomaterials.

[65]  Metin Sitti,et al.  Soft erythrocyte-based bacterial microswimmers for cargo delivery , 2018, Science Robotics.

[66]  Samuel Sanchez,et al.  Propulsion Mechanism of Catalytic Microjet Engines , 2014, IEEE Transactions on Robotics.

[67]  Zhigang Wang,et al.  Phase-Shifted PFH@PLGA/Fe3O4 Nanocapsules for MRI/US Imaging and Photothermal Therapy with near-Infrared Irradiation. , 2015, ACS applied materials & interfaces.

[68]  S. Martel,et al.  Magneto-aerotactic bacteria deliver drug-containing nanoliposomes to tumour hypoxic regions , 2016, Nature nanotechnology.

[69]  Metin Sitti,et al.  Small-scale soft-bodied robot with multimodal locomotion , 2018, Nature.

[70]  Qiang He,et al.  Collective motion and dynamic self-assembly of colloid motors , 2018 .

[71]  Samuel Sánchez,et al.  Designing Micro- and Nanoswimmers for Specific Applications , 2016, Accounts of chemical research.

[72]  Edward D Light,et al.  Color Doppler Imaging of Cardiac Catheters Using Vibrating Motors , 2008, Ultrasonic imaging.

[73]  Robert D. Viveros,et al.  Mechanically Tunable Hollow Silica Ultrathin Nanoshells for Ultrasound Contrast Agents , 2015, Advanced functional materials.

[74]  Li Zhang,et al.  Four-dimensional direct laser writing of reconfigurable compound micromachines , 2020 .

[75]  Jake J. Abbott,et al.  OctoMag: An Electromagnetic System for 5-DOF Wireless Micromanipulation , 2010, IEEE Transactions on Robotics.

[76]  Li Zhang,et al.  Magnetic Navigation of a Rotating Colloidal Swarm Using Ultrasound Images , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[77]  Stephane Regnier,et al.  Tracking systems for intracranial medical devices: A review , 2019, MEDICAL DEVICES & SENSORS.

[78]  Samuel K. Sia,et al.  Soft medical microrobots: Design components and system integration , 2019 .

[79]  Bradley J. Nelson,et al.  Magnetically actuated microrobots as a platform for stem cell transplantation , 2019, Science Robotics.

[80]  J. Holen,et al.  Representations of rapidly oscillating structures on the Doppler display. , 1985, Ultrasound in medicine & biology.

[81]  Sylvain Martel,et al.  Exploiting the responses of magnetotactic bacteria robotic agents to enhance displacement control and swarm formation for drug delivery platforms , 2017, Int. J. Robotics Res..

[82]  Nitesh Nama,et al.  3D steerable, acoustically powered microswimmers for single-particle manipulation , 2019, Science Advances.

[83]  Metin Sitti,et al.  Pros and Cons: Magnetic versus Optical Microrobots , 2020, Advanced materials.

[84]  Hongliang Ren,et al.  Ultrasound-Assisted Guidance With Force Cues for Intravascular Interventions , 2019, IEEE Transactions on Automation Science and Engineering.

[85]  Metin Sitti,et al.  Mechanical Rubbing of Blood Clots Using Helical Robots Under Ultrasound Guidance , 2018, IEEE Robotics and Automation Letters.

[86]  Jie Zhang,et al.  Active colloids with collective mobility status and research opportunities. , 2017, Chemical Society reviews.

[87]  Alexander L. Klibanov,et al.  Microbubbles in ultrasound-triggered drug and gene delivery. , 2008, Advanced drug delivery reviews.

[88]  Li Zhang,et al.  Automated Control of Magnetic Spore-Based Microrobot Using Fluorescence Imaging for Targeted Delivery With Cellular Resolution , 2020, IEEE Transactions on Automation Science and Engineering.

[89]  Claudio Pacchierotti,et al.  Steering and Control of Miniaturized Untethered Soft Magnetic Grippers With Haptic Assistance , 2018, IEEE Transactions on Automation Science and Engineering.

[90]  Jake J. Abbott,et al.  Kinematic Model of a Magnetic-Microrobot Swarm in a Rotating Magnetic Dipole Field , 2020, IEEE Robotics and Automation Letters.

[91]  Li Zhang,et al.  Collective Behavior of Reconfigurable Magnetic Droplets via Dynamic Self-Assembly. , 2018, ACS applied materials & interfaces.

[92]  Islam S. M. Khalil,et al.  The Control of Self-Propelled Microjets Inside a Microchannel With Time-Varying Flow Rates , 2014, IEEE Transactions on Robotics.

[93]  Sangjin Yoo,et al.  Biomolecular Ultrasound and Sonogenetics. , 2018, Annual review of chemical and biomolecular engineering.

[94]  Li Zhang,et al.  An Automated Microrobotic Platform for Rapid Detection of C. diff Toxins , 2020, IEEE Transactions on Biomedical Engineering.

[95]  Jong-Oh Park,et al.  Magnetic actuated pH-responsive hydrogel-based soft micro-robot for targeted drug delivery , 2016 .

[96]  S. Salcudean,et al.  Needle tip localization using stylet vibration. , 2006, Ultrasound in medicine & biology.

[97]  K. Bente,et al.  Biohybrid and Bioinspired Magnetic Microswimmers. , 2018, Small.

[98]  Ick Chan Kwon,et al.  pH-controlled gas-generating mineralized nanoparticles: a theranostic agent for ultrasound imaging and therapy of cancers. , 2015, ACS nano.

[99]  P. Fischer,et al.  A swarm of slippery micropropellers penetrates the vitreous body of the eye , 2018, Science Advances.

[100]  Robert D. Howe,et al.  Robotic catheter cardiac ablation combining ultrasound guidance and force control , 2014, Int. J. Robotics Res..

[101]  Mariana Medina-Sánchez,et al.  Medical microbots need better imaging and control , 2017, Nature.

[102]  Ben Wang,et al.  Recent progress on micro- and nano-robots: towards in vivo tracking and localization. , 2018, Quantitative imaging in medicine and surgery.

[103]  Stefano Scheggi,et al.  Magnetic motion control and planning of untethered soft grippers using ultrasound image feedback , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[104]  Ben Wang,et al.  Bubble-Assisted Three-Dimensional Ensemble of Nanomotors for Improved Catalytic Performance , 2019, iScience.

[105]  Benjamin V. Johnson,et al.  A Microforce-Sensing Mobile Microrobot for Automated Micromanipulation Tasks , 2019, IEEE Transactions on Automation Science and Engineering.

[106]  Lixin Dong,et al.  Artificial bacterial flagella: Fabrication and magnetic control , 2009 .

[107]  Kevin Kaufmann,et al.  Aptamer-Modified Graphene-Based Catalytic Micromotors: Off–On Fluorescent Detection of Ricin , 2016 .

[108]  Nitin Sharma,et al.  Ultrasound Tracking of the Acoustically Actuated Microswimmer , 2019, IEEE Transactions on Biomedical Engineering.

[109]  Li Zhang,et al.  A Miniature Flexible-Link Magnetic Swimming Robot With Two Vibration Modes: Design, Modeling and Characterization , 2017, IEEE Robotics and Automation Letters.

[110]  Bradley J. Nelson,et al.  Visually Servoing Magnetic Intraocular Microdevices , 2012, IEEE Transactions on Robotics.

[111]  Islam S. M. Khalil,et al.  Magnetic-based closed-loop control of paramagnetic microparticles using ultrasound feedback , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[112]  Damien Faivre,et al.  Pattern formation and collective effects in populations of magnetic microswimmers , 2017 .

[113]  Li Zhang,et al.  Ultra-extensible ribbon-like magnetic microswarm , 2018, Nature Communications.

[114]  Ioannis K. Kaliakatsos,et al.  Microrobots for minimally invasive medicine. , 2010, Annual review of biomedical engineering.

[115]  Fei Peng,et al.  Micro/nanomotors towards in vivo application: cell, tissue and biofluid. , 2017, Chemical Society reviews.

[116]  Sunil Unnikrishnan,et al.  Microbubbles as ultrasound contrast agents for molecular imaging: preparation and application. , 2012, AJR. American journal of roentgenology.