Automated robotic breast ultrasound acquisition using ultrasound feedback

Current challenges in automated robotic breast ultrasound (US) acquisitions include keeping acoustic coupling between the breast and the US probe, minimizing tissue deformations and safety. In this paper, we present how an autonomous 3D breast US acquisition can be performed utilizing a 7DOF robot equipped with a linear US transducer. Robotic 3D breast US acquisitions would increase the diagnostic value of the modality since they allow patient specific scans and have a high reproducibility, accuracy and efficiency. Additionally, 3D US acquisitions allow more flexibility in examining the breast and simplify registration with preoperative images like MRI. To overcome the current challenges, the robot follows a reference- based trajectory adjusted by a visual servoing algorithm. The reference trajectory is a patient specific trajectory coming from e.g. an MRI. The visual servoing algorithm commands in-plane rotations and corrects the probe contact based on confidence maps. A safety aware, intrinsically passive framework is utilised to actuate the robot. The approach is illustrated with experiments on a phantom, which show that the robot only needs minor pre-procedural information to consistently image the phantom while relying mainly on US feedback.

[1]  Peter Kazanzides,et al.  A cooperatively controlled robot for ultrasound monitoring of radiation therapy , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Thomas Neff,et al.  Automatic force-compliant robotic ultrasound screening of abdominal aortic aneurysms , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[3]  Rafik Mebarki,et al.  2-D Ultrasound Probe Complete Guidance by Visual Servoing Using Image Moments , 2010, IEEE Transactions on Robotics.

[4]  Alexandre Krupa,et al.  Intensity-Based Ultrasound Visual Servoing: Modeling and Validation With 2-D and 3-D Probes , 2013, IEEE Transactions on Robotics.

[5]  Tomas Akenine-Möller,et al.  Fast, Minimum Storage Ray-Triangle Intersection , 1997, J. Graphics, GPU, & Game Tools.

[6]  Nassir Navab,et al.  Optimization of ultrasound image quality via visual servoing , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[7]  Mustafa Z. Mahmoud,et al.  Evolution of Robot-assisted ultrasound-guided breast biopsy systems , 2018 .

[8]  Nassir Navab,et al.  Confidence-driven control of an ultrasound probe: Target-specific acoustic window optimization , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[9]  Atsuo Takanishi,et al.  Out-of-plane visual servoing method for tracking the carotid artery with a robot-assisted ultrasound diagnostic system , 2011, 2011 IEEE International Conference on Robotics and Automation.

[10]  Stefano Stramigioli,et al.  Energy-Aware Robotics , 2015 .

[11]  Wen-Hong Zhu,et al.  Image-guided control of a robot for medical ultrasound , 2002, IEEE Trans. Robotics Autom..

[12]  Stefano Stramigioli,et al.  Design of an end-effector for robot-assisted ultrasound-guided breast biopsies , 2020, International Journal of Computer Assisted Radiology and Surgery.

[13]  Nassir Navab,et al.  Use the force: deformation correction in robotic 3D ultrasound , 2018, International Journal of Computer Assisted Radiology and Surgery.

[14]  Nikolai Hungr,et al.  A 3-D Ultrasound Robotic Prostate Brachytherapy System With Prostate Motion Tracking , 2012, IEEE Transactions on Robotics.

[15]  Stefano Stramigioli,et al.  Development of a Safety- and Energy-Aware Impedance Controller for Collaborative Robots , 2018, IEEE Robotics and Automation Letters.

[16]  Qinghua Huang,et al.  Fully Automatic Three-Dimensional Ultrasound Imaging Based on Conventional B-Scan , 2018, IEEE Transactions on Biomedical Circuits and Systems.

[17]  Nassir Navab,et al.  Ultrasound confidence maps using random walks , 2012, Medical Image Anal..

[18]  Y. Kim,et al.  Development of a control algorithm for the ultrasound scanning robot (NCCUSR) using ultrasound image and force feedback , 2017, The international journal of medical robotics + computer assisted surgery : MRCAS.

[19]  Qinghua Huang,et al.  A Review on Real-Time 3D Ultrasound Imaging Technology , 2017, BioMed research international.

[20]  Nassir Navab,et al.  Confidence-Driven Control of an Ultrasound Probe , 2017, IEEE Transactions on Robotics.

[21]  Gregory D. Hager,et al.  Real-time Motion Stabilization with B-mode Ultrasound Using Image Speckle Information and Visual Servoing , 2009, Int. J. Robotics Res..