Augmented reality user interface for an atomic force microscope-based nanorobotic system

A real-time augmented reality (AR) user interface for nanoscale interaction and manipulation applications using an atomic force microscope (AFM) is presented. Nanoscale three-dimensional (3-D) topography and force information sensed by an AFM probe are fed back to a user through a simulated AR system. The sample surface is modeled with a B-spline-based geometry model, upon which a collision detection algorithm determines whether and how the spherical AFM tip penetrates the surface. Based on these results, the induced surface deformations are simulated using continuum micro/nanoforce and Maugis-Dugdale elastic contact mechanics models, and 3-D decoupled force feedback information is obtained in real time. The simulated information is then blended in real time with the force measurements of the AFM in an AR human machine interface, comprising a computer graphics environment and a haptic interface. Accuracy, usability, and reliability of the proposed AR user interface is tested by experiments for three tasks: positioning the AFM probe tip close to a surface, just in contact with a surface, or below a surface by elastically indenting. Results of these tests showed the performance of the proposed user interface. This user interface would be critical for many nanorobotic applications in biotechnology, nanodevice prototyping, and nanotechnology education

[1]  Allison M. Okamura,et al.  Interactive Haptic Rendering of Deformable Surfaces Based on the Medial Axis Transform , 2002 .

[2]  Ning Xi,et al.  Manipulation of living cells by atomic force microscopy , 2003, Proceedings 2003 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM 2003).

[3]  R. Superfine,et al.  Nanometre-scale rolling and sliding of carbon nanotubes , 1999, Nature.

[4]  Alejandro Bugacov,et al.  Building and Manipulating Three-Dimensional and Linked Two-Dimensional Structures of Nanoparticles Using Scanning Force Microscopy , 1998 .

[5]  Othmar Marti,et al.  AFM Instrumentation and Tips , 1998, Handbook of Micro/Nano Tribology.

[6]  Sitti Metin.  Teleoperated 2-D Micro/Nanomanipulation Using Atomic Force Microscope , 1999 .

[7]  Byungkyu Kim,et al.  Modeling and Simulation of Nanorobotic Manipulation with an AFM probe , 2002 .

[8]  Charles Baur,et al.  Delta Haptic Device as a nanomanipulator , 2001, Optics East.

[9]  Stefan Thalhammer,et al.  The AFM as a tool for chromosomal dissection – the influence of physical parameters , 1998 .

[10]  S. Salcudean,et al.  Toward a tele-nanorobotic manipulation system with atomic scale force feedback and motion resolution , 1990, IEEE Proceedings on Micro Electro Mechanical Systems, An Investigation of Micro Structures, Sensors, Actuators, Machines and Robots..

[11]  Russell M. Taylor,et al.  Advanced interfaces to scanned-probe microscopes , 2000 .

[12]  R. W. Stark,et al.  Force-feedback joystick as a low-cost haptic interface for an atomic-force-microscopy nanomanipulator , 2003 .

[13]  M. Sitti.  Atomic force microscope probe based controlled pushing for nanotribological characterization , 2004, IEEE/ASME Transactions on Mechatronics.

[14]  H. Hashimoto,et al.  Controlled pushing of nanoparticles: modeling and experiments , 2000 .

[15]  Metin Sitti,et al.  Teleoperated touch feedback from the surfaces at the nanoscale: modeling and experiments , 2003 .

[16]  Y. Hatamura,et al.  Direct coupling system between nanometer world and human world , 1990, IEEE Proceedings on Micro Electro Mechanical Systems, An Investigation of Micro Structures, Sensors, Actuators, Machines and Robots..

[17]  L. Samuelson,et al.  Controlled manipulation of nanoparticles with an atomic force microscope , 1995 .

[18]  L. Piegl,et al.  The NURBS Book , 1995, Monographs in Visual Communications.

[19]  Metin Sitti,et al.  Nanotribological characterization system by AFM based controlled pushing , 2001, Proceedings of the 2001 1st IEEE Conference on Nanotechnology. IEEE-NANO 2001 (Cat. No.01EX516).

[20]  Hideki Hashimoto,et al.  Scaled teleoperation system for nano-scale interaction and manipulation , 2003, Adv. Robotics.