Image processing, geometric modeling and data management for development of a virtual bone surgery system

This paper describes image processing, geometric modeling and data management techniques for the development of a virtual bone surgery system. Image segmentation is used to divide CT scan data into different segments representing various regions of the bone. A region-growing algorithm is used to extract cortical bone and trabecular bone structures systematically and efficiently. Volume modeling is then used to represent the bone geometry based on the CT scan data. Material removal simulation is achieved by continuously performing Boolean subtraction of the surgical tool model from the bone model. A quadtree-based adaptive subdivision technique is developed to handle the large set of data in order to achieve the real-time simulation and visualization required for virtual bone surgery. A Marching Cubes algorithm is used to generate polygonal faces from the volumetric data. Rendering of the generated polygons is performed with the publicly available VTK (Visualization Tool Kit) software. Implementation of the developed techniques consists of developing a virtual bone-drilling software program, which allows the user to manipulate a virtual drill to make holes with the use of a PHANToM™ device on a bone model derived from real CT scan data.

[1]  W. Eric L. Grimson,et al.  Simulating arthroscopic knee surgery using volumetric object representations, real-time volume rendering and haptic feedback , 1997, CVRMed.

[2]  Andreas Baerentzen Volume Sculpting: Intuitive, Interactive 3d Shape Modelling , .

[3]  Anil K. Jain Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[4]  Diego Borro,et al.  Approximation of Optimal Voxel Size for Collision Detection in Maintainability Simulations within Massive Virtual Environments , 2004, Comput. Graph. Forum.

[5]  John Kenneth Salisbury,et al.  A Collaborative Virtual Environment for the Simulation of Temporal Bone Surgery , 2004, MICCAI.

[6]  J A Hobkirk,et al.  Investigation of variable factors in drilling bone. , 1977, Journal of oral surgery.

[7]  Andrea Giachetti,et al.  Real-Time Haptic and Visual Simulation of Bone Dissection , 2002, Presence: Teleoperators & Virtual Environments.

[8]  Dirk Bartz,et al.  Large Model Visualization: Techniques and Applications , 2001, WSCG.

[9]  Daniel Cohen-Or,et al.  Volume graphics , 1993, Computer.

[10]  J. Andreas Bærentzen,et al.  Octree–based Volume Sculpting , 1998 .

[11]  Ming-Chuan Leu,et al.  Bone Surgery Simulation with Virtual Reality , 2003 .

[12]  Arie E. Kaufman,et al.  Volume sculpting , 1995, I3D '95.

[13]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[14]  John F. Hughes,et al.  Sculpting: an interactive volumetric modeling technique , 1991, SIGGRAPH.

[15]  S M Bentzen,et al.  Mechanical strength of tibial trabecular bone evaluated by X-ray computed tomography. , 1987, Journal of biomechanics.

[16]  James C. Miller,et al.  Computer graphics principles and practice, second edition , 1992, Comput. Graph..

[17]  Thomas Ertl,et al.  Computer Graphics - Principles and Practice, 3rd Edition , 2014 .

[18]  Dirk Bartz,et al.  Voxels versus Polygons: A Comparative Approach for Volume Graphics , 2000, Volume Graphics.

[19]  A. Kaufman,et al.  Memory Management of Large Data Sets in Volume Visualization Systems , 2001 .