Medical Imaging and Augmented Reality

Orthognathic surgery is a surgical procedure to correct jaw deformities. It requires extensive presurgical planning. We developed a novel computeraided surgical simulation (CASS) system, the AnatomicAligner, for doctors planning the entire orthognathic surgical procedure in computer following our streamlined clinical protocol. The computerized plan can be transferred to the patient at the time of surgery using digitally designed surgical splints. The system includes six modules: image segmentation and three-dimensional (3D) model reconstruction; registration and reorientation of the models to neutral head posture (NHP) space, 3D cephalometric analysis, virtual osteotomy, surgical simulation, and surgical splint designing. The system has been validated using the 5 sets of patient’s datasets. The AnatomicAligner system will be soon available freely to the broader clinical and research communities.

[1]  D J Berry,et al.  Early experience and results with the periacetabular osteotomy. The Mayo Clinic experience. , 1999, Clinical orthopaedics and related research.

[2]  R. Rosenfeld,et al.  Ethics , 2008 .

[3]  Russell H. Taylor,et al.  Development of a biomechanical guidance system for periacetabular osteotomy , 2015, International Journal of Computer Assisted Radiology and Surgery.

[4]  Neil D. Glossop,et al.  Laser projection augmented reality system for computer-assisted surgery , 2003, CARS.

[5]  Chengwen Chu,et al.  MASCG: Multi-Atlas Segmentation Constrained Graph method for accurate segmentation of hip CT images , 2015, Medical Image Anal..

[6]  Guoyan Zheng,et al.  Comparison of 2.5D and 3D Quantification of Femoral Head Coverage in Normal Control Subjects and Patients with Hip Dysplasia , 2015, PloS one.

[7]  R. Arnheim.  Art and visual perception: A psychology of the creative eye, New version , 1955 .

[8]  H. Przuntek,et al.  Facial expression recognition in people with medicated and unmedicated Parkinson’s disease , 2003, Neuropsychologia.

[9]  D. Murray.  The definition and measurement of acetabular orientation. , 1993, The Journal of bone and joint surgery. British volume.

[10]  Jong-Il Park,et al.  Surface-Independent Direct-Projected Augmented Reality , 2006, ACCV.

[11]  Yu-Han Chang,et al.  Image-guided periacetabular osteotomy: computer-assisted navigation compared with the conventional technique: A randomized study of 36 patients followed for 2 years , 2006, Acta orthopaedica.

[12]  D. Louis Collins,et al.  An analysis of tracking error in image-guided neurosurgery , 2014, International Journal of Computer Assisted Radiology and Surgery.

[13]  Cameron N. Riviere,et al.  Inexpensive monocular pico-projector-based augmented reality display for surgical microscope , 2012, 2012 25th IEEE International Symposium on Computer-Based Medical Systems (CBMS).

[14]  H. Ellgring,et al.  Spontaneous and posed facial expression in Parkinson's Disease , 1996, Journal of the International Neuropsychological Society.

[15]  D. Louis Collins,et al.  Augmented reality in neurovascular surgery: feasibility and first uses in the operating room , 2015, International Journal of Computer Assisted Radiology and Surgery.

[16]  Andrew Zisserman,et al.  Multiple View Geometry , 1999 .

[17]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Guang-Zhong Yang,et al.  Pico Lantern: A Pick-up Projector for Augmented Reality in Laparoscopic Surgery , 2014, MICCAI.

[19]  D. Louis Collins,et al.  Improving Patient Specific Neurosurgical Models with Intraoperative Ultrasound and Augmented Reality Visualizations in a Neuronavigation Environment , 2015, CLIP@MICCAI.

[20]  Peter Anderson,et al.  Method for estimating dynamic EM tracking accuracy of surgical navigation tools , 2006, SPIE Medical Imaging.

[21]  S B Murphy,et al.  The prognosis in untreated dysplasia of the hip. A study of radiographic factors that predict the outcome. , 1995, The Journal of bone and joint surgery. American volume.

[22]  A. Young,et al.  Disgust implicated in obsessive–compulsive disorder , 1997, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[23]  Li Liu,et al.  Computer Assisted Planning and Navigation of Periacetabular Osteotomy with Range of Motion Optimization , 2014, MICCAI.

[24]  Gabriel Taubin,et al.  Simple, Accurate, and Robust Projector-Camera Calibration , 2012, 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission.

[25]  T. Mieno,et al.  Determination of acetabular coverage of the femoral head with use of a single anteroposterior radiograph. A new computerized technique. , 1993, The Journal of bone and joint surgery. American volume.

[26]  Leila Besharati Tabrizi,et al.  A novel augmented reality system of image projection for image-guided neurosurgery , 2013, Acta Neurochirurgica.

[27]  M. Tannast,et al.  Femoral Morphology Differs Between Deficient and Excessive Acetabular Coverage , 2008, Clinical orthopaedics and related research.

[28]  J L Moctezuma,et al.  Intraoperative visualization of surgical planning data using video projectors. , 2001, Studies in health technology and informatics.

[29]  Leila Besharati Tabrizi,et al.  Augmented reality-guided neurosurgery: accuracy and intraoperative application of an image projection technique. , 2015, Journal of neurosurgery.

[30]  S B Murphy,et al.  Surgical correction of acetabular dysplasia in the adult. A Boston experience. , 1999, Clinical orthopaedics and related research.

[31]  R. Ganz,et al.  Anterior femoroacetabular impingement after periacetabular osteotomy. , 1999, Clinical orthopaedics and related research.

[32]  R. Ganz,et al.  A new periacetabular osteotomy for the treatment of hip dysplasias. Technique and preliminary results. , 1988, Clinical orthopaedics and related research.

[33]  M B Millis,et al.  Bernese Periacetabular Osteotomy in Males: Is There an Increased Risk of Femoroacetabular Impingement (FAI) After Bernese Periacetabular Osteotomy? , 2011, Clinical orthopaedics and related research.

[34]  Steven L. Hartmann,et al.  Spinal Navigation and Imaging: History, Trends, and Future , 2015, IEEE Transactions on Medical Imaging.

[35]  F Langlotz,et al.  Computer Assistance for Pelvic Osteotomies , 1998, Clinical orthopaedics and related research.

[36]  Daniel Bia,et al.  [Regional differences in viscosity, elasticity and wall buffering function in systemic arteries: pulse wave analysis of the arterial pressure-diameter relationship]. , 2005, Revista espanola de cardiologia.

[37]  Selene G. Parekh,et al.  The Bernese Periacetabular Osteotomy: A Review of Surgical Technique , 2010 .

[38]  U. Mezger,et al.  Navigation in surgery , 2013, Langenbeck's Archives of Surgery.

[39]  A. Leong-Hoï,et al.  Three-dimensional surface reconstruction by combining a pico-digital projector for structured light illumination and an imaging system with high magnification and high depth of field , 2014, Photonics Europe.

[40]  Dongmei Jiang,et al.  Objectifying Facial Expressivity Assessment of Parkinson's Patients: Preliminary Study , 2014, Comput. Math. Methods Medicine.

[41]  S B Murphy,et al.  Planning acetabular redirection osteotomies based on joint contact pressures. , 1999, Clinical orthopaedics and related research.

[42]  Guoyan Zheng,et al.  A hybrid CT-free navigation system for total hip arthroplasty. , 2002, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[43]  Lixu Gu,et al.  A robust automated markerless registration framework for neurosurgery navigation , 2015, The international journal of medical robotics + computer assisted surgery : MRCAS.

[44]  Takahiro Hoshino,et al.  Disgust-specific impairment of facial expression recognition in Parkinson's disease. , 2006, Brain : a journal of neurology.