Application of an RGBD augmented C-arm for minimally invasive scoliosis surgery assistance

Minimally invasive surgeries (MISs) are gaining popularity as alternatives to conventional open surgeries. In thoracoscopic scoliosis MIS, fluoroscopy is used to guide pedicle screw placement and to visualise the effect of the intervention on the spine curvature. However, cosmetic external appearance is the most important concern for patients, while correction of the spine and achieving coronal and sagittal trunk balance are the top priorities for surgeons. The authors present the feasibility study of the first intra-operative assistive system for scoliosis surgery composed of a single RGBD camera affixed on a C-arm which allows visualising in real time the surgery effects on the patient trunk surface in the transverse plane. They perform three feasibility experiments from simulated data based on scoliotic patients to live acquisition from non-scoliotic mannequin and person, all showing that the proposed system accuracy is comparable with scoliotic surface reconstruction state of art.

[1]  Eva R. Helgeson,et al.  A prospective randomized comparison of laparoscopic appendectomy with open appendectomy: Clinical and economic analyses. , 2001, Surgery.

[2]  J. Birch,et al.  Do You See What I See? Looking at Scoliosis Surgical Outcomes Through Orthopedists’ Eyes , 2003, Spine.

[3]  Nicholas Ayache,et al.  3D reconstruction of the human spine from radiograph(s) using a multi-body statistical model , 2009, Medical Imaging.

[4]  P. Newton,et al.  Thoracoscopic Deformity Correction , 2009 .

[5]  P. Patias,et al.  A review of the trunk surface metrics used as Scoliosis and other deformities evaluation indices , 2010, Scoliosis.

[6]  F. Cheriet,et al.  Multilevel Analysis of Trunk Surface Measurements for Noninvasive Assessment of Scoliosis Deformities , 2012, Spine.

[7]  Lejing Wang,et al.  First Deployments of Augmented Reality in Operating Rooms , 2012, Computer.

[8]  Shahram Izadi,et al.  Modeling Kinect Sensor Noise for Improved 3D Reconstruction and Tracking , 2012, 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission.

[9]  Sergio Escalera,et al.  Automatic digital biometry analysis based on depth maps , 2013, Comput. Ind..

[10]  Farida Cheriet,et al.  Noninvasive Clinical Assessment of Trunk Deformities Associated With Scoliosis , 2013, IEEE Journal of Biomedical and Health Informatics.

[11]  R. Lyon,et al.  Historical review and experience with the use of surface topographic systems in children with idiopathic scoliosis , 2013 .

[12]  F. Cheriet,et al.  Changes in Trunk Appearance After Scoliosis Spinal Surgery and Their Relation to Changes in Spinal Measurements , 2015, Spine deformity.

[13]  Nassir Navab,et al.  RGBDX: First Design and Experimental Validation of a Mirror-Based RGBD X-ray Imaging System , 2015, 2015 IEEE International Symposium on Mixed and Augmented Reality.

[14]  Gentiane Venture,et al.  Automatic estimate of back anatomical landmarks and 3D spine curve from a Kinect sensor , 2016, 2016 6th IEEE International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[15]  Slobodan Ilic,et al.  X-Tag: A Fiducial Tag for Flexible and Accurate Bundle Adjustment , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[16]  J. Tavares,et al.  Non-invasive methods of computer vision in the posture evaluation of adolescent idiopathic scoliosis. , 2016, Journal of bodywork and movement therapies.

[17]  António H. J. Moreira,et al.  Evaluation of spinal posture using Microsoft Kinect™: A preliminary case‐study with 98 volunteers , 2017, Porto biomedical journal.