Augmented Reality in a Tumor Resection Model

Measurements and main results: Augmented Reality (AR) is a technology that can allow a surgeon to see sub-surface structures in an endoscopic video. In our technique, three phases are necessary: Phase 1: segmentation phase: using the MRI images, the kidneys and pseudotumors' surface are delimited to construct a 3D mesh model. Phase 2: the intra-operative shape on the kidney is determined. Phase 3: fusion phase: pre-operative and intraoperative models are fused with the laparoscopic view. This blending gives the impression that the kidney is semitransparent and the surgeon can see the exact location of the tumor inside it.