Virtual reality and 3D printing improve preoperative visualization of 3D liver reconstructions—results from a preclinical comparison of presentation modalities and user’s preference

Background Preoperative three-dimensional (3D) reconstructions for liver surgery planning have been shown to be effective in reduction of blood loss and operation time. However, the role of the 'presentation modality' is not well investigated. We present the first study to compare 3D PDFs, 3D printed models (PR) and virtual reality (VR) 3D models with regard to anatomical orientation and personal preferences in a high volume liver surgery center. Methods Thirty participants, 10 medical students, 10 residents, 5 fellows and 5 hepatopancreatobiliary (HPB) experts, assigned the tumor-bearing segments of 20 different patient's individual liver reconstructions. Liver models were presented in a random order in all modalities. Time needed to specify the tumor location was recorded. In addition, a score was calculated factoring in correct, wrong and missing segment assignments. Furthermore, standardized test/questionnaires for spatial thinking and seeing, vegetative side effects and usability were completed. Results Participants named significantly more correct segments in VR (P=0.040) or PR (P=0.036) compared to PDF. Tumor assignment was significantly shorter with 3D PR models compared to 3D PDF (P<0.001) or VR application (P<0.001). Regardless of the modality, HPB experts were significantly faster (24±8 vs. 35±11 sec; P=0.014) and more often correct (0.87±0.12 vs. 0.83±0.15; P<0.001) than medical students. Test results for spatial thinking and seeing had no influence on time but on correctness of tumor assignment. Regarding usability and user experience the VR application achieved the highest scores without causing significant vegetative symptoms and was also the most preferred method (n=22, 73.3%) because of the multiple functions like scaling and change of transparency. Ninety percent (n=27) stated that this application can positively influence the operation planning. Conclusions 3D PR models and 3D VR models enable a better and partially faster anatomical orientation than reconstructions presented as 3D PDFs. User's preferred the VR application over the PR models and PDF. A prospective trial is needed to evaluate the different presentation modalities regarding intra- and postoperative outcomes.

[1]  James T. Miller,et al.  An Empirical Evaluation of the System Usability Scale , 2008, Int. J. Hum. Comput. Interact..

[2]  Robert S. Kennedy,et al.  Simulator Sickness Questionnaire: An enhanced method for quantifying simulator sickness. , 1993 .

[3]  Rui Yao,et al.  Three-dimensional printing: review of application in medicine and hepatic surgery , 2016, Cancer biology & medicine.

[4]  Dushyant V. Sahani,et al.  Vascular and biliary variants in the liver: implications for liver surgery. , 2008, Radiographics : a review publication of the Radiological Society of North America, Inc.

[5]  G. Fichtinger,et al.  Utility of 3D Reconstruction of 2D Liver Computed Tomography/Magnetic Resonance Images as a Surgical Planning Tool for Residents in Liver Resection Surgery. , 2017, Journal of surgical education.

[6]  Stefan Weber,et al.  Intraoperative image-guided navigation system: development and applicability in 65 patients undergoing liver surgery , 2016, Langenbeck's Archives of Surgery.

[7]  H. Lang,et al.  Experiences With Three-dimensional Printing in Complex Liver Surgery , 2020, Annals of surgery.

[8]  Jan J. Koenderink,et al.  Haptic perception disambiguates visual perception of 3D shape , 2009, Experimental Brain Research.

[9]  G. Tsoulfas,et al.  Role of innovative 3D printing models in the management of hepatobiliary malignancies , 2019, World journal of hepatology.

[10]  M. Sugimoto,et al.  Intraoperative 3D Hologram Support With Mixed Reality Techniques in Liver Surgery. , 2019, Annals of surgery.

[11]  Heinz-Otto Peitgen,et al.  Impact of virtual tumor resection and computer-assisted risk analysis on operation planning and intraoperative strategy in major hepatic resection. , 2005, Archives of surgery.

[12]  F. Auricchio,et al.  An overview on 3D printing for abdominal surgery , 2020, Surgical Endoscopy.

[13]  I. Sauer,et al.  Mixed Reality in Visceral Surgery: Development of a Suitable Workflow and Evaluation of Intraoperative Use-cases , 2017, Annals of surgery.

[14]  Chi-hua Fang,et al.  Impact of three-dimensional reconstruction technique in the operation planning of centrally located hepatocellular carcinoma. , 2015, Journal of the American College of Surgeons.

[15]  Yukio Oshiro,et al.  Three-Dimensional Liver Surgery Simulation: Computer-Assisted Surgical Planning with Three-Dimensional Simulation Software and Three-Dimensional Printing. , 2017, Tissue engineering. Part A.

[16]  N. Hibino,et al.  Virtual Reality in Neurointervention. , 2018, Journal of vascular and interventional neurology.

[17]  C. Fang,et al.  [Application of 3D visualization and 3D printing in individualized precision surgery for Bismuth-Corlette type Ⅲ and Ⅳ hilar cholangiocarcinoma]. , 2020, Nan fang yi ke da xue xue bao = Journal of Southern Medical University.

[18]  H P Meinzer,et al.  The impact of 3-dimensional reconstructions on operation planning in liver surgery. , 2000, Archives of surgery.

[19]  Jianyi Li,et al.  Do 3D Printing Models Improve Anatomical Teaching About Hepatic Segments to Medical Students? A Randomized Controlled Study , 2016, World Journal of Surgery.

[20]  S. Irtan,et al.  Preoperative 3D reconstruction images for paediatric tumours: Advantages and drawbacks , 2020, Pediatric blood & cancer.

[21]  Martin Schrepp,et al.  Construction of a Benchmark for the User Experience Questionnaire (UEQ) , 2017, Int. J. Interact. Multim. Artif. Intell..

[22]  C. Heidecke,et al.  Randomized study of the influence of two-dimensional versus three-dimensional imaging using a novel 3D head-mounted display (HMS-3000MT) on performance of laparoscopic inguinal hernia repair , 2018, Surgical Endoscopy.

[23]  V. Vilgrain,et al.  Consensus recommendations of three-dimensional visualization for diagnosis and management of liver diseases , 2020, Hepatology International.

[24]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[25]  L. Soler,et al.  3D virtual reality and selective vascular control for laparoscopic left hepatic lobectomy , 2009, Surgical Endoscopy.

[26]  B. Preim,et al.  VR-basierte Interaktion mit 3D-Organmodellen zur Planung und Simulation laparoskopischer Eingriffe , 2018 .

[27]  Bernhard Preim,et al.  Collaborative Virtual Reality for Laparoscopic Liver Surgery Training , 2019, 2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR).

[28]  Heinz-Otto Peitgen,et al.  Improved assessment of functional resectability in repeated hepatectomy by computer-assisted operation planning. , 2005, Hepato-gastroenterology.

[29]  L Soler,et al.  [Image fusion, virtual reality, robotics and navigation. Effects on surgical practice]. , 2002, Der Chirurg; Zeitschrift fur alle Gebiete der operativen Medizen.

[30]  C. Hansen,et al.  Using virtual 3D-models in surgical planning: workflow of an immersive virtual reality application in liver surgery , 2021, Langenbeck's Archives of Surgery.

[31]  H. Lang,et al.  Local, semi-automatic, three-dimensional liver reconstruction or external provider? An analysis of performance and time expense , 2020, Langenbeck's Archives of Surgery.

[32]  Bernhard Preim,et al.  Analysis of vasculature for liver surgical planning , 2002, IEEE Transactions on Medical Imaging.

[33]  J R Merril,et al.  Surgical simulation using virtual reality technology: design, implementation, and implications. , 1994, Surgical technology international.

[34]  Martin Schrepp,et al.  Construction and Evaluation of a User Experience Questionnaire , 2008, USAB.

[35]  Tianyou Yang,et al.  Impact of 3D printing technology on the comprehension of surgical liver anatomy , 2018, Surgical Endoscopy.

[36]  T. Aloia Extending the Limits of Resection for Colorectal Liver Metastases: Bilateral Disease , 2016, Journal of Gastrointestinal Surgery.

[37]  Jiahong Dong,et al.  The Use of Three-Dimensional Printing Model in the Training of Choledochoscopy Techniques , 2018, World Journal of Surgery.

[38]  Lars Konge,et al.  Three-dimensional versus two-dimensional vision in laparoscopy: a systematic review , 2015, Surgical Endoscopy.