A Virtual Reality Enhanced Cyber-Human Framework for Orthopedic Surgical Training

This paper discusses the adoption of information-centric systems engineering (ICSE) principles to design a cyber-human systems-based simulator framework to train orthopedic surgery medical residents using haptic and immersive virtual reality platforms; the surgical procedure of interest is a less invasive stabilization system plating surgery that is used to treat fractures of the femur. Developing such training systems is a complex task involving multiple systems, technologies, and human experts. The information-centric approach proposed provides a structured foundation to plan, design, and build the simulators using the ICSE approach; in addition, the information models of the surgical processes were built to capture the surgical complexities and relationships between the various systems/components in the simulator framework, along with the controlling factors, performing mechanisms, and decision outcomes at various levels of abstraction. The simulator platforms include a haptic-based training system and a fully immersive training system for six training environments. Next-generation networking principles were adopted to support the collaborative training activities within this framework. As part of the proposed approach, expert surgeons played an important role in the design of the training environments. The outcomes of the learning assessment conducted demonstrate the effectiveness of using such simulator-based cyber-human training frameworks.

[1]  Christopher J. Martin,et al.  Virtual reality simulators: Current status in acquisition and assessment of surgical skills , 2002, ANZ journal of surgery.

[2]  William R. Edwards A systems engineering primer for every engineer and scientist , 2001 .

[3]  Yueshan Xiong,et al.  Key techniques of haptic related computation in virtual liver surgery , 2015, 2015 8th International Conference on Biomedical Engineering and Informatics (BMEI).

[4]  Subhash C. Kak,et al.  Information Centric Frameworks for Micro Assembly , 2011, OTM Workshops.

[5]  Tao Wang,et al.  A geometric modeling method based on OpenGL in virtual gallbladder surgery , 2013 .

[6]  Bradley N. Doebbeling,et al.  Applying Systems Engineering Principles in Improving Health Care Delivery , 2007, Journal of General Internal Medicine.

[7]  Irem Y. Tumer,et al.  Model-Based Systems Engineering for the Design and Development of Complex Aerospace Systems , 2011 .

[8]  Giuditta Pezzotta,et al.  Product-Service Systems Engineering: State of the art and research challenges , 2012, Comput. Ind..

[9]  Andrew P. Sage,et al.  Modeling and Simulation in Systems Engineering , 2001, Simul..

[10]  Ming-Dar Tsai,et al.  Bone drilling haptic interaction for orthopedic surgical simulator , 2007, Comput. Biol. Medicine.

[11]  Thomas A. DeFanti,et al.  Haptics-based virtual reality periodontal training simulator , 2009, Virtual Reality.

[12]  W. L. Heinrichs,et al.  Design, Development, and Evaluation of an Online Virtual Emergency Department for Training Trauma Teams , 2008, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[13]  Kristina Lerman,et al.  Autonomous Robots manuscript No. (will be inserted by the editor) Top–Down vs Bottom–up Methodologies in Multi–Agent System Design , 2022 .

[14]  Korris Fu-Lai Chung,et al.  A virtual training simulator for learning cataract surgery with phacoemulsification , 2009, Comput. Biol. Medicine.

[15]  Lucian Panait,et al.  The role of haptic feedback in laparoscopic simulation training. , 2009, The Journal of surgical research.

[16]  Parameswaran Ramanathan,et al.  A distributed collaborative simulation environment for orthopedic surgical training , 2017, 2017 Annual IEEE International Systems Conference (SysCon).

[17]  Keith Kirkpatrick,et al.  Software-defined networking , 2013, CACM.

[18]  Joe Cecil,et al.  An Information Model for Designing Virtual Environments for Orthopedic Surgery , 2013, OTM Workshops.

[19]  A. D. Hall,et al.  Three-Dimensional Morphology of Systems Engineering , 1969, IEEE Trans. Syst. Sci. Cybern..

[20]  J Cecil TAMIL: an integrated fixture design system for prismatic parts , 2004, Int. J. Comput. Integr. Manuf..

[21]  Douglas L. Jones,et al.  Towards a Medical Virtual Reality Environment for Minimally Invasive Cardiac Surgery , 2008, MIAR.

[22]  Ruxu Du,et al.  A new dynamic model for drilling and reaming processes , 2002 .

[23]  Andreas Pommert,et al.  Virtual reality: A new paranasal sinus surgery simulator , 2009, The Laryngoscope.

[24]  Jean-Yves Choley,et al.  SafeSysE: A Safety Analysis Integration in Systems Engineering Approach , 2018, IEEE Systems Journal.

[25]  Tien-Tsin Wong,et al.  A Novel Modeling Framework for Multilayered Soft Tissue Deformation in Virtual Orthopedic Surgery , 2010, Journal of Medical Systems.

[26]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[27]  Daniel B. Jones,et al.  Comparison of video trainer and virtual reality training systems on acquisition of laparoscopic skills , 2002, Surgical Endoscopy And Other Interventional Techniques.

[28]  Jørgen Lindskov Knudsen,et al.  A new virtual reality approach for planning of cardiac interventions , 2001, Artif. Intell. Medicine.

[29]  Kevin Kunkler,et al.  The role of medical simulation: an overview , 2006, The international journal of medical robotics + computer assisted surgery : MRCAS.

[30]  Petra Winzer,et al.  Generic System Description and Problem Solving in Systems Engineering , 2017, IEEE Systems Journal.

[31]  J. Dankelman,et al.  Transfer validity of laparoscopic knot-tying training on a VR simulator to a realistic environment: A randomized controlled trial , 2008, Surgical Endoscopy.

[32]  Sadiq Albuhamood,et al.  An Advanced Cyber Physical Framework for Micro Devices Assembly , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[33]  Joe Cecil,et al.  An advanced simulator for orthopedic surgical training , 2018, International Journal of Computer Assisted Radiology and Surgery.

[34]  J L Rees,et al.  Transferring simulated arthroscopic skills to the operating theatre: a randomised blinded study. , 2008, The Journal of bone and joint surgery. British volume.

[35]  Ming-Dar Tsai,et al.  Virtual Reality Facial Contouring Surgery Simulator Based on CT Transversal Slices , 2011, 2011 5th International Conference on Bioinformatics and Biomedical Engineering.

[36]  Suvranu De,et al.  Hierarchical Task Analysis of Hybrid Rigid Scope Natural Orifice Translumenal Endoscopic Surgery (NOTES) Cholecystectomy Procedures , 2013, MMVR.

[37]  Edgar C. Smith Simulation in Systems Engineering , 1962, IBM Syst. J..

[38]  Akihiro Nakao,et al.  GENI: A federated testbed for innovative network experiments , 2014, Comput. Networks.

[39]  Joe Cecil,et al.  An Internet of Things (IoT)-based collaborative framework for advanced manufacturing , 2015, The International Journal of Advanced Manufacturing Technology.

[40]  James D Watterson,et al.  Randomized prospective blinded study validating acquistion of ureteroscopy skills using computer based virtual reality endourological simulator. , 2002, The Journal of urology.

[41]  Diego Borro,et al.  A Brain Surgery Simulator , 2014, IEEE Computer Graphics and Applications.

[42]  Jürgen P. Schulze,et al.  Oculus Rift with Stereo Camera for Augmented Reality Medical Intubation Training , 2017 .

[43]  Andrew J. Schaefer,et al.  Determining the Acceptance of Cadaveric Livers Using an Implicit Model of the Waiting List , 2007, Oper. Res..

[44]  Jauvane C. de Oliveira,et al.  VELVET: An Adaptive Hybrid Architecture for Very Large Virtual Environments , 2002, Presence: Teleoperators & Virtual Environments.

[45]  Ramón Cáceres,et al.  Ubicomp Systems at 20: Progress, Opportunities, and Challenges , 2012, IEEE Pervasive Computing.

[46]  J. Yu,et al.  Development of a Virtual Reality Based Simulation Environment for Orthopedic Surgical Training , 2016, OTM Workshops.

[47]  L. Hedman,et al.  Systematic Video Game Training in Surgical Novices Improves Performance in Virtual Reality Endoscopic Surgical Simulators: A Prospective Randomized Study , 2009, World Journal of Surgery.

[48]  Nadia A Tepper Exploring the use of Model-Based Systems Engineering (MBSE) to develop systems architectures in naval ship design , 2010 .

[49]  Xiaohua Xia,et al.  When to initiate HIV therapy: a control theoretic approach , 2003, IEEE Transactions on Biomedical Engineering.

[50]  Christian Hansen,et al.  New dimensions in surgical training: immersive virtual reality laparoscopic simulation exhilarates surgical staff , 2017, Surgical Endoscopy.

[51]  Sudanthi N. R. Wijewickrema,et al.  Design and Evaluation of a Virtual Reality Simulation Module for Training Advanced Temporal Bone Surgery , 2017, 2017 IEEE 30th International Symposium on Computer-Based Medical Systems (CBMS).

[52]  James Lyle Peterson,et al.  Petri net theory and the modeling of systems , 1981 .

[53]  Joe Cecil,et al.  A cyber training framework for orthopedic surgery , 2017 .

[54]  Ashis Jalote-Parmar,et al.  Workflow Integration Matrix: a framework to support the development of surgical information systems , 2008 .

[55]  Ronei Marcos de Moraes,et al.  Interactive collaboration for Virtual Reality systems related to medical education and training , 2011 .

[56]  Joe Cecil,et al.  An information centric framework for creating virtual environments to support micro surgery , 2015 .

[57]  A. Langella,et al.  A torque and thrust prediction model for drilling of composite materials , 2005 .

[58]  Rajesh Aggarwal,et al.  A tale of two trainers: virtual reality versus a video trainer for acquisition of basic laparoscopic skills. , 2010, American journal of surgery.

[59]  Albert J. Shih,et al.  An analytical finite element technique for predicting thrust force and torque in drilling , 2004 .

[60]  John Kenneth Salisbury,et al.  Haptic Feedback Enhances Force Skill Learning , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[61]  Dieter Schmalstieg,et al.  Integration of the HTC Vive into the medical platform MeVisLab , 2017, Medical Imaging.

[62]  Richard J. Mayer,et al.  IDEF Family of Methods for Concurrent Engineering and Business Re-engineering Applications , 1994 .