The next step: intelligent digital assistance for clinical operating rooms

Abstract With the emergence of new technologies, the surgical working environment becomes increasingly complex and comprises many medical devices that have to be taken cared of. However, the goal is to reduce the workload of the surgical team to allow them to fully focus on the actual surgical procedure. Therefore, new strategies are needed to keep the working environment manageable. Existing research projects in the field of intelligent medical environments mostly concentrate on workflow modeling or single smart features rather than building up a complete intelligent environment. In this article, we present the concept of intelligent digital assistance for clinical operating rooms (IDACO), providing the surgeon assistance in many different situations before and during an ongoing procedure using natural spoken language. The speech interface enables the surgeon to concentrate on the surgery and control the technical environment at the same time, without taking care of how to interact with the system. Furthermore, the system observes the context of the surgery and controls several devices autonomously at the appropriate time during the procedure.

[1]  Alexander Schmitt,et al.  OwlSpeak - adaptive spoken dialogue within Intelligent Environments , 2010, 2010 8th IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops).

[2]  Wolfgang Minker,et al.  Managing adaptive spoken dialogue for Intelligent Environments , 2014, J. Ambient Intell. Smart Environ..

[3]  Satoshi Nakamura,et al.  Cultural Communication Idiosyncrasies in Human-Computer Interaction , 2016, SIGDIAL Conference.

[4]  H. Feußner,et al.  Minimalinvasive Chirurgie und „robotic surgery“: Chirurgie 4.0? , 2016, Der Chirurg.

[5]  H. Feußner.  The Operating Room of the Future: A View from Europe , 2003, Seminars in laparoscopic surgery.

[6]  H. Feußner,et al.  Technische und digitale Weiterentwicklung in der laparoskopischen/offenen Chirurgie , 2014, Der Chirurg.

[7]  Joanne Pransky,et al.  An intelligent operating room of the future – an interview with the University of California Los Angeles Medical Center , 2001 .

[8]  Martin S. Karpeh,et al.  Digital communications and social media use in surgery: how to maximize communication in the digital age , 2017, Innovative surgical sciences.

[9]  Diane J. Litman,et al.  Evaluating a Spoken Dialogue System that Detects and Adapts to User Affective States , 2014, SIGDIAL Conference.

[10]  A. Knoll,et al.  Toward increased autonomy in the surgical OR: needs, requests, and expectations , 2013, Surgical Endoscopy.

[11]  Niels Ole Bernsen,et al.  Evaluation and usability of multimodal spoken language dialogue systems , 2004, Speech Commun..