Towards a video quality assessment based framework for enhancement of laparoscopic videos

Laparoscopic videos can be affected by different distortions which may impact the performance of surgery and introduce surgical errors. In this work, we propose a framework for automatically detecting and identifying such distortions and their severity using video quality assessment. There are three major contributions presented in this work (i) a proposal for a novel video enhancement framework for laparoscopic surgery; (ii) a publicly available database for quality assessment of laparoscopic videos evaluated by expert as well as non-expert observers and (iii) objective video quality assessment of laparoscopic videos including their correlations with expert and non-expert scores.

[1]  Luc Soler,et al.  The status of augmented reality in laparoscopic surgery as of 2016 , 2017, Medical Image Anal..

[2]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[3]  ITU-T Rec. P.910 (04/2008) Subjective video quality assessment methods for multimedia applications , 2009 .

[4]  Pablo Lamata,et al.  Laparoscopic video analysis for training and image-guided surgery , 2011, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[5]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.

[6]  Mohamed A. Deriche,et al.  Towards the design of a consistent image contrast enhancement evaluation measure , 2017, Signal Process. Image Commun..

[7]  Philippe Cinquin,et al.  Automatic Detection of Instruments in Laparoscopic Images: A First Step Towards High-level Command of Robotic Endoscopic Holders , 2007, The First IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics, 2006. BioRob 2006..

[8]  Stefan Winkler,et al.  Analysis of Public Image and Video Databases for Quality Assessment , 2012, IEEE Journal of Selected Topics in Signal Processing.

[9]  Nikolay N. Ponomarenko,et al.  Image database TID2013: Peculiarities, results and perspectives , 2015, Signal Process. Image Commun..

[10]  John Immerkær,et al.  Fast Noise Variance Estimation , 1996, Comput. Vis. Image Underst..

[11]  Mohamed A. Deriche,et al.  A hybrid system for distortion classification and image quality evaluation , 2012, Signal Process. Image Commun..

[12]  Alan C. Bovik,et al.  Image information and visual quality , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[13]  Masimba Nyandowe,et al.  Technical problems during laparoscopy: a systematic method of troubleshooting for surgeons , 2017, Innovative surgical sciences.

[14]  Rüdiger Dillmann,et al.  Real-time image-based instrument classification for laparoscopic surgery , 2018, ArXiv.

[15]  J. Dankelman,et al.  Problems with technical equipment during laparoscopic surgery , 2007, Surgical Endoscopy.

[16]  Danail Stoyanov,et al.  Vision‐based and marker‐less surgical tool detection and tracking: a review of the literature , 2017, Medical Image Anal..

[17]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[18]  Klaus Schöffmann,et al.  Real-Time Image-based Smoke Detection in Endoscopic Videos , 2017, ACM Multimedia.

[19]  Alan C. Bovik,et al.  A Completely Blind Video Integrity Oracle , 2016, IEEE Transactions on Image Processing.

[20]  Azeddine Beghdadi,et al.  A new reference-free image quality index for blur estimation in the frequency domain , 2009, 2009 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT).

[21]  Andru Putra Twinanda,et al.  EndoNet: A Deep Architecture for Recognition Tasks on Laparoscopic Videos , 2016, IEEE Transactions on Medical Imaging.

[22]  Shahram Payandeh,et al.  Visual Tracking of Laparoscopic Instruments , 2014 .