Computer‐based endoscopic image‐processing technology for endourology and laparoscopic surgery

Endourology and laparoscopic surgery are evolving in accordance with developments in instrumentation and progress in surgical technique. Recent advances in computer and image‐processing technology have enabled novel images to be created from conventional endoscopic and laparoscopic video images. Such technology harbors the potential to advance endourology and laparoscopic surgery by adding new value and function to the endoscope. The panoramic and three‐dimensional images created by computer processing are two outstanding features that can address the shortcomings of conventional endoscopy and laparoscopy, such as narrow field of view, lack of depth cue, and discontinuous information. The wide panoramic images show an anatomical ‘map’ of the abdominal cavity and hollow organs with high brightness and resolution, as the images are collected from video images taken in a close‐up manner. To assist in laparoscopic surgery, especially in suturing, a three‐dimensional movie can be obtained by enhancing movement parallax using a conventional monocular laparoscope. In tubular organs such as the prostatic urethra, reconstruction of three‐dimensional structure can be achieved, implying the possibility of a liquid dynamic model for assessing local urethral resistance in urination. Computer‐based processing of endoscopic images will establish new tools for endourology and laparoscopic surgery in the near future.

[1]  A. Goh,et al.  Optical coherence tomography as an adjunct to white light cystoscopy for intravesical real-time imaging and staging of bladder cancer. , 2007, Urology.

[2]  J. Platt,et al.  Bladder tumor detection at virtual cystoscopy. , 2001, Radiology.

[3]  G. Bartsch,et al.  Dynamic Transurethral Sonography and 3‐Dimensional Reconstruction of the Rhabdosphincter and Urethra , 2006, Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine.

[4]  T. Yamanishi,et al.  Relationship between bladder neck diameter and hydraulic energy at maximum flow. , 1994, The Journal of urology.

[5]  A. Prando.  CT-virtual endoscopy of the urinary tract. , 2002, International braz j urol : official journal of the Brazilian Society of Urology.

[6]  A J Aschoff,et al.  Virtual cystoscopy based on helical CT scan datasets: perspectives and limitations. , 1998, The British journal of radiology.

[7]  Takayuki Okatani,et al.  Shape Reconstruction from an Endoscope Image by Shape from Shading Technique for a Point Light Source at the Projection Center , 1997, Comput. Vis. Image Underst..

[8]  Bin Li,et al.  A novel approach to extract colon lumen from CT images for virtual colonoscopy , 2000, IEEE Transactions on Medical Imaging.

[9]  Terry M. Peters,et al.  Real-time fusion of endoscopic views with dynamic 3-D cardiac images: a phantom study , 2005, IEEE Transactions on Medical Imaging.

[10]  S. Nishida,et al.  Human Visual System Integrates Color Signals along a Motion Trajectory , 2007, Current Biology.

[11]  Y. Choi,et al.  The overlooked cause of benign prostatic hyperplasia: prostatic urethral angulation. , 2008, Medical hypotheses.

[12]  Shouhua Luo,et al.  Virtual Laryngoscopy: a Noninvasive Tool for the Assessment of Laryngeal Tumor Extent , 2007, The Laryngoscope.

[13]  S. Bhat,et al.  Virtual cystoscopy by intravesical instillation of dilute contrast medium: preliminary experience. , 2006, The Journal of urology.

[14]  Y Kubota,et al.  Computerized tomographic ureteroscopy for diagnosing ureteral tumors. , 2000, The Journal of urology.

[15]  Ron Kikinis,et al.  Tumor detection by virtual cystoscopy with color mapping of bladder wall thickness. , 2002, The Journal of urology.

[16]  H Feussner,et al.  Three-dimensional navigated laparoscopic ultrasonography: first experiences with a new minimally invasive diagnostic device. , 2001, Surgical endoscopy.

[17]  K Miyasaka,et al.  Virtual endoscopy of coronary arteries using contrast-enhanced ECG-triggered electron beam CT data sets. , 2000, AJR. American journal of roentgenology.

[18]  Philippe C. Cattin,et al.  Endoscopic navigation for minimally invasive suturing , 2008, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[19]  Osamu Ukimura,et al.  Intraoperative ultrasonography in an era of minimally invasive urology , 2008, International journal of urology : official journal of the Japanese Urological Association.

[20]  R. Clayman,et al.  Comparison of three-dimensional and two-dimensional laparoscopic video systems. , 1996, Journal of endourology.

[21]  M. Hori,et al.  Laparoscopic lymph node dissection for gastric cancer with intraoperative navigation using three-dimensional angio computed tomography images reconstructed as laparoscopic view , 2003, Surgical Endoscopy And Other Interventional Techniques.

[22]  M. Buscarini,et al.  Update on Flexible Ureteroscopy , 2008, Urologia Internationalis.

[23]  I. Narabayashi,et al.  Virtual CT colectomy by three-dimensional imaging using multidetector-row CT for laparoscopic colorectal surgery , 2005, Abdominal Imaging.

[24]  Kazuhiro Araki,et al.  Usefulness of panoramic views for novice surgeons doing retroperitoneal laparoscopic nephrectomy , 2009, International journal of urology : official journal of the Japanese Urological Association.

[25]  H. Tajiri,et al.  Narrow-band imaging in the diagnosis of colorectal mucosal lesions: a pilot study. , 2004, Endoscopy.

[26]  J. Widran.  Video transurethral resection using controlled continuous flow resectoscope. , 1988, Urology.

[27]  Marc Lacrosse,et al.  3D Spiral CT of the Tracheobronchial Tree , 1995, Journal of computer assisted tomography.

[28]  M. Colaiacomo,et al.  CT cystoscopy in the evaluation of bladder tumors. , 2003, Journal of experimental & clinical cancer research : CR.

[29]  Kyoung-Sik Cho,et al.  Virtual cystoscopy of the contrast material-filled bladder in patients with gross hematuria. , 2002, AJR. American journal of roentgenology.

[30]  M. F. Reiser,et al.  Evaluation of the middle and inner ear structures: comparison of hybrid rendering, virtual endoscopy and axial 2D source images , 1999, European Radiology.

[31]  D. Rex,et al.  Wide angle colonoscopy with a prototype instrument: impact on miss rates and efficiency as determined by back-to-back colonoscopies , 2003, American Journal of Gastroenterology.

[32]  G. Nikiforidis,et al.  Virtual endoscopy: navigation within pelvicaliceal system. , 2005, Journal of endourology.

[33]  J. Kaspersen,et al.  Laparoscopic navigation pointer for three-dimensional image–guided surgery , 2004, Surgical Endoscopy And Other Interventional Techniques.

[34]  M. Gagner,et al.  Virtual Gastroduodenoscopy: A New Look at the Bypassed Stomach and Duodenum After Laparoscopic Roux-en-Y Gastric Bypass for Morbid Obesity , 2002, Obesity surgery.

[35]  L. Billingham,et al.  Narrow‐band imaging flexible cystoscopy in the detection of recurrent urothelial cancer of the bladder , 2008, BJU international.

[36]  Ron Kikinis,et al.  Nondistorting flattening maps and the 3-D visualization of colon CT images , 2000, IEEE Transactions on Medical Imaging.

[37]  D. Bagley,et al.  Ureteroscopy and ureteropyeloscopy. , 1984, Urology.

[38]  G. Andriole,et al.  Three-Dimensional (3D) Vision: Does It Improve Laparoscopic Skills? An Assessment of a 3D Head-Mounted Visualization System. , 2005, Reviews in urology.

[39]  R. Sakakibara,et al.  The effectiveness of terazosin, an α1‐blocker, on bladder neck obstruction as assessed by urodynamic hydraulic energy , 2000, BJU international.

[40]  T. Langø,et al.  Navigation in laparoscopy – prototype research platform for improved image‐guided surgery , 2008, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[41]  G. Halter,et al.  Comparison of virtual and fiberoptic bronchoscopy. , 1998, The Thoracic and cardiovascular surgeon.

[42]  Osamu Ukimura,et al.  Four‐Dimensional Ultrasonography for Dynamic Bladder Shape Visualization and Analysis During Voiding , 2006, Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine.

[43]  Christian Daul,et al.  Mosaicing of Bladder Endoscopic Image Sequences: Distortion Calibration and Registration Algorithm , 2008, IEEE Transactions on Biomedical Engineering.

[44]  Computerized tomography virtual endoscopy in evaluation of upper urinary tract tumors: initial experience , 2008, Abdominal Imaging.

[45]  R Kikinis,et al.  Virtual CT cystoscopy: color mapping of bladder wall thickness. , 2000, Investigative radiology.

[46]  K. Overbeeke,et al.  Using movement parallax for 3D laparoscopy. , 1996, Medical progress through technology.

[47]  N. Zantl,et al.  Die virtuelle Endoskopie des Harntrakts , 2002, Der Urologe A.

[48]  W Cheng,et al.  Esophageal atresia and tracheal stenosis: use of three-dimensional CT and virtual bronchoscopy in neonates, infants, and children. , 2000, AJR. American journal of roentgenology.

[49]  Axel Pinz,et al.  Human Visual System , 2002 .

[50]  F. Ballester,et al.  The usefulness of virtual endoscopy and CT urography in the diagnosis of upper urinary tract tumors , 2006 .

[51]  N. Xu,et al.  Fuji Intelligent Chromo Endoscopy and staining technique for the diagnosis of colon tumor. , 2008, Chinese medical journal.

[52]  Allen Tannenbaum,et al.  Correction to "Nondistorting flattened maps and the 3-D visualization of colon CT images" , 2000 .

[53]  Z.E. Gketsis,et al.  Laparoscopic Image Analysis for Robotic Arm Guidance , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[54]  K. Deguchi,et al.  Shape reconstruction from an endoscope image by shape-from-shading technique for a point light source at the projection center , 1996, Proceedings of the Workshop on Mathematical Methods in Biomedical Image Analysis.

[55]  H. Hoppe,et al.  Virtuelle Endoskopie der oberen, zentralen und peripheren Atemwege mit Mehrzeilen-Spiral-CT , 2002, Der Radiologe.

[56]  H. Feussner,et al.  Three-dimensional navigated laparoscopic ultrasonography , 2001, Surgical Endoscopy.

[57]  G. Nikiforidis,et al.  Virtual endoscopy of the urinary tract. , 2006, Asian journal of andrology.

[58]  J. Rey,et al.  Narrow-Band Imaging in Digestive Endoscopy , 2007, TheScientificWorldJournal.

[59]  Douglas K Rex,et al.  High yields of small and flat adenomas with high-definition colonoscopes using either white light or narrow band imaging. , 2007, Gastroenterology.

[60]  Takafumi Hiro,et al.  Localized elevation of shear stress is related to coronary plaque rupture: a 3-dimensional intravascular ultrasound study with in-vivo color mapping of shear stress distribution. , 2008, Journal of the American College of Cardiology.

[61]  Chao-Hung Lin,et al.  Interactive 3-D virtual colonoscopy system , 1999, IEEE Transactions on Information Technology in Biomedicine.

[62]  E. Neri,et al.  Pseudoaneurysm of the abdominal aorta: evaluation with virtual angioscopy of spiral-CT data sets , 1999, European Radiology.

[63]  P. Pickhardt,et al.  Surface visualization at 3D endoluminal CT colonography: degree of coverage and implications for polyp detection. , 2006, Gastroenterology.

[64]  R. Günther,et al.  Value of virtual tracheobronchoscopy and bronchography from 16-slice multidetector-row spiral computed tomography for assessment of suspected tracheobronchial stenosis in children , 2006, European Radiology.

[65]  Cisel Yazgan,et al.  Virtual cystoscopy in the evaluation of bladder tumors. , 2004, Clinical imaging.

[66]  Michael B. Kimmey,et al.  Tethered Capsule Endoscopy, A Low-Cost and High-Performance Alternative Technology for the Screening of Esophageal Cancer and Barrett's Esophagus , 2008, IEEE Transactions on Biomedical Engineering.

[67]  H. Herr,et al.  A comparison of white‐light cystoscopy and narrow‐band imaging cystoscopy to detect bladder tumour recurrences , 2008, BJU international.

[68]  A. Li,et al.  Comparison of two-dimensional vs three-dimensional camera systems in laparoscopic surgery , 1997, Surgical Endoscopy.

[69]  Carlo Bartolozzi,et al.  Time efficiency of CT colonography: 2D vs 3D visualization , 2006, Comput. Medical Imaging Graph..

[70]  I. Fidler,et al.  The heterogeneous nature of metastatic neoplasms: implications for the treatment of cancer. , 1984, Urology.

[71]  Perry J Pickhardt,et al.  Three-dimensional endoluminal CT colonography (virtual colonoscopy): comparison of three commercially available systems. , 2003, AJR. American journal of roentgenology.