New intraoperative imaging technologies: Innovating the surgeon’s eye toward surgical precision

Imaging is one of the pillars for the ongoing evolution of surgical oncology toward a precision paradigm. In the present overview, some established or emerging intraoperative imaging technologies are described in light of the vision and experience of our group in image‐guided surgery, focusing on digestive surgical oncology.

[1]  Rohit Bhargava,et al.  Using Fourier transform IR spectroscopy to analyze biological materials , 2014, Nature Protocols.

[2]  C. V. D. van de Velde,et al.  Validation of full-field optical coherence tomography in distinguishing malignant and benign tissue in resected pancreatic cancer specimens , 2017, PloS one.

[3]  A. Darzi,et al.  Intraoperative Tissue Identification Using Rapid Evaporative Ionization Mass Spectrometry , 2013, Science Translational Medicine.

[4]  C. Brennan,et al.  A Brain Tumor Molecular Imaging Strategy Using A New Triple-Modality MRI-Photoacoustic-Raman Nanoparticle , 2011, Nature Medicine.

[5]  A. Nagorni,et al.  Narrow band imaging versus conventional white light colonoscopy for the detection of colorectal polyps. , 2012, The Cochrane database of systematic reviews.

[6]  K. Valluru,et al.  Photoacoustic Imaging in Oncology: Translational Preclinical and Early Clinical Experience. , 2016, Radiology.

[7]  M. Hashizume,et al.  Integrated Endoscopic System Based on Optical Imaging and Hyperspectral Data Analysis for Colorectal Cancer Detection. , 2016, Anticancer research.

[8]  Luc Soler,et al.  Virtual Reality Exploration and Planning for Precision Colorectal Surgery , 2018, Diseases of the colon and rectum.

[9]  E. Ring,et al.  Infrared thermal imaging in medicine , 2012, Physiological measurement.

[10]  T. Shimosegawa,et al.  Recent development of optical coherence tomography for preoperative diagnosis of esophageal malignancies. , 2015, World journal of gastrointestinal endoscopy.

[11]  Kishan Dholakia,et al.  Multi-modal approach using Raman spectroscopy and optical coherence tomography for the discrimination of colonic adenocarcinoma from normal colon. , 2013, Biomedical optics express.

[12]  Luc Soler,et al.  Real-time 3D image reconstruction guidance in liver resection surgery. , 2014, Hepatobiliary surgery and nutrition.

[13]  P. Chittiboina.  iMRI During Transsphenoidal Surgery. , 2017, Neurosurgery clinics of North America.

[14]  Vasilis Ntziachristos,et al.  Optical and Opto-Acoustic Interventional Imaging , 2011, Annals of Biomedical Engineering.

[15]  Luc Soler,et al.  Robotic duodenopancreatectomy assisted with augmented reality and real-time fluorescence guidance , 2014, Surgical Endoscopy.

[16]  Gregory Palmer,et al.  Noninvasive measurement of tissue blood oxygenation with Cerenkov imaging during therapeutic radiation delivery. , 2017, Optics letters.

[17]  E. Dekker,et al.  Feasibility and Accuracy of Confocal Endomicroscopy in Comparison With Narrow-Band Imaging and Chromoendoscopy for the Differentiation of Colorectal Lesions , 2012, The American Journal of Gastroenterology.

[18]  Megan C. Garland,et al.  A Bright Future for Precision Medicine: Advances in Fluorescent Chemical Probe Design and Their Clinical Application. , 2016, Cell chemical biology.

[19]  Hui-Xiong Xu,et al.  Nano/microparticles and ultrasound contrast agents. , 2013, World journal of radiology.

[20]  J. Marescaux,et al.  Precision real-time evaluation of bowel perfusion: accuracy of confocal endomicroscopy assessment of stoma in a controlled hemorrhagic shock model , 2017, Surgical Endoscopy.

[21]  A. Iasonos,et al.  Prospective Comparative Study of Laparoscopic Narrow Band Imaging (NBI) Versus Standard Imaging in Gynecologic Oncology , 2018, Annals of Surgical Oncology.

[22]  P. Siersema,et al.  Narrow Band Imaging, Magnifying Chromoendoscopy, and Gross Morphological Features for the Optical Diagnosis of T1 Colorectal Cancer and Deep Submucosal Invasion: A Systematic Review and Meta-Analysis , 2017, The American Journal of Gastroenterology.

[23]  Daniel Azoulay,et al.  Confocal Laser Endomicroscopy in Gastrointestinal and Pancreatobiliary Diseases: A Systematic Review and Meta-Analysis , 2016, BioMed research international.

[24]  J. Marescaux,et al.  Towards cybernetic surgery: robotic and augmented reality-assisted liver segmentectomy , 2015, Langenbeck's Archives of Surgery.

[25]  G Malandain,et al.  An automatic virtual patient reconstruction from CT-scans for hepatic surgical planning. , 2000, Studies in health technology and informatics.

[26]  M. Diana,et al.  Critical View of Safety During Laparoscopic Cholecystectomy: From the Surgeon’s Eye to Fluorescent Vision , 2018, Surgical innovation.

[27]  Seong-Ho Kong,et al.  Reply to Letter: "Enhanced Reality Fluorescence Videography to Assess Bowel Perfusion: The Cybernetic Eye". , 2017, Annals of surgery.

[28]  J. Marescaux,et al.  Three-Dimensional Virtual Cholangioscopy: A Reliable Tool for the Diagnosis of Common Bile Duct Stones , 2004, Annals of surgery.

[29]  J. Marescaux,et al.  Augmented-reality-assisted laparoscopic adrenalectomy. , 2004, JAMA.

[30]  Luc Soler,et al.  Prospective Evaluation of Precision Multimodal Gallbladder Surgery Navigation: Virtual Reality, Near-infrared Fluorescence, and X-ray-based Intraoperative Cholangiography , 2017, Annals of surgery.

[31]  Sylvie Treuillet,et al.  Hyperspectral interventional imaging for enhanced tissue visualization and discrimination combining band selection methods , 2016, International Journal of Computer Assisted Radiology and Surgery.

[32]  R. Jain,et al.  Cancer imaging by optical coherence tomography: preclinical progress and clinical potential , 2012, Nature Reviews Cancer.

[33]  Z. Takáts,et al.  Ambient Mass Spectrometry in Cancer Research. , 2017, Advances in cancer research.

[34]  Luc Soler,et al.  Enhanced-Reality Video Fluorescence: A Real-Time Assessment of Intestinal Viability , 2014, Annals of surgery.

[35]  Oliver Faust,et al.  Application of infrared thermography in computer aided diagnosis , 2014, Infrared Physics & Technology.

[36]  Guolan Lu,et al.  Medical hyperspectral imaging: a review , 2014, Journal of biomedical optics.

[37]  Vasilis Ntziachristos,et al.  Optoacoustic Imaging of Human Vasculature: Feasibility by Using a Handheld Probe. , 2016, Radiology.

[38]  S. Gambhir,et al.  Light in and sound out: emerging translational strategies for photoacoustic imaging. , 2014, Cancer research.

[39]  Zhenhua Hu,et al.  Cerenkov luminescence imaging on evaluation of early response to chemotherapy of drug-resistant gastric cancer. , 2018, Nanomedicine : nanotechnology, biology, and medicine.

[40]  Johan F. Langenhuijsen,et al.  Intraoperative Imaging Techniques to Support Complete Tumor Resection in Partial Nephrectomy. , 2017, European urology focus.

[41]  J. Marescaux,et al.  The quest for precision in transanal total mesorectal excision , 2015, Techniques in Coloproctology.

[42]  Michele Diana.  Cirugía guiada por fluorescencia aplicada al aparato digestivo: el ojo cibernético permite ver lo invisible , 2017 .

[43]  F. Caillol,et al.  Refined Probe-Based Confocal Laser Endomicroscopy Classification for Biliary Strictures: The Paris Classification , 2013, Digestive Diseases and Sciences.

[44]  Helmut Neumann,et al.  Prospective evaluation of the learning curve of confocal laser endomicroscopy in patients with IBD. , 2011, Histology and histopathology.

[45]  Kristina Schwamborn,et al.  MALDI imaging mass spectrometry - From bench to bedside. , 2017, Biochimica et biophysica acta. Proteins and proteomics.

[46]  M. Mortensen,et al.  Intraoperative Ultrasound as a Screening Modality for the Detection of Liver Metastases during Resection of Primary Colorectal Cancer - A Systematic Review , 2017, Ultrasound International Open.

[47]  Vasilis Ntziachristos,et al.  Eigenspectra optoacoustic tomography achieves quantitative blood oxygenation imaging deep in tissues , 2015, Nature Communications.

[48]  Muhan Liu,et al.  Feasibility study of novel endoscopic Cerenkov luminescence imaging system in detecting and quantifying gastrointestinal disease: first human results , 2015, European Radiology.

[49]  Timothy C. Chang,et al.  Image-Guided Transurethral Resection of Bladder Tumors – Current Practice and Future Outlooks , 2017, Bladder Cancer.

[50]  V. Agnus,et al.  A step towards stereotactic navigation during pelvic surgery: 3D nerve topography , 2018, Surgical Endoscopy.

[51]  Sarah E. Pinder,et al.  Intraoperative Assessment of Tumor Resection Margins in Breast-Conserving Surgery Using 18F-FDG Cerenkov Luminescence Imaging: A First-in-Human Feasibility Study , 2017, The Journal of Nuclear Medicine.

[52]  William E Grizzle,et al.  Current and Emerging Clinical Applications of Multispectral Optoacoustic Tomography (MSOT) in Oncology , 2016, Clinical Cancer Research.

[53]  D. Tuch,et al.  Cerenkov luminescence imaging (CLI) for image-guided cancer surgery , 2016, Clinical and Translational Imaging.

[54]  M. Wallace,et al.  Miami classification for probe-based confocal laser endomicroscopy , 2011, Endoscopy.

[55]  S. Singhal.  The Future of Surgical Oncology: Image-Guided Cancer Surgery. , 2016, JAMA surgery.

[56]  M. Diana.  Fluorescence-guided surgery applied to the digestive system: the cybernetic eye to see the invisible. , 2018, Cirugia espanola.

[57]  F. Dip,et al.  Fluorescent incisionless cholangiography as a teaching tool for identification of Calot’s triangle , 2017, Surgical Endoscopy.

[58]  Emiliano Schena,et al.  Multipoint temperature monitoring in liver undergoing computed tomography-guided radiofrequency ablation with fiber Bragg grating probes , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[59]  Hiroshi Imamura,et al.  Intraoperative fluorescent cholangiography using indocyanine green: a biliary road map for safe surgery. , 2009, Journal of the American College of Surgeons.

[60]  T. Jayakumar,et al.  Medical applications of infrared thermography: A review , 2012, Infrared Physics & Technology.

[61]  Angelo Pierangelo,et al.  Diagnostic accuracy of confocal laser endomicroscopy for the ex vivo characterization of peritoneal nodules during laparoscopic surgery , 2016, Surgical Endoscopy.

[62]  Luc Soler,et al.  Real-time navigation by fluorescence-based enhanced reality for precise estimation of future anastomotic site in digestive surgery , 2014, Surgical Endoscopy.

[63]  Luc Soler,et al.  Probe-based confocal laser endomicroscopy and fluorescence-based enhanced reality for real-time assessment of intestinal microcirculation in a porcine model of sigmoid ischemia , 2014, Surgical Endoscopy.

[64]  A. Mahadevan-Jansen,et al.  Intraoperative Assessment of Parathyroid Viability using Laser Speckle Contrast Imaging , 2017, Scientific Reports.

[65]  Jason M Warram,et al.  Laparoscopic Fluorescent Visualization of the Ureter With Intravenous IRDye800CW. , 2015, Journal of minimally invasive gynecology.

[66]  Jacques Marescaux,et al.  Looking at the future of surgery with the augmented eye , 2016 .

[67]  T. B. Bakker Schut,et al.  Raman spectroscopy for cancer detection and cancer surgery guidance: translation to the clinics. , 2017, The Analyst.

[68]  Jacques Marescaux,et al.  Effects of Nd:YAG laser for the controlled and localized treatment of early gastrointestinal tumors: Preliminary in vivo study , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[69]  N. Harlaar,et al.  Molecular fluorescence-guided surgery of peritoneal carcinomatosis of colorectal origin: a single-centre feasibility study. , 2016, The lancet. Gastroenterology & hepatology.

[70]  Nicholas Ayache,et al.  Software for automated classification of probe-based confocal laser endomicroscopy videos of colorectal polyps. , 2012, World journal of gastroenterology.

[71]  Guido Perrone,et al.  Novel carbon fiber probe for temperature monitoring during thermal therapies , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[72]  M. Ferrari.  Cancer nanotechnology: opportunities and challenges , 2005, Nature Reviews Cancer.

[73]  Lihong V. Wang,et al.  Simultaneous functional photoacoustic and ultrasonic endoscopy of internal organs in vivo , 2012, Nature Medicine.

[74]  Ismail Gögenur,et al.  Indocyanine green fluorescence angiography for intraoperative assessment of gastrointestinal anastomotic perfusion: a systematic review of clinical trials , 2016, Langenbeck's Archives of Surgery.

[75]  J. Moalem,et al.  Preliminary results of ex vivo multispectral photoacoustic imaging in the management of thyroid cancer. , 2014, AJR. American journal of roentgenology.

[76]  Keith D Paulsen,et al.  Successful Translation of Fluorescence Navigation During Oncologic Surgery: A Consensus Report , 2016, The Journal of Nuclear Medicine.

[77]  J. Marescaux,et al.  New technologies for single‐site robotic surgery in hepato‐biliary‐pancreatic surgery , 2014, Journal of hepato-biliary-pancreatic sciences.

[78]  Brendan F Kennedy,et al.  Biomedical device innovation methodology: applications in biophotonics , 2017, Journal of biomedical optics.

[79]  Kenneth K Wang,et al.  Endoscopic tri-modal imaging for detection of early neoplasia in Barrett’s oesophagus: a multi-centre feasibility study using high-resolution endoscopy, autofluorescence imaging and narrow band imaging incorporated in one endoscopy system , 2007, Gut.

[80]  Vasilis Ntziachristos,et al.  Performance of a Multispectral Optoacoustic Tomography (MSOT) System equipped with 2D vs. 3D Handheld Probes for Potential Clinical Translation , 2015, Photoacoustics.

[81]  M. Kaczmarek,et al.  Active IR-Thermal Imaging in Medicine , 2016 .

[82]  Chihua Fang,et al.  Near infrared-emitting persistent luminescent nanoparticles for Hepatocellular Carcinoma imaging and luminescence-guided surgery. , 2018, Biomaterials.

[83]  Laura Marcu,et al.  Label-free optical imaging technologies for rapid translation and use during intraoperative surgical and tumor margin assessment , 2017, Journal of biomedical optics.

[84]  Luc Soler,et al.  Three-dimensional virtual neck exploration before parathyroidectomy. , 2012, The New England journal of medicine.

[85]  P. Low,et al.  Intraoperative tumor-specific fluorescence imaging in ovarian cancer by folate receptor-α targeting: first in-human results , 2011, Nature Medicine.

[86]  Luc Soler,et al.  The status of augmented reality in laparoscopic surgery as of 2016 , 2017, Medical Image Anal..

[87]  J. Nilsson,et al.  Laser speckle contrast imaging for intraoperative assessment of liver microcirculation: a clinical pilot study , 2014, Medical devices.

[88]  L. Soler,et al.  3D virtual reality and selective vascular control for laparoscopic left hepatic lobectomy , 2009, Surgical Endoscopy.

[89]  A. Jarmusch,et al.  Ambient ionization mass spectrometric analysis of human surgical specimens to distinguish renal cell carcinoma from healthy renal tissue , 2016, Analytical and Bioanalytical Chemistry.

[90]  A. Pierangelo,et al.  Diagnostic accuracy of confocal laser endomicroscopy for the characterization of liver nodules , 2017, European journal of gastroenterology & hepatology.

[91]  A. Bansal,et al.  Toward better imaging of Barrett's esophagus--see more, biopsy less! , 2006, Gastrointestinal endoscopy.

[92]  J. Marescaux,et al.  Novel laparoscopic narrow band imaging for real-time detection of bile leak during hepatectomy: proof of the concept in a porcine model , 2016, Surgical Endoscopy.

[93]  A. Stallmach,et al.  Confocal laser endomicroscopy reliably detects sepsis-related and treatment-associated changes in intestinal mucosal microcirculation. , 2013, British journal of anaesthesia.

[94]  Guido Perrone,et al.  Linearly chirped fiber Bragg grating response to thermal gradient: from bench tests to the real-time assessment during in vivo laser ablations of biological tissue , 2017, Journal of biomedical optics.

[95]  S. L. Bugby,et al.  Modalities for image‐ and molecular‐guided cancer surgery , 2018, The British journal of surgery.

[96]  S. L. Bugby,et al.  Hybrid intraoperative imaging techniques in radioguided surgery: present clinical applications and future outlook , 2017, Clinical and Translational Imaging.

[97]  Zoltan Takats,et al.  In vivo endoscopic tissue identification by rapid evaporative ionization mass spectrometry (REIMS). , 2015, Angewandte Chemie.

[98]  G. Rao,et al.  Intraoperative pancreatoscopy with narrow band imaging: a novel method for assessment of resection margins in case of intraductal papillary mucinous neoplasm , 2012, Surgical Endoscopy.

[99]  Jacques Marescaux,et al.  Inventing the Future of Surgery , 2015, World Journal of Surgery.

[100]  B. Wilson,et al.  A review of Raman spectroscopy advances with an emphasis on clinical translation challenges in oncology , 2016, Physics in medicine and biology.

[101]  Didier Mutter,et al.  Improving Echo-Guided Procedures Using an Ultrasound-CT Image Fusion System , 2015, Surgical innovation.

[102]  S R Cherry,et al.  Optical imaging of Cerenkov light generation from positron-emitting radiotracers , 2009, Physics in medicine and biology.

[103]  Hirotoshi Kikuchi,et al.  Laparoscopic Narrow-Band Imaging for the Diagnosis of Peritoneal Metastasis in Gastric Cancer , 2014, Annals of Surgical Oncology.

[104]  F. Beuvon,et al.  Real-time cancer diagnosis during prostate biopsy: ex vivo evaluation of full-field optical coherence tomography (FFOCT) imaging on biopsy cores , 2016, World Journal of Urology.

[105]  Luc Soler,et al.  Augmented Reality Guidance for the Resection of Missing Colorectal Liver Metastases: An Initial Experience , 2016, World Journal of Surgery.

[106]  L. Price,et al.  Laparoscopic narrow band imaging for detection of occult cancer metastases: a randomized feasibility trial , 2016, Surgical Endoscopy.

[107]  Luc Soler,et al.  Augmented Reality-Guided Artery-First Pancreatico-Duodenectomy , 2013, Journal of Gastrointestinal Surgery.

[108]  X Guo,et al.  Meta-analysis of the effects of endoscopy with narrow band imaging in detecting dysplasia in Barrett's esophagus. , 2015, Diseases of the esophagus : official journal of the International Society for Diseases of the Esophagus.

[109]  F. Jolesz,et al.  Mass spectrometry imaging as a tool for surgical decision-making. , 2013, Journal of mass spectrometry : JMS.

[110]  R. Weissleder,et al.  Imaging in the era of molecular oncology , 2008, Nature.

[111]  P. R. Bloemen,et al.  Effect of ephedrine on gastric conduit perfusion measured by laser speckle contrast imaging after esophagectomy: a prospective in vivo cohort study. , 2018, Diseases of the esophagus : official journal of the International Society for Diseases of the Esophagus.

[112]  D. Faller,et al.  Medical hyperspectral imaging to facilitate residual tumor identification during surgery , 2007, Cancer biology & therapy.

[113]  Mads S. Bergholt,et al.  Fiberoptic confocal raman spectroscopy for real-time in vivo diagnosis of dysplasia in Barrett's esophagus. , 2014, Gastroenterology.

[114]  J. Marescaux,et al.  Reply to Letter: "Enhanced Reality Fluorescence Videography to Assess Bowel Perfusion: The Cybernetic Eye". , 2017, Annals of surgery.

[115]  B Dallemagne,et al.  Intraoperative fluorescence‐based enhanced reality laparoscopic real‐time imaging to assess bowel perfusion at the anastomotic site in an experimental model , 2015, The British journal of surgery.

[116]  Thomas Walker,et al.  Intraoperative ultrasound for the colorectal surgeon: current trends and barriers , 2017, ANZ journal of surgery.

[117]  M. Diana.  Enabling precision digestive surgery with fluorescence imaging. , 2017, Translational gastroenterology and hepatology.

[118]  Mengxin Xu,et al.  Activating TiO2 Nanoparticles: Gallium-68 Serves as a High-Yield Photon Emitter for Cerenkov-Induced Photodynamic Therapy. , 2018, ACS applied materials & interfaces.

[119]  M. Wallace,et al.  Needle-based confocal endomicroscopy for in vivo histology of intra-abdominal organs: first results in a porcine model (with videos). , 2010, Gastrointestinal endoscopy.

[120]  Michael V Knopp,et al.  A comprehensive overview of radioguided surgery using gamma detection probe technology , 2009, World journal of surgical oncology.

[121]  M. Wallace,et al.  Optimal fluorescein dose for intravenous application in miniprobe‐based confocal laser scanning microscopy in pigs , 2011, Journal of biophotonics.

[122]  J. Marescaux,et al.  Three-Dimensional Metabolic and Radiologic Gathered Evaluation Using VR-RENDER Fusion: A Novel Tool to Enhance Accuracy in the Localization of Parathyroid Adenomas , 2013, World Journal of Surgery.

[123]  Nathan D. Shemonski,et al.  Real-time Imaging of the Resection Bed Using a Handheld Probe to Reduce Incidence of Microscopic Positive Margins in Cancer Surgery. , 2015, Cancer research.

[124]  Y. Zhang,et al.  Intraoperative detection of sentinel lymph node metastases in breast carcinoma by Fourier transform infrared spectroscopy , 2015, The British journal of surgery.

[125]  D Mutter,et al.  Recent advances in liver imaging , 2010, Expert review of gastroenterology & hepatology.

[126]  Kazuhide Hayama,et al.  Intraoperative gamma cameras for radioguided surgery: technical characteristics, performance parameters, and clinical applications. , 2013, Physica medica : PM : an international journal devoted to the applications of physics to medicine and biology : official journal of the Italian Association of Biomedical Physics.

[127]  H Delingette,et al.  Virtual reality applied to hepatic surgery simulation: the next revolution. , 1998, Annals of surgery.

[128]  Alexander Meining,et al.  A pilot study of in vivo identification of pancreatic cystic neoplasms with needle-based confocal laser endomicroscopy under endosonographic guidance , 2013, Endoscopy.

[129]  F. Collins,et al.  A new initiative on precision medicine. , 2015, The New England journal of medicine.

[130]  Ton G van Leeuwen,et al.  Applicability of quantitative optical imaging techniques for intraoperative perfusion diagnostics: a comparison of laser speckle contrast imaging, sidestream dark-field microscopy, and optical coherence tomography. , 2017, Journal of biomedical optics.

[131]  M. Raphaelson,et al.  Stimulants and attention-deficit/hyperactivity disorder. , 2004, JAMA.

[132]  Luc Soler,et al.  Trans-thoracic minimally invasive liver resection guided by augmented reality. , 2015, Journal of the American College of Surgeons.

[133]  J. Marescaux,et al.  Endoluminal full-thickness suture repair of gastrotomy: a survival study , 2015, Surgical Endoscopy.

[134]  Seong-Ho Kong,et al.  Near-infrared cholecysto-cholangiography with indocyanine green may secure cholecystectomy in difficult clinical situations: proof of the concept in a porcine model , 2016, Surgical Endoscopy.

[135]  Paul Fockens,et al.  Diagnostic accuracy of probe-based confocal laser endomicroscopy in detecting residual colorectal neoplasia after EMR: a prospective study. , 2012, Gastrointestinal endoscopy.