Extracting remote photoplethysmogram signal from endoscopy videos for vessel and capillary density recognition

In this paper, we propose a new feature for finding lesions in gastrointestinal tissues. Polyps or cancerous parts have different capillary pattern compared with normal parts. There are polyps which have higher density of vessel or capillary pattern. This feature leads us to extract remote photoplethysmogram signal from different parts of videos from gastrointestinal tissue. Due to the fact that hemoglobin absorbs more light than surrounding tissues, more changes are expected to be observed in the parts with higher density of vessels and capillaries. In the experimental results, rPPG signals is extracted from colonoscopy and endoscopy videos. This feature is used to distinguish between normal and abnormal tissues. It is shown that power of rPPG signal can be used to find lesion areas.

[1]  Shankar M. Krishnan,et al.  Intestinal abnormality detection from endoscopic images , 1998, Proceedings of the 20th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Vol.20 Biomedical Engineering Towards the Year 2000 and Beyond (Cat. No.98CH36286).

[2]  Toru Hayashi,et al.  Evaluation of autonomic nervous function during upper gastrointestinal endoscopy using heart rate variability , 2000, Journal of Gastroenterology.

[3]  Topi Mäenpää,et al.  The local binary pattern approach to texture analysis - extensions and applications , 2003 .

[4]  H. Tajiri,et al.  Narrow-band imaging in the diagnosis of colorectal mucosal lesions: a pilot study. , 2004, Endoscopy.

[5]  Jung-Hwan Oh,et al.  Polyp Detection in Colonoscopy Video using Elliptical Shape Feature , 2007, 2007 IEEE International Conference on Image Processing.

[6]  Dietrich Paulus,et al.  Methods for polyp detection in colonoscopy videos: a review , 2008 .

[7]  Hiroaki Ikematsu,et al.  Efficacy of capillary pattern type IIIA/IIIB by magnifying narrow band imaging for estimating depth of invasion of early colorectal neoplasms , 2010, BMC gastroenterology.

[8]  Daniel McDuff,et al.  Advancements in Noncontact, Multiparameter Physiological Measurements Using a Webcam , 2011, IEEE Transactions on Biomedical Engineering.

[9]  Tomoyuki Shibata,et al.  Correlation between magnifying narrow band imaging and histopathology in gastric protruding/or polypoid lesions: a pilot feasibility trial , 2012, BMC Gastroenterology.

[10]  Amit Rastogi,et al.  Optical Diagnosis of Small Colorectal Polyp Histology with High-Definition Colonoscopy Using Narrow Band Imaging , 2013, Clinical endoscopy.

[11]  Seyyed Hamed Fouladi,et al.  Denoising Based on Multivariate Stochastic Volatility Modeling of Multiwavelet Coefficients , 2013, IEEE Transactions on Signal Processing.

[12]  E. Hari Krishna,et al.  ICA-Based Improved DTCWT Technique for MA Reduction in PPG Signals With Restored Respiratory Information , 2013, IEEE Transactions on Instrumentation and Measurement.

[13]  Steven D. Wexner,et al.  Colorectal polyps and polyposis syndromes , 2014, Gastroenterology report.

[14]  Hussain Al-Ahmad,et al.  Automatic polyp detection: A comparative study , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[15]  Seyyed Hamed Fouladi,et al.  Accurate heart rate estimation from camera recording via MUSIC algorithm , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[16]  Nima Tajbakhsh,et al.  Automatic polyp detection in colonoscopy videos using an ensemble of convolutional neural networks , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).