A System for an Accurate 3D Reconstruction in Video Endoscopy Capsule

Since few years, the gastroenterologic examinations could have been realised by wireless video capsules. Although the images make it possible to analyse some diseases, the diagnosis could be improved by the use of the 3D Imaging techniques implemented in the video capsule. The work presented here is related to Cyclope, an embedded active vision system that is able to give in real time both 3D information and texture. The challenge is to realise this integrated sensor with constraints on size, consumption, and computational resources with inherent limitation of video capsule. In this paper, we present the hardware and software development of a wireless multispectral vision sensor which allows to transmit, a 3D reconstruction of a scene in realtime. multispectral acquisitions grab both texture and IR pattern images at least at 25 frames/s separately. The different Intellectual Properties designed allow to compute specifics algorithms in real time while keeping accuracy computation. We present experimental results with the realization of a large-scale demonstrator using an SOPC prototyping board.

[1]  Jean-François Rey,et al.  Olympus Capsule Endoscope for Small and Large Bowel Exploration , 2006 .

[2]  Patrick Garda,et al.  Cyclope: an integrated real-time 3D image sensor , 2004 .

[3]  P. Swain,et al.  Wireless capsule endoscopy. , 2002, The Israel Medical Association journal : IMAJ.

[4]  Joaquim Salvi,et al.  Recent progress in coded structured light as a technique to solve the correspondence problem: a survey , 1998, Pattern Recognit..

[5]  S. P. Mudur,et al.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[6]  Paolo Fiorini,et al.  Human++: autonomous wireless sensors for body area networks , 2005, Proceedings of the IEEE 2005 Custom Integrated Circuits Conference, 2005..

[7]  Aly A. Farag,et al.  CardEye: a 3D trinocular active vision system , 2000, ITSC2000. 2000 IEEE Intelligent Transportation Systems. Proceedings (Cat. No.00TH8493).

[8]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[9]  Mohan M. Trivedi,et al.  3-D Computer Vision Using Structured Light: Design, Calibration, and Implementation Issues , 1996, Adv. Comput..

[10]  I. Xilinx,et al.  Virtex-II Pro and Virtex-II Pro X Platform FPGAs: Complete data sheet , 2004 .

[11]  Patrick Garda,et al.  Seuil lage dynamique temps reel dans un systeme embarque , 2007 .

[12]  Andrew K. C. Wong,et al.  A new method for gray-level picture thresholding using the entropy of the histogram , 1985, Comput. Vis. Graph. Image Process..

[13]  Kunihiro Asada,et al.  Real-time and high-resolution 3D imaging system using light-section method and smart CMOS sensor , 2003, Proceedings of IEEE Sensors 2003 (IEEE Cat. No.03CH37498).

[14]  Olivier Romain,et al.  Entropy Coding on a Programmable Processor Array for Multimedia SoC , 2007 .

[15]  Franck Marzani,et al.  Toward a 3D Multispectral Scanner: An Application to Multimedia , 2007, IEEE MultiMedia.

[16]  Tarik Graba,et al.  Etude d'une architecture de traitement pour un capteur intégré de vision 3D , 2006 .

[17]  Jamil Y. Khan,et al.  Wireless Body Sensor Network Using Medical Implant Band , 2007, Journal of Medical Systems.

[18]  Holly E. Rushmeier,et al.  The 3D Model Acquisition Pipeline , 2002, Comput. Graph. Forum.

[19]  E. Belhaire,et al.  Smart Bi-Spectral Image Sensor for 3D Vision , 2007, 2007 IEEE Sensors.

[20]  Janne Heikkilä,et al.  A four-step camera calibration procedure with implicit image correction , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  Kristofer S. J. Pister,et al.  Smart Dust: Communicating with a Cubic-Millimeter Computer , 2001, Computer.

[22]  Ou-Yang Mang,et al.  Design of wide-angle lenses for wireless capsule endoscopes , 2007 .

[23]  O. Romain,et al.  A Digital Processing Architecture For 3D Reconstruction , 2007, 2006 International Workshop on Computer Architecture for Machine Perception and Sensing.

[24]  Moon Gi Kang,et al.  Correction of lens distortion using point correspondence , 1999, Proceedings of IEEE. IEEE Region 10 Conference. TENCON 99. 'Multimedia Technology for Asia-Pacific Information Infrastructure' (Cat. No.99CH37030).

[25]  Dan Ionescu,et al.  A high precision 3D object reconstruction method using a color coded grid and NURBS , 1999, Proceedings 10th International Conference on Image Analysis and Processing.

[26]  Andreas Ullrich,et al.  Long-range high-performance time-of-flight-based 3D imaging sensors , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[27]  Song Zhang Recent progresses on real-time 3D shape measurement using digital fringe projection techniques , 2010 .