Design of a Hybrid Visuo-Inertial Smart Sensor

In this paper, a smart sensor dedicated to image and inertial sensing is proposed. This work considers a system with a CMOS imager and an inertial set composed by 3 linear accelerometers and 3 gyrometers. One of the most original aspect of this approach is the use of a System On Chip implemented in a FPGA to manage the whole system. With its structure, the system proposes a high degree of versatility and allows the implementation of parallel image and inertial processing algorithms. In order to illustrate our approach, first results consisting in a depth estimation of a target are proposed.

[1]  Noboru Ohnishi,et al.  The recovery of object shape and camera motion using a sensing system with a video camera and a gyro sensor , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[2]  Long Quan,et al.  Quasi-Dense Reconstruction from Image Sequence , 2002, ECCV.

[3]  François Berry,et al.  Design of an imaging system based on FPGA technology and CMOS imager , 2004, Proceedings. 2004 IEEE International Conference on Field- Programmable Technology (IEEE Cat. No.04EX921).

[4]  R Chellappa,et al.  Robust structure from motion estimation using inertial data. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[5]  Stefan Fischer,et al.  Design and development of the smart machine vision sensor (SMVS) , 1998, Other Conferences.

[6]  O. Faugeras Three-dimensional computer vision: a geometric viewpoint , 1993 .

[7]  Suya You,et al.  Fusion of vision and gyro tracking for robust augmented reality registration , 2001, Proceedings IEEE Virtual Reality 2001.

[8]  Sanjiv Singh,et al.  Optimal motion estimation from visual and inertial measurements , 2002, Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings..

[9]  Stephen M. Rock,et al.  Relative position estimation for manipulation tasks by fusing vision and inertial measurements , 2001, MTS/IEEE Oceans 2001. An Ocean Odyssey. Conference Proceedings (IEEE Cat. No.01CH37295).