Integration of vision and inertial sensing

Tese de doutoramento em Engenharia Electrotecnica (Instrumentacao e Controlo) apresentada a Fac. de Ciencias e Tecnologia de Coimbra

[1]  Seth J. Teller,et al.  Epipolar Constraints for Vision-Aided Inertial Navigation , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[2]  HighWire Press.  The journal of neuroscience : the official journal of the Society for Neuroscience. , 1981 .

[3]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[4]  Colin Blakemore,et al.  Areas of the human brain activated by ambient visual motion, indicating three kinds of self-movement , 2002, Experimental Brain Research.

[5]  François Berry,et al.  Design of a Hybrid Visuo-Inertial Smart Sensor , 2005 .

[6]  Rui Li,et al.  Multi-Scale 3D Scene Flow from Binocular Stereo Sequences , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[7]  Andrew Hogue,et al.  An optical-inertial tracking system for fully-enclosed VR displays , 2004, First Canadian Conference on Computer and Robot Vision, 2004. Proceedings..

[8]  Jean Laurens,et al.  Bayesian processing of vestibular information , 2007, Biological Cybernetics.

[9]  Anthony Lawrence,et al.  Modern Inertial Technology: Navigation, Guidance, and Control , 1993 .

[10]  Bijoy K. Ghosh,et al.  Pose estimation using line-based dynamic vision and inertial sensors , 2003, IEEE Trans. Autom. Control..

[11]  Stereo Vision 3 D Map Registration for Airships using Vision-Inertial Sensing , 2006 .

[12]  Kurt Konolige,et al.  Small Vision Systems: Hardware and Implementation , 1998 .

[13]  Stergios I. Roumeliotis,et al.  Augmenting inertial navigation with image-based motion estimation , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[14]  Michael Harrington,et al.  FlightTracker: a novel optical/inertial tracker for cockpit enhanced vision , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[15]  G. Leone,et al.  The effect of gravity on human recognition of disoriented objects , 1998, Brain Research Reviews.

[16]  Ryo Kurazume,et al.  Development of image stabilization system for remote operation of walking robots , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[17]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[18]  Stéphane Viollet,et al.  A high speed gaze control system based on the Vestibulo-Ocular Reflex , 2005, Robotics Auton. Syst..

[19]  Meng-xiang Li.  Camera Calibration of the KTH Head-Eye System , 1994, eccv 1994.

[20]  Eric Foxlin,et al.  Circular data matrix fiducial system and robust image processing for a wearable vision-inertial self-tracker , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[22]  Helder Araújo,et al.  Simulating pursuit with machine experiments with robots and artificial vision , 1998, IEEE Trans. Robotics Autom..

[23]  M. Caruso,et al.  A New Perspective on Magnetic Field Sensing , 1999 .

[24]  Tom Drummond,et al.  Tightly integrated sensor fusion for robust visual tracking , 2004, Image Vis. Comput..

[25]  Jorge Lobo,et al.  Bioinspired Visuovestibular Artificial Perception System for Independent Motion Segmentation , 2006 .

[26]  Beatrice Brillault-O'Mahony,et al.  New method for vanishing point detection , 1991, CVGIP Image Underst..

[27]  Eric Foxlin,et al.  VIS-Tracker: a wearable vision-inertial self-tracker , 2003, IEEE Virtual Reality, 2003. Proceedings..

[28]  Ye Zhang,et al.  On 3-D scene flow and structure recovery from multiview image sequences , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[29]  Luc Van Gool,et al.  Vision Based Intelligent Wheel Chair Control: The Role of Vision and Inertial Sensing in Topological Navigation , 2004, J. Field Robotics.

[30]  Rolf-Rainer Grigat,et al.  Real-time hybrid pose estimation from vision and inertial data , 2004, First Canadian Conference on Computer and Robot Vision, 2004. Proceedings..

[31]  Jorge Lobo,et al.  Camera-Inertial Sensor modelling and alignment for Visual Navigation , 2003 .

[32]  Takeo Kanade,et al.  Three-dimensional scene flow , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Shree K. Nayar,et al.  Ego-motion and omnidirectional cameras , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[34]  Susan Hurley,et al.  Perception And Action: Alternative Views , 2001, Synthese.

[35]  Jack M. Loomis,et al.  The importance of perceived relative motion in the control of posture , 2005, Experimental Brain Research.

[36]  G. Schmidt,et al.  Inertial sensor technology trends , 2001 .

[37]  Satyan R. Coorg,et al.  Pose imagery and automated three-dimensional modeling of urban environments , 1998 .

[38]  Larry H. Matthies,et al.  Error modeling in stereo navigation , 1986, IEEE J. Robotics Autom..

[39]  R Chellappa,et al.  Robust structure from motion estimation using inertial data. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[40]  Axel Pinz,et al.  A Flexible Software Architecture for Hybrid Tracking , 2004, J. Field Robotics.

[41]  Olivier Faugeras,et al.  Computation of inertial information on a Robot , 1991 .

[42]  Roger Y. Tsai,et al.  A new technique for fully autonomous and efficient 3D robotics hand/eye calibration , 1988, IEEE Trans. Robotics Autom..

[43]  Rui P. Rocha,et al.  RAC ROBOTIC SOCCER SMALL-SIZE TEAM: CONTROL ARCHITECTURE AND GLOBAL VISION , 2005 .

[44]  Roberto Horowitz,et al.  Integrated micro-electro-mechanical sensor development for inertial applications , 1998, IEEE 1998 Position Location and Navigation Symposium (Cat. No.98CH36153).

[45]  Joseph O'Rourke,et al.  Computational Geometry in C. , 1995 .

[46]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[47]  B J Hess,et al.  Computation of Inertial Motion: Neural Strategies to Resolve Ambiguous Otolith Information , 1999, The Journal of Neuroscience.

[48]  Kostas Daniilidis,et al.  Hand-Eye Calibration Using Dual Quaternions , 1999, Int. J. Robotics Res..

[49]  N. D. Tillett,et al.  Ground based sensing systems for autonomous agricultural vehicles , 2000 .

[50]  Ronald Azuma,et al.  A motion-stabilized outdoor augmented reality system , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[51]  Irem Stratmann,et al.  Omnidirectional Vision and Inertial Clues for Robot Navigation , 2004, J. Field Robotics.

[52]  Olivier D. Faugeras,et al.  Autonomous navigation of a mobile robot using inertial and visual cues , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[53]  K. Najafi,et al.  A monolithic three-axis micro-g micromachined silicon capacitive accelerometer , 2005, Journal of Microelectromechanical Systems.

[54]  Jacques Droulez,et al.  Visuovestibular perception of self-motion modeled as a dynamic optimization process , 2002, Biological Cybernetics.

[55]  Khoi Nguyen,et al.  Computer-vision-based registration techniques for augmented reality , 1996, Other Conferences.

[56]  Kikuro Fukushima,et al.  Corticovestibular interactions: anatomy, electrophysiology, and functional considerations , 1997, Experimental Brain Research.

[57]  P. Veltink,et al.  Compensation of magnetic disturbances improves inertial and magnetic sensing of human body segment orientation , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[58]  L. Harris,et al.  Visual and non-visual cues in the perception of linear self motion , 2000, Experimental Brain Research.

[59]  Bernd Hürtgen,et al.  Lane following combining vision and DGPS , 2000, Image Vis. Comput..

[60]  Jean-Arcady Meyer,et al.  A contribution to vision-based autonomous helicopter flight in urban environments , 2005, Robotics Auton. Syst..

[61]  H. Bastian.  Sensation and Perception.—I , 1869, Nature.

[62]  Noboru Ohnishi,et al.  Object shape and camera motion recovery using sensor fusion of a video camera and a gyro sensor , 2000, Inf. Fusion.

[63]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[64]  Suya You,et al.  A robust hybrid tracking system for outdoor augmented reality , 2004, IEEE Virtual Reality 2004.

[65]  Giulio Sandini,et al.  Visuo-inertial stabilization in space-variant binocular systems , 2000, Robotics Auton. Syst..

[66]  Giulio Sandini,et al.  Oculo-motor stabilization reflexes: integration of inertial and visual information , 1998, Neural Networks.

[67]  Suya You,et al.  Fusion of vision and gyro tracking for robust augmented reality registration , 2001, Proceedings IEEE Virtual Reality 2001.

[68]  Jorge Dias,et al.  World feature detection and mapping using stereovision and inertial sensors , 2003, Robotics Auton. Syst..

[69]  Jorge Lobo,et al.  Fusing of image and inertial sensing for camera calibration , 2001, Conference Documentation International Conference on Multisensor Fusion and Integration for Intelligent Systems. MFI 2001 (Cat. No.01TH8590).

[70]  Thierry Viéville,et al.  Computation of ego motion using the vertical cue , 2005, Machine Vision and Applications.

[71]  Markus Vincze,et al.  Fusion of Vision and Inertial Data for Motion and Structure Estimation , 2004, J. Field Robotics.

[72]  Jorge Dias,et al.  Relative Pose Calibration Between Visual and Inertial Sensors , 2007, Int. J. Robotics Res..

[73]  Sukhan Lee,et al.  Micromachined inertial sensors , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[74]  R. Chellappa,et al.  Bayesian structure from motion using inertial information , 2002, Proceedings. International Conference on Image Processing.

[75]  Ernst D. Dickmanns,et al.  Vehicles Capable of Dynamic Vision: A New Breed of Technical Beings? , 1998, Artif. Intell..

[76]  Giulio Sandini,et al.  Learning visual stabilization reflexes in robots with moving eyes , 2002, Neurocomputing.

[77]  Jorge Nuno de Almeida e Sousa Lobo.  Inertial sensor data integration in computer vision systems , 2002 .

[78]  Jorge Dias,et al.  Vision and Inertial Sensor Cooperation Using Gravity as a Vertical Reference , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[79]  A. Pinz,et al.  Calibration of Hybrid Vision / Inertial Tracking Systems * , 2005 .

[80]  Kiriakos N. Kutulakos,et al.  A Theory of Shape by Space Carving , 2000, International Journal of Computer Vision.

[81]  Thierry Viéville,et al.  Computation of ego-motion and structure from visual and inertial sensors using the vertical cue , 1993, 1993 (4th) International Conference on Computer Vision.

[82]  A. Berthoz,et al.  The Brain’s Sense of Movement , 2000 .

[83]  R. Rocha.  Building volumetric maps with cooperative mobile robots and useful information sharing : a distributed control approach based on entropy , 2006 .

[84]  A. Pinz,et al.  Inertial tracking for mobile augmented reality , 2002, IMTC/2002. Proceedings of the 19th IEEE Instrumentation and Measurement Technology Conference (IEEE Cat. No.00CH37276).

[85]  Tyrone L. Vincent,et al.  Three-Dimensional Motion and Structure Estimation Using Inertial Sensors and Computer Vision for Augmented Reality , 2002, Presence: Teleoperators & Virtual Environments.

[86]  Steven A. Shafer,et al.  What is the center of the image? , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[87]  John S. Zelek,et al.  Towards Bayesian real-time optical flow , 2004, Image Vis. Comput..

[88]  D. Whitteridge.  Movements of the eyes R. H. S. Carpenter, Pion Ltd, London (1977), 420 pp., $27.00 , 1979, Neuroscience.

[89]  Kenichi Kanatani,et al.  Geometric computation for machine vision , 1993 .

[90]  B. Caprile,et al.  Using vanishing points for camera calibration , 1990, International Journal of Computer Vision.

[91]  W. Yang,et al.  Joint Motion and Disparity Fields Estimation for Stereoscopic Video Sequences , 2005, Signal Process. Image Commun..

[92]  Stephen M. Smith,et al.  SUSAN—A New Approach to Low Level Image Processing , 1997, International Journal of Computer Vision.

[93]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .

[94]  Per Skoglar,et al.  Navigation Aided Image Processing in UAV Surveillance: Preliminary Results and Design of an Airborne Experimental System , 2004, J. Field Robotics.

[95]  Thierry Viéville.  A Few Steps Towards 3D Active Vision , 1997 .

[96]  C. Blakemore,et al.  Functional imaging of brain areas involved in the processing of coherent and incoherent wide field-of-view visual motion , 2000, Experimental Brain Research.

[97]  Olivier Faugeras,et al.  Cooperation of the inertial and visual systems , 1990 .

[98]  Leo Dorst,et al.  First order error propagation of the Procrustes method for 3D attitude estimation , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[99]  Camillo J. Taylor,et al.  Camera trajectory estimation using inertial sensor measurements and structure from motion results , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[100]  M. Shuster.  The kinematic equation for the rotation vector , 1993 .

[101]  Carme Torras,et al.  Fusing Visual and Inertial Sensing to Recover Robot Ego-motion , 2004, J. Field Robotics.

[102]  Sanjiv Singh,et al.  Optimal motion estimation from visual and inertial measurements , 2002, Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings..

[103]  Zhengyou Zhang,et al.  Flexible camera calibration by viewing a plane from unknown orientations , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[104]  Jorge Lobo,et al.  Vertical world feature detection and mapping using stereo vision and accelerometers , 2001 .

[105]  Peter H. Veltink,et al.  Inertial and magnetic sensing of human movement near ferromagnetic materials , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[106]  Suya You,et al.  Augmented virtual environments (AVE): dynamic fusion of imagery and 3D models , 2003, IEEE Virtual Reality, 2003. Proceedings..

[107]  Jorge Dias,et al.  Inertial Sensed Ego-motion for 3D Vision , 2004, J. Field Robotics.

[108]  H. Durrant-Whyte,et al.  Initial calibration and alignment of an inertial navigation , 1997, Proceedings Fourth Annual Conference on Mechatronics and Machine Vision in Practice.

[109]  Robert C. Bolles,et al.  Background modeling for segmentation of video-rate stereo sequences , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[110]  Stevica Graovac.  Principles of Fusion of Inertial Navigation and Dynamic Vision , 2004, J. Field Robotics.

[111]  Peter I. Corke.  An inertial and visual sensing system for a small autonomous helicopter , 2004 .

[112]  David R. Nadeau,et al.  VRML 2.0 Sourcebook , 1995 .

[113]  Wen-Hsiang Tsai,et al.  Camera Calibration by Vanishing Lines for 3-D Computer Vision , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[114]  Helder Araújo,et al.  Simulating pursuit with machines. Experiments with robots and artificial vision , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.