Multiresolutional Fusion of Perceptions Applied to Robot Navigation

Visual perception-based autonomously moving virtual agent in virtual reality as a counterpart of an actual robot moving with a given dynamics is investigated. The visual perception is mathematically modelled as a probabilistic process obtaining and interpreting visual information from an environment. The perception obtained in the form of measurements in 2D is used for perceptual robot navigation. By means of this twofold gain is obtained; while the autonomous robot is navigated, it is equipped with some human-like behaviour, thereby dealing with complexity and environmental dynamics. The visual data is processed in a multiresolutional form via wavelet transform and optimally estimated via extended Kalman filtering in each resolution level and the outcomes are fused for improved estimation of the trajectory. The perceptual robotics experiments are carried out in virtual reality for the demonstration of the feasibility of the investigations in this domain. The computer experiments are carried out with perception measurement data, and the sensor/data fusion experiments are carried out by means of simulation. The improvement on the trajectory estimation by means of sensor/data fusion is demonstrated. The research is connected to building technological robotics, where some form of perceptual intelligence, like reaction to moving objects around, is required during operation.

[1]  Michael Wimmer,et al.  Guided visibility sampling , 2006, SIGGRAPH 2006.

[2]  A. Cowey,et al.  Human cortical magnification factor and its relation to visual acuity , 2004, Experimental Brain Research.

[3]  Dirk Söffker,et al.  A Cognitive-Oriented Architecture to Realize Autonomous Behavior - Part I: Theoretical Background , 2006, 2006 IEEE International Conference on Systems, Man and Cybernetics.

[4]  T. Papathomas.  Early vision and beyond , 1995 .

[5]  M. Turvey,et al.  Ecological foundations of cognition. I: Symmetry and specificity of animal-environment systems , 1999 .

[6]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[7]  Dirk Söffker.  From Human–Machine-Interaction Modeling to New Concepts Constructing Autonomous Systems: A Phenomenological Engineering-Oriented Approach , 2001, J. Intell. Robotic Syst..

[8]  Meng Wang,et al.  Online path searching for autonomous robot navigation , 2004, IEEE Conference on Robotics, Automation and Mechatronics, 2004..

[9]  Özer Ciftcioglu,et al.  Statistics on exponential averaging of periodograms , 1995, IEEE Trans. Signal Process..

[10]  Rolf Eckmiller,et al.  Tunable retina encoders for retina implants: why and how , 2005, Journal of neural engineering.

[11]  Michael S. Bittermann,et al.  Studies on visual perception for perceptual robotics , 2006, ICINCO-RA.

[12]  S. Mallat.  A wavelet tour of signal processing , 1998 .

[13]  Dirk Söffker,et al.  A Cognitive-Oriented Architecture to Realize Autonomous Behavior - Part II: Application to Mobile Robotics , 2006, 2006 IEEE International Conference on Systems, Man and Cybernetics.

[14]  Athanasios Papoulis,et al.  Probability, Random Variables and Stochastic Processes , 1965 .

[15]  Lang Hong.  Multiresolutional filtering using wavelet transform , 1993 .

[16]  Sandip Sarkar,et al.  A possible explanation of the low-level brightness–contrast illusions in the light of an extended classical receptive field model of retinal ganglion cells , 2006, Biological Cybernetics.

[17]  James T. Kajiya,et al.  The rendering equation , 1986, SIGGRAPH.

[18]  M. Posner,et al.  The attention system of the human brain. , 1990, Annual review of neuroscience.

[19]  Robert Grover Brown,et al.  Introduction to random signal analysis and Kalman filtering , 1983 .

[20]  Dirk Söffker,et al.  A concept for a cognitive-oriented approach to build autonomous systems , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[21]  J. Foster,et al.  The Nature of Perception , 2000 .

[22]  R. Hecht-Nielsen.  The Mechanism of Thought , 2006 .

[23]  T. Wiesel.  Postnatal development of the visual cortex and the influence of environment , 1982, Nature.

[24]  A. Walden,et al.  Wavelet Methods for Time Series Analysis , 2000 .

[25]  Ronald A. Rensink,et al.  Picture Changes During Blinks: Looking Without Seeing and Seeing Without Looking , 2000 .

[26]  Ramón García-Martínez,et al.  An Integrated Approach of Learning, Planning, and Execution , 2000, J. Intell. Robotic Syst..

[27]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[28]  Ronald A. Rensink,et al.  TO SEE OR NOT TO SEE: The Need for Attention to Perceive Changes in Scenes , 1997 .

[29]  Lionel Moisan,et al.  A Grouping Principle and Four Applications , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Tomaso Poggio,et al.  Computational vision and regularization theory , 1985, Nature.

[31]  J. Taylor,et al.  Neural networks of the brain: their analysis and relation to brain images , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[32]  Michael W. Levine,et al.  Fundamentals of sensation and perception , 1981 .

[33]  Aaron Knoll,et al.  Ray tracing animated scenes using coherent grid traversal , 2006, SIGGRAPH 2006.

[34]  Angélica de Antonio Jiménez,et al.  Modelling the Sensory Abilities of Intelligent Virtual Agents , 2005, Autonomous Agents and Multi-Agent Systems.

[35]  Michael S. Bittermann,et al.  Towards Computer-Based Perception by Modeling Visual Perception: A Probabilistic Theory , 2006, 2006 IEEE International Conference on Systems, Man and Cybernetics.

[36]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  A. Parker,et al.  Quantitative analysis of the responses of V1 neurons to horizontal disparity in dynamic random-dot stereograms. , 2002, Journal of neurophysiology.

[38]  C. Bundesen.  A theory of visual attention. , 1990, Psychological review.

[39]  Bruno O. Shubert,et al.  Random variables and stochastic processes , 1979 .

[40]  A. Treisman.  How the deployment of attention determines what we see , 2006, Visual cognition.

[41]  A. D. Smith,et al.  The Problem of Perception , 2002 .

[42]  A. Jazwinski.  Stochastic Processes and Filtering Theory , 1970 .

[43]  Dirk Neumann,et al.  On Human Factors for Interactive Man-Machine Vision: Requirements of the Neural Visual System to transform Objects into Percepts , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[44]  Robert L. Cook,et al.  Distributed ray tracing , 1998 .

[45]  D. Hubel.  Exploration of the primary visual cortex, 1955–78 , 1982, Nature.

[46]  M. Wertheimer.  Untersuchungen zur Lehre von der Gestalt. II , 1923 .

[47]  A. Gilchrist,et al.  Local and global processes in surface lightness perception , 1995, Perception & psychophysics.

[48]  B JULESZ,et al.  Binocular Depth Perception without Familiarity Cues , 1964, Science.

[49]  B. Anderson,et al.  Optimal Filtering , 1979, IEEE Transactions on Systems, Man, and Cybernetics.

[50]  Brian Scassellati,et al.  Humanoid Robots: A New Kind of Tool , 2000, IEEE Intell. Syst..

[51]  E. Adelson,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[52]  John K. Tsotsos,et al.  Modeling Visual Attention via Selective Tuning , 1995, Artif. Intell..

[53]  Marilena Vendittelli,et al.  Real-time map building and navigation for autonomous robots in unknown environments , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[54]  A. L. I︠A︡rbus.  Eye Movements and Vision , 1967 .

[55]  Michael T. Turvey,et al.  Ecological foundations of cognition. II: Degrees of freedom and conserved quantities in animal-environment systems , 1999 .

[56]  Tamim Asfour,et al.  A cognitive architecture for a humanoid robot: a first approach , 2005, 5th IEEE-RAS International Conference on Humanoid Robots, 2005..

[57]  Michael A. Arbib,et al.  The handbook of brain theory and neural networks , 1995, A Bradford book.

[58]  Wolfram Burgard,et al.  Integrated, plan-based control of autonomous robot in human environments , 2001, IEEE Intelligent Systems.