Decentralized Sensor Fusion for Ubiquitous Networking Robotics in Urban Areas

In this article we explain the architecture for the environment and sensors that has been built for the European project URUS (Ubiquitous Networking Robotics in Urban Sites), a project whose objective is to develop an adaptable network robot architecture for cooperation between network robots and human beings and/or the environment in urban areas. The project goal is to deploy a team of robots in an urban area to give a set of services to a user community. This paper addresses the sensor architecture devised for URUS and the type of robots and sensors used, including environment sensors and sensors onboard the robots. Furthermore, we also explain how sensor fusion takes place to achieve urban outdoor execution of robotic services. Finally some results of the project related to the sensor network are highlighted.

[1]  Jeffrey K. Uhlmann,et al.  Introduction to the Algorithmics of Data Association in Multiple-Target Tracking , 2017 .

[2]  Alberto Sanfeliu,et al.  OUTDOOR DELAYED-STATE VISUALLY AUGMENTED ODOMETRY , 2007 .

[3]  Juan Andrade-Cetto,et al.  3D mapping for urban service robots , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Jesús Capitán,et al.  Accurate fusion of robot, camera and wireless sensors for surveillance applications , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[5]  Andrew Gilbert,et al.  Scale Invariant Action Recognition Using Compound Features Mined from Dense Spatio-temporal Corners , 2008, ECCV.

[6]  Leslie Pack Kaelbling,et al.  Planning and Acting in Partially Observable Stochastic Domains , 1998, Artif. Intell..

[7]  Alberto Sanfeliu,et al.  Efficient active global localization for mobile robots operating in large and cooperative environments , 2008, 2008 IEEE International Conference on Robotics and Automation.

[8]  Andreu Corominas Murtra,et al.  Geographical information systems for map based navigation in urban environments , 2009, Robotics Auton. Syst..

[9]  Aníbal Ollero,et al.  Delayed-state information filter for cooperative decentralized tracking , 2009, 2009 IEEE International Conference on Robotics and Automation.

[10]  J. Andrade-Cetto,et al.  Ubiquitous networking robotics in urban settings , 2006 .

[11]  Plinio Moreno,et al.  Boosting with Temporal Consistent Learners: An Application to Human Activity Recognition , 2007, ISVC.

[12]  Wolfram Burgard,et al.  A Probabilistic Approach to Collaborative Multi-Robot Localization , 2000, Auton. Robots.

[13]  S. Grime,et al.  Data fusion in decentralized sensor networks , 1994 .

[14]  João Sequeira,et al.  Multirobot coordination by auctioning POMDPs , 2010, 2010 IEEE International Conference on Robotics and Automation.

[15]  Juan Andrade-Cetto,et al.  Reduced state representation in delayed-state SLAM , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[17]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[18]  Kurt Konolige,et al.  Large-Scale Visual Odometry for Rough Terrain , 2007, ISRR.

[19]  Aníbal Ollero,et al.  A probabilistic framework for entire WSN localization using a mobile robot , 2008, Robotics Auton. Syst..

[20]  João Sequeira,et al.  Multirobot Task Assignment in Active Surveillance , 2009, EPIA.

[21]  Alexandre Bernardino,et al.  Waving Detection Using the Local Temporal Consistency of Flow-Based Features for Real-Time Applications , 2009, ICIAR.

[22]  Gary Bradski,et al.  Computer Vision Face Tracking For Use in a Perceptual User Interface , 1998 .

[23]  Juan Andrade-Cetto,et al.  Graph-based Segmentation of Range Data with Applications to 3D Urban Mapping , 2009, ECMR.

[24]  Alberto Sanfeliu,et al.  Action evaluation for mobile robot global localization in cooperative environments , 2008, Robotics Auton. Syst..

[25]  Alberto Sanfeliu,et al.  Integrating asynchronous observations for mobile robot position tracking in cooperative environments , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[26]  Pedro U. Lima,et al.  Decision-theoretic robot guidance for active cooperative perception , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[27]  Alberto Sanfeliu,et al.  Real-Time Software for Mobile Robot Simulation and Experimentation in Cooperative Environments , 2008, SIMPAR.

[28]  Barbara Caputo,et al.  Recognizing human actions: a local SVM approach , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[29]  Giorgio Metta,et al.  YARP: Yet Another Robot Platform , 2006 .

[30]  Ramakrishnan Srikant,et al.  Fast Algorithms for Mining Association Rules in Large Databases , 1994, VLDB.

[31]  Cordelia Schmid,et al.  Learning realistic human actions from movies , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[32]  Cordelia Schmid,et al.  Human Detection Using Oriented Histograms of Flow and Appearance , 2006, ECCV.

[33]  Hugh F. Durrant-Whyte,et al.  Decentralised SLAM with Low-Bandwidth Communication for Teams of Vehicles , 2003, FSR.

[34]  Hugh Durrant-Whyte,et al.  Communication In General Decentralised Filters And The Coordinated Search Strategy , 2004 .

[35]  Alexandre Bernardino,et al.  Optical Flow Based Detection in Mixed Human Robot Environments , 2009, ISVC.

[36]  Serge J. Belongie,et al.  Behavior recognition via sparse spatio-temporal features , 2005, 2005 IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance.

[37]  A. Ollero,et al.  Autonomous perception techniques for urban and industrial fire scenarios , 2007, 2007 IEEE International Workshop on Safety, Security and Rescue Robotics.

[38]  Juan Andrade-Cetto,et al.  Calibrating an outdoor distributed camera network using Laser Range Finder data , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[39]  H. Durrant-Whyte,et al.  The ANSER Project: Data Fusion Across Multiple Uninhabited Air Vehicles , 2003 .

[40]  Sebastian Thrun,et al.  Probabilistic robotics , 2002, CACM.

[41]  Juan Andrade-Cetto,et al.  Information-Based Compact Pose SLAM , 2010, IEEE Transactions on Robotics.

[42]  Hanumant Singh,et al.  Exactly Sparse Delayed-State Filters for View-Based SLAM , 2006, IEEE Transactions on Robotics.

[43]  Richard Bowden,et al.  A real time adaptive visual surveillance system for tracking low-resolution colour targets in dynamically changing scenes , 2003, Image Vis. Comput..

[44]  Filiberto Pla,et al.  Extracting Motion Features for Visual Human Activity Representation , 2005, IbPRIA.

[45]  Saeed Masoudnia,et al.  Team Description Paper , 2006 .

[46]  Pedro U. Lima,et al.  ISocRob 2009 Team Description Paper , 2009 .

[47]  Pedro U. Lima,et al.  MERMAID – MULTIPLE-ROBOT MIDDLEWARE FOR INTELLIGENT DECISION-MAKING , 2007 .