Unsupervised construction of 4D semantic maps in a long-term autonomy scenario

Robots are operating for longer times and collecting much more data than just a few years ago. In this setting we are interested in exploring ways of modeling the environment, segmenting out areas ...

[1]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[2]  G. Roth,et al.  View planning for automated three-dimensional object reconstruction and inspection , 2003, CSUR.

[3]  Sven Oesau,et al.  Indoor scene reconstruction using feature sensitive primitive extraction and graph-cut , 2014 .

[4]  Bastian Leibe,et al.  Dense 3D semantic mapping of indoor scenes from RGB-D images , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[5]  Dieter Fox,et al.  Autonomous generation of complete 3D object models using next best view manipulation planning , 2011, 2011 IEEE International Conference on Robotics and Automation.

[6]  Avideh Zakhor,et al.  Floor plan generation and room labeling of indoor environments from laser range data , 2015, 2014 International Conference on Computer Graphics Theory and Applications (GRAPP).

[7]  Roland Siegwart,et al.  Long-term 3D map maintenance in dynamic environments , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[8]  Wolfram Burgard,et al.  Improved Techniques for Grid Mapping With Rao-Blackwellized Particle Filters , 2007, IEEE Transactions on Robotics.

[9]  John J. Leonard,et al.  A Mixture of Manhattan Frames: Beyond the Manhattan World , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  John Folkesson.  Simultaneous localization and mapping with robots , 2005 .

[11]  Ba-Ngu Vo,et al.  Introduction to the issue on multitarget tracking , 2013, IEEE J. Sel. Top. Signal Process..

[12]  Silvio Savarese,et al.  3D Semantic Parsing of Large-Scale Indoor Spaces , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Joachim Hertzberg,et al.  6D SLAM—3D mapping outdoor environments , 2007, J. Field Robotics.

[14]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[15]  Grzegorz Cielniak,et al.  Spectral analysis for long-term robotic mapping , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[16]  Rares Ambrus,et al.  Efficient retrieval of arbitrary objects from long-term robot observations , 2017, Robotics Auton. Syst..

[17]  Marc Hanheide,et al.  Exploiting Probabilistic Knowledge under Uncertain Sensing for Efficient Robot Behaviour , 2011, IJCAI.

[18]  Changchang Wu,et al.  SiftGPU : A GPU Implementation of Scale Invariant Feature Transform (SIFT) , 2007 .

[19]  Gordon Wyeth,et al.  Place categorization and semantic mapping on a mobile robot , 2015, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[20]  Wolfram Burgard,et al.  MINERVA: a second-generation museum tour-guide robot , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[21]  Achim J. Lilienthal,et al.  Point set registration through minimization of the L2 distance between 3D-NDT models , 2012, 2012 IEEE International Conference on Robotics and Automation.

[22]  Albert S. Huang,et al.  Planning to Perceive: Exploiting Mobility for Robust Object Detection , 2011, ICAPS.

[23]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[24]  Rares Ambrus,et al.  Meta-rooms: Building and maintaining long term spatial models in a dynamic world , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Pavel Krsek,et al.  The Trimmed Iterative Closest Point algorithm , 2002, Object recognition supported by user interaction for service robots.

[26]  Lei Shi,et al.  Understand scene categories by objects: A semantic regularized scene classifier using Convolutional Neural Networks , 2015, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[27]  Burcu Akinci,et al.  Automatic Creation of Semantically Rich 3D Building Models from Laser Scanner Data , 2013 .

[28]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Dylan Schwesinger.  3D Perception Based Lifelong Navigation of Service Robots in Dynamic Environments , 2016 .

[30]  Jari Saarinen,et al.  Conditional transition maps: Learning motion patterns in dynamic environments , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[31]  Mihalis Yannakakis,et al.  Searching a Fixed Graph , 1996, ICALP.

[32]  Dieter Fox,et al.  Toward online 3-D object segmentation and mapping , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[33]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[34]  Vladimir Kolmogorov,et al.  An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Tom Duckett,et al.  Experimental Analysis of Sample-Based Maps for Long-Term SLAM , 2009, Int. J. Robotics Res..

[36]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[37]  Joachim Hertzberg,et al.  Towards semantic maps for mobile robots , 2008, Robotics Auton. Syst..

[38]  Wolfram Burgard,et al.  Unsupervised discovery of object classes from range data using latent Dirichlet allocation , 2009, Robotics: Science and Systems.

[39]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[40]  Sanja Fidler,et al.  The Role of Context for Object Detection and Semantic Segmentation in the Wild , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[41]  Subhransu Maji,et al.  Multi-view Convolutional Neural Networks for 3D Shape Recognition , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[42]  Reinhard Klein,et al.  Efficient RANSAC for Point‐Cloud Shape Detection , 2007, Comput. Graph. Forum.

[43]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[44]  Silvio Savarese,et al.  Robust single-view instance recognition , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[45]  Jari Saarinen,et al.  Fast 3D mapping in highly dynamic environments using normal distributions transform occupancy maps , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[46]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[47]  Reinhard Klein,et al.  Automatic reconstruction of parametric building models from indoor point clouds , 2016, Comput. Graph..

[48]  Jörg Stückler,et al.  Distinctive 3D surface entropy features for place recognition , 2013, 2013 European Conference on Mobile Robots.

[50]  Axel Wendt,et al.  Automatic Room Segmentation From Unstructured 3-D Data of Indoor Environments , 2017, IEEE Robotics and Automation Letters.

[51]  Olga Sorkine-Hornung,et al.  Object detection and classification from large‐scale cluttered indoor scans , 2014, Comput. Graph. Forum.

[52]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[53]  Lucas Beyer,et al.  The STRANDS Project: Long-Term Autonomy in Everyday Environments , 2016, IEEE Robotics Autom. Mag..

[54]  John J. Leonard,et al.  Dynamic pose graph SLAM: Long-term mapping in low dynamic environments , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[55]  Joachim Hertzberg,et al.  Building semantic object maps from sparse and noisy 3D data , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[56]  Achim J. Lilienthal,et al.  Has somethong changed here? Autonomous difference detection for security patrol robots , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[57]  Jörg Stückler,et al.  Multi-resolution surfel maps for efficient dense 3D modeling and tracking , 2014, J. Vis. Commun. Image Represent..

[58]  Wolfram Burgard,et al.  The dynamic window approach to collision avoidance , 1997, IEEE Robotics Autom. Mag..

[59]  Jari Saarinen,et al.  Independent Markov chain occupancy grid maps for representation of dynamic environment , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[60]  Sebastian Thrun,et al.  Integrating Grid-Based and Topological Maps for Mobile Robot Navigation , 1996, AAAI/IAAI, Vol. 2.

[61]  Barbara Caputo,et al.  Multi-modal Semantic Place Classification , 2010, Int. J. Robotics Res..

[62]  Rares Ambrus,et al.  Autonomous meshing, texturing and recognition of object models with a mobile robot , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[63]  Markus Vincze,et al.  Automation of “ground truth” annotation for multi-view RGB-D object instance recognition datasets , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[64]  Sebastian Thrun,et al.  FastSLAM: An Efficient Solution to the Simultaneous Localization And Mapping Problem with Unknown Data , 2004 .

[65]  Rares Ambrus,et al.  Unsupervised learning of spatial-temporal models of objects in a long-term autonomy scenario , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[66]  Wolfram Burgard,et al.  Probabilistic Robotics (Intelligent Robotics and Autonomous Agents) , 2005 .

[67]  Andrew W. Fitzgibbon,et al.  KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera , 2011, UIST.

[68]  Wenzhe Li,et al.  Room segmentation: Survey, implementation, and analysis , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[69]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[70]  Richard Szeliski,et al.  Bundle Adjustment in the Large , 2010, ECCV.

[71]  Richard A. Newcombe,et al.  Dense visual SLAM , 2012 .

[72]  Paolo Cignoni,et al.  Reconstructing Textured Meshes from Multiple Range RGB Maps , 2002, VMV.

[73]  Mechthild Stoer,et al.  A simple min-cut algorithm , 1997, JACM.

[74]  Manuela M. Veloso,et al.  The 1,000-km Challenge: Insights and Quantitative and Qualitative Results , 2016, IEEE Intelligent Systems.

[75]  Tim Weyrich,et al.  Real-Time 3D Reconstruction in Dynamic Scenes Using Point-Based Fusion , 2013, 2013 International Conference on 3D Vision.

[76]  Pieter Abbeel,et al.  Optimized color models for high-quality 3D scanning , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[77]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[78]  Dieter Fox,et al.  Toward object discovery and modeling via 3-D scene comparison , 2011, 2011 IEEE International Conference on Robotics and Automation.

[79]  Dieter Fox,et al.  Adapting the Sample Size in Particle Filters Through KLD-Sampling , 2003, Int. J. Robotics Res..

[80]  John J. Leonard,et al.  Toward lifelong object segmentation from change detection in dense RGB-D maps , 2013, 2013 European Conference on Mobile Robots.

[81]  Sanja Fidler,et al.  Holistic Scene Understanding for 3D Object Detection with RGBD Cameras , 2013, 2013 IEEE International Conference on Computer Vision.

[82]  Davis E. King,et al.  Dlib-ml: A Machine Learning Toolkit , 2009, J. Mach. Learn. Res..

[83]  Bhaskara Marthi,et al.  An object-based semantic world model for long-term change detection and semantic querying , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[84]  Tal Hassner,et al.  Interactive Learning for Point‐Cloud Motion Segmentation , 2013, Comput. Graph. Forum.

[85]  Henrik I. Christensen,et al.  RGB-D edge detection and edge-based registration , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[86]  Zoltan-Csaba Marton,et al.  Semantic Labeling of Indoor Environments from 3D RGB Maps , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[87]  Wolfram Burgard,et al.  Robust 3D scan point classification using associative Markov networks , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[88]  Patric Jensfelt,et al.  Approaches to Mobile Robot Localization in Indoor Environments , 2001 .

[89]  Kristoffer Sjöö.  Semantic map segmentation using function-based energy maximization , 2012, 2012 IEEE International Conference on Robotics and Automation.

[90]  Florentin Wörgötter,et al.  Voxel Cloud Connectivity Segmentation - Supervoxels for Point Clouds , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[91]  Nils Bore,et al.  Querying 3D Data by Adjacency Graphs , 2015, ICVS.

[92]  Rares Ambrus,et al.  Modeling motion patterns of dynamic objects by IOHMM , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[93]  Vladlen Koltun,et al.  Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials , 2011, NIPS.

[94]  James M. Rehg,et al.  Visual Place Categorization: Problem, dataset, and algorithm , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[95]  Markus Vincze,et al.  A Global Hypotheses Verification Method for 3D Object Recognition , 2012, ECCV.

[96]  Wolfram Burgard,et al.  Unsupervised learning of 3D object models from partial views , 2009, 2009 IEEE International Conference on Robotics and Automation.

[97]  Sanja Fidler,et al.  Describing the scene as a whole: Joint object detection, scene classification and semantic segmentation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[98]  Wolfram Burgard,et al.  Lifelong localization in changing environments , 2013, Int. J. Robotics Res..

[99]  Patric Jensfelt,et al.  Large-scale semantic mapping and reasoning with heterogeneous modalities , 2012, 2012 IEEE International Conference on Robotics and Automation.

[100]  Michael M. Kazhdan,et al.  Screened poisson surface reconstruction , 2013, TOGS.

[101]  Marc Hanheide,et al.  Long-term topological localisation for service robots in dynamic environments using spectral maps , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[102]  Miroslav Kulich,et al.  Where's waldo at time t ? using spatio-temporal models for mobile robot search , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[103]  Martial Hebert,et al.  Moving object detection with laser scanners , 2013, J. Field Robotics.

[104]  Nils Bore,et al.  Retrieval of arbitrary 3D objects from robot observations , 2015, 2015 European Conference on Mobile Robots (ECMR).

[105]  Thorsten Joachims,et al.  Semantic Labeling of 3D Point Clouds for Indoor Scenes , 2011, NIPS.

[106]  Roland Siegwart,et al.  Unsupervised discovery of repetitive objects , 2010, 2010 IEEE International Conference on Robotics and Automation.

[107]  Markus Vincze,et al.  Autonomous Learning of Object Models on a Mobile Robot , 2017, IEEE Robotics and Automation Letters.

[108]  Tom Duckett,et al.  Spatio-temporal exploration strategies for long-term autonomy of mobile robots , 2017, Robotics Auton. Syst..

[109]  Roland Siegwart,et al.  TSDF-based change detection for consistent long-term dense reconstruction and dynamic object discovery , 2017, ICRA 2017.

[110]  Sebastian Thrun,et al.  Unsupervised Intrinsic Calibration of Depth Sensors via SLAM , 2013, Robotics: Science and Systems.

[111]  Markus Vincze,et al.  Calibration and correction of vignetting effects with an application to 3D mapping , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[112]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[113]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[114]  John J. Leonard,et al.  Towards lifelong feature-based mapping in semi-static environments , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[115]  Derek Hoiem,et al.  Indoor Segmentation and Support Inference from RGBD Images , 2012, ECCV.

[116]  Luc Van Gool,et al.  In-hand scanning with online loop closure , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[117]  Dieter Fox,et al.  RGB-D object discovery via multi-scene analysis , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[118]  Shahram Izadi,et al.  Modeling Kinect Sensor Noise for Improved 3D Reconstruction and Tracking , 2012, 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission.

[119]  Rares Ambrus,et al.  Unsupervised object segmentation through change detection in a long term autonomy scenario , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[120]  Stefan Leutenegger,et al.  ElasticFusion: Dense SLAM Without A Pose Graph , 2015, Robotics: Science and Systems.

[121]  Danica Kragic,et al.  SimTrack: A simulation-based framework for scalable real-time object pose detection and tracking , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[122]  Rares Ambrus,et al.  On the use of unmanned aerial vehicles for autonomous object modeling , 2017, 2017 European Conference on Mobile Robots (ECMR).

[123]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[124]  Gary R. Bradski,et al.  Fast 3D recognition and pose using the Viewpoint Feature Histogram , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[125]  François Pomerleau,et al.  Expanding the Limits of Vision-based Localization for Long-term Route-following Autonomy , 2017, J. Field Robotics.

[126]  Renato Pajarola,et al.  Automatic room detection and reconstruction in cluttered indoor environments with complex room layouts , 2014, Comput. Graph..

[127]  Avideh Zakhor,et al.  Fast, Automated, Scalable Generation of Textured 3D Models of Indoor Environments , 2015, IEEE Journal of Selected Topics in Signal Processing.

[128]  Luis Enrique Sucar,et al.  View planning for 3D object reconstruction with a mobile manipulator robot , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[129]  Raimund Seidel,et al.  Constructing arrangements of lines and hyperplanes with applications , 1983, 24th Annual Symposium on Foundations of Computer Science (sfcs 1983).

[130]  Sven Wachsmuth,et al.  Using articulated scene models for dynamic 3d scene analysis in vista spaces , 2010 .

[131]  Jürgen Pripfl,et al.  Lessons learned from the deployment of a long-term autonomous robot as companion in physical therapy for older adults with dementia a mixed methods study , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[132]  Markus Vincze,et al.  RGB-D object modelling for object recognition and tracking , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[133]  Markus Vincze,et al.  Multimodal cue integration through Hypotheses Verification for RGB-D object recognition and 6DOF pose estimation , 2013, 2013 IEEE International Conference on Robotics and Automation.

[134]  Federico Tombari,et al.  Unique Signatures of Histograms for Local Surface Description , 2010, ECCV.

[135]  John J. Leonard,et al.  Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age , 2016, IEEE Transactions on Robotics.

[136]  Jianxiong Xiao,et al.  Reconstructing the World's Museums , 2012, ECCV.

[137]  Nico Blodow,et al.  Towards 3D Point cloud based object maps for household environments , 2008, Robotics Auton. Syst..

[138]  Thomas Hofmann,et al.  Large Margin Methods for Structured and Interdependent Output Variables , 2005, J. Mach. Learn. Res..

[139]  John Folkesson,et al.  KTH-3D-TOTAL: A 3D dataset for discovering spatial structures for long-term autonomous learning , 2014, 2014 13th International Conference on Control Automation Robotics & Vision (ICARCV).

[140]  Nick Hawes,et al.  A Poisson-spectral model for modelling temporal patterns in human data observed by a robot , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[141]  Renato Pajarola,et al.  Piecewise‐planar Reconstruction of Multi‐room Interiors with Arbitrary Wall Arrangements , 2016, Comput. Graph. Forum.

[142]  Andreas Birk,et al.  Fast Registration Based on Noisy Planes With Unknown Correspondences for 3-D Mapping , 2010, IEEE Transactions on Robotics.

[143]  Vladlen Koltun,et al.  Color map optimization for 3D reconstruction with consumer depth cameras , 2014, ACM Trans. Graph..