Human-Like Room Segmentation for Domestic Cleaning Robots

Autonomous mobile robots have recently become a popular solution for automating cleaning tasks. In one application, the robot cleans a floor space by traversing and covering it completely. While fulfilling its task, such a robot may create a map of its surroundings. For domestic indoor environments, these maps often consist of rooms connected by passageways. Segmenting the map into these rooms has several uses, such as hierarchical planning of cleaning runs by the robot, or the definition of cleaning plans by the user. Especially in the latter application, the robot-generated room segmentation should match the human understanding of rooms. Here, we present a novel method that solves this problem for the graph of a topo-metric map: first, a classifier identifies those graph edges that cross a border between rooms. This classifier utilizes data from multiple robot sensors, such as obstacle measurements and camera images. Next, we attempt to segment the map at these room–border edges using graph clustering. By training the classifier on user-annotated data, this produces a human-like room segmentation. We optimize and test our method on numerous realistic maps generated by our cleaning-robot prototype and its simulated version. Overall, we find that our method produces more human-like room segmentations compared to mere graph clustering. However, unusual room borders that differ from the training data remain a challenge.

[1]  Jana Kosecka,et al.  Visual door detection integrating appearance and shape cues , 2008, Robotics Auton. Syst..

[2]  Lei Shi,et al.  Application of semi-supervised learning with Voronoi Graph for place classification , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Zhichao Chen,et al.  Visual detection of lintel-occluded doors from a single image , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[4]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[5]  Wolfram Burgard,et al.  Conceptual spatial representations for indoor mobile robots , 2008, Robotics Auton. Syst..

[6]  Roland Siegwart,et al.  A Toolbox for Easily Calibrating Omnidirectional Cameras , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Ben J. A. Kröse,et al.  BIRON, where are you? Enabling a robot to learn new places in a real home environment by integrating spoken dialog and visual localization , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  V. Egido,et al.  A Door Lintel Locator Sensor for Mobile Robot Topological Navigation , 2005, 2005 IEEE Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications.

[9]  Emanuele Menegatti,et al.  Image-based memory for robot navigation using properties of omnidirectional images , 2004, Robotics Auton. Syst..

[10]  Wenzhe Li,et al.  Room segmentation: Survey, implementation, and analysis , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[11]  Sebastian Thrun,et al.  Learning Metric-Topological Maps for Indoor Mobile Robot Navigation , 1998, Artif. Intell..

[12]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[13]  Wolfram Burgard,et al.  Supervised semantic labeling of places using information extracted from sensor data , 2007, Robotics Auton. Syst..

[14]  Antonios Gasteratos,et al.  Semantic mapping for mobile robotics tasks: A survey , 2015, Robotics Auton. Syst..

[15]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..

[16]  Barbara Caputo,et al.  Multi-modal Semantic Place Classification , 2010, Int. J. Robotics Res..

[17]  Josef Kittler,et al.  A survey of the hough transform , 1988, Comput. Vis. Graph. Image Process..

[18]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[19]  Xiaodong Yang,et al.  Robust door detection in unfamiliar environments by combining edge and corner features , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[20]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[21]  Jochen Zeil,et al.  Catchment areas of panoramic snapshots in outdoor scenes. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[22]  Ziyuan Liu,et al.  Extracting semantic indoor maps from occupancy grids , 2014, Robotics Auton. Syst..

[23]  Patric Jensfelt,et al.  Large-scale semantic mapping and reasoning with heterogeneous modalities , 2012, 2012 IEEE International Conference on Robotics and Automation.

[24]  Martin Hägele,et al.  New brooms sweep clean - an autonomous robotic cleaning assistant for professional office cleaning , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[25]  Edward Roy Davies Image space transforms for detecting straight edges in industrial images , 1986, Pattern Recognit. Lett..

[26]  Hinrich Schütze,et al.  Introduction to information retrieval , 2008 .

[27]  Inderjit S. Dhillon,et al.  Weighted Graph Cuts without Eigenvectors A Multilevel Approach , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[29]  P. Bartlett,et al.  Probabilities for SV Machines , 2000 .

[30]  Ben J. A. Kröse,et al.  Jijo-2: An Office Robot that Communicates and Learns , 2001, IEEE Intell. Syst..

[31]  Chih-Jen Lin,et al.  A Practical Guide to Support Vector Classication , 2008 .

[32]  Jongwoo Lim,et al.  Visual place categorization in maps , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[33]  Lorenz Gerstmayr-Hillen,et al.  Dense topological maps and partial pose estimation for visual control of an autonomous cleaning robot , 2013, Robotics Auton. Syst..

[34]  Dieter Fox,et al.  Voronoi Random Fields: Extracting Topological Structure of Indoor Environments via Place Labeling , 2007, IJCAI.

[35]  Marc Hanheide,et al.  Home alone: Autonomous extension and correction of spatial representations , 2011, 2011 IEEE International Conference on Robotics and Automation.

[36]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[37]  Patric Jensfelt,et al.  Hierarchical Multi-Modal Place Categorization , 2011, ECMR.

[38]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[39]  David Fleer,et al.  Comparing holistic and feature-based visual methods for estimating the relative pose of mobile robots , 2017, Robotics Auton. Syst..

[40]  Roland Siegwart,et al.  Cognitive maps for mobile robots - an object based approach , 2007, Robotics Auton. Syst..

[41]  Oliver Schlüter,et al.  Parsimonious loop-closure detection based on global image-descriptors of panoramic images , 2011, 2011 15th International Conference on Advanced Robotics (ICAR).

[42]  Hanno Scharr,et al.  A Scheme for Coherence-Enhancing Diffusion Filtering with Optimized Rotation Invariance , 2002, J. Vis. Commun. Image Represent..

[43]  Hanno Scharr,et al.  Principles of Filter Design , 1999 .

[44]  Tony Lindeberg,et al.  Object recognition using composed receptive field histograms of higher dimensionality , 2004, ICPR 2004.

[45]  David Fleer,et al.  Cleaning robot navigation using panoramic views and particle clouds as landmarks , 2013, Robotics Auton. Syst..

[46]  Ben J. A. Kröse,et al.  From images to rooms , 2007, Robotics Auton. Syst..

[47]  Federico Girosi,et al.  Support Vector Machines: Training and Applications , 1997 .

[48]  W. Youden,et al.  Index for rating diagnostic tests , 1950, Cancer.

[49]  Ananth Ranganathan,et al.  PLISS: Detecting and Labeling Places Using Online Change-Point Detection , 2010, Robotics: Science and Systems.