Crowd Map: Accurate Reconstruction of Indoor Floor Plans from Crowdsourced Sensor-Rich Videos

Lack of an accurate and low-cost method to reconstruct indoor maps is the main reason behind the current sporadic availability of digital building floor plans. The conventional approach using professional equipment is very costly and only available in the most popular areas. In this paper, we propose and demonstrate CrowdMap, a crowd sourcing system utilizing sensor-rich video data from mobile users for indoor floor plan reconstruction with low-cost. The key idea of CrowdMap is to first jointly leverage crowd sourced sensory and video data to track user movements, then use the inferred user motion traces and context of the image to produce an accurate floor plan. In particular, we exploit the sequential relationship between each consecutive frame abstracted from the video to improve system performance. Our experiments in three college buildings show that CrowdMap achieves a precision of hallway shape around 88%, a recall around 93% and a F-measure around 90%. In addition, we achieve on average 9.8% room area error and on average 6.5% room aspect ratio error. The evaluation result demonstrates a significant improvement of accuracy compared with other crowd sourcing floor plan reconstruction systems.

[1]  Guobin Shen,et al.  Walkie-Markie: Indoor Pathway Mapping Made Easy , 2013, NSDI.

[2]  Philip Steadman Why are most buildings rectangular , 2006 .

[3]  Andrew W. Fitzgibbon,et al.  KinectFusion: Real-time dense surface mapping and tracking , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[4]  Hojung Cha,et al.  LifeMap: A Smartphone-Based Context Provider for Location-Based Services , 2011, IEEE Pervasive Computing.

[5]  Jie Yang,et al.  Push the limit of WiFi based localization for smartphones , 2012, Mobicom '12.

[6]  Richard Szeliski,et al.  Reconstructing building interiors from images , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[7]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..

[8]  David Salesin,et al.  Fast multiresolution image querying , 1995, SIGGRAPH.

[9]  Pei Zhang,et al.  Headio: zero-configured heading acquisition for indoor mobile devices through multimodal context sensing , 2013, UbiComp.

[10]  Richard Szeliski,et al.  Modeling the World from Internet Photo Collections , 2008, International Journal of Computer Vision.

[11]  Hojung Cha,et al.  Unsupervised Construction of an Indoor Floor Plan Using a Smartphone , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[12]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[13]  Toshikazu Kato,et al.  A sketch retrieval method for full color image database-query by visual example , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[14]  Peter Eades,et al.  A Heuristics for Graph Drawing , 1984 .

[15]  Andrew Owens,et al.  SUN3D: A Database of Big Spaces Reconstructed Using SfM and Object Labels , 2013, 2013 IEEE International Conference on Computer Vision.

[16]  Jie Xiong,et al.  ArrayTrack: A Fine-Grained Indoor Location System , 2011, NSDI.

[17]  Moustafa Youssef,et al.  No need to war-drive: unsupervised indoor localization , 2012, MobiSys '12.

[18]  Sebastian Thrun,et al.  Learning Occupancy Grid Maps with Forward Sensor Models , 2003, Auton. Robots.

[19]  David G. Kirkpatrick,et al.  On the shape of a set of points in the plane , 1983, IEEE Trans. Inf. Theory.

[20]  Anshul Rai,et al.  Zee: zero-effort crowdsourcing for indoor localization , 2012, Mobicom '12.

[21]  Moustafa Youssef,et al.  CrowdInside: automatic construction of indoor floorplans , 2012, SIGSPATIAL/GIS.

[22]  Eyal de Lara,et al.  The SkyLoc Floor Localization System , 2007, Fifth Annual IEEE International Conference on Pervasive Computing and Communications (PerCom'07).

[23]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[24]  Silvio Savarese,et al.  Free your Camera: 3D Indoor Scene Understanding from Arbitrary Camera Motion , 2013, BMVC.

[25]  Rafael Grompone von Gioi,et al.  LSD: a Line Segment Detector , 2012, Image Process. Line.

[26]  Yunhao Liu,et al.  WILL: Wireless indoor localization without site survey , 2012, 2012 Proceedings IEEE INFOCOM.

[27]  He Wang,et al.  I am a smartphone and i can tell my user's walking direction , 2014, MobiSys.

[28]  Venkata N. Padmanabhan,et al.  Indoor localization without the pain , 2010, MobiCom.

[29]  Jianxiong Xiao,et al.  Reconstructing the World's Museums , 2012, ECCV.

[30]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[31]  Frank Dürr,et al.  MapGENIE: Grammar-enhanced indoor map construction from crowd-sourced data , 2014, 2014 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[32]  Yafei Dai,et al.  UStore: A Low Cost Cold and Archival Data Storage System for Data Centers , 2015, 2015 IEEE 35th International Conference on Distributed Computing Systems.

[33]  Hwee-Xian Tan,et al.  CIMLoc: A crowdsourcing indoor digital map construction system for localization , 2014, 2014 IEEE Ninth International Conference on Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP).

[34]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[35]  Kaigui Bian,et al.  Jigsaw: indoor floor plan reconstruction via mobile crowdsensing , 2014, MobiCom.

[36]  Robert P. Dick,et al.  Hallway based automatic indoor floorplan construction using room fingerprints , 2013, UbiComp.

[37]  Richard Szeliski,et al.  Manhattan-world stereo , 2009, CVPR.

[38]  P.V.C. Hough,et al.  Machine Analysis of Bubble Chamber Pictures , 1959 .

[39]  Ruizhi Chen,et al.  Heading change detection for indoor navigation with a Smartphone camera , 2011, 2011 International Conference on Indoor Positioning and Indoor Navigation.

[40]  Yunhao Liu,et al.  Robust Trajectory Estimation for Crowdsourcing-Based Mobile Applications , 2014, IEEE Transactions on Parallel and Distributed Systems.

[41]  Yiran Chen,et al.  How is energy consumed in smartphone display applications? , 2013, HotMobile '13.

[42]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Yinda Zhang,et al.  PanoContext: A Whole-Room 3D Context Model for Panoramic Scene Understanding , 2014, ECCV.

[44]  Richard Szeliski,et al.  Towards Internet-scale multi-view stereo , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[45]  C.-C. Jay Kuo,et al.  Content-based image retrieval using multiresolution histogram representation , 1995, Other Conferences.

[46]  Scott Shenker,et al.  Spark: Cluster Computing with Working Sets , 2010, HotCloud.

[47]  Steven M. Seitz,et al.  Capturing indoor scenes with smartphones , 2012, UIST.

[48]  Xing Xie,et al.  Mining interesting locations and travel sequences from GPS trajectories , 2009, WWW '09.