A Framework of Wearable Sensor-System Development for Urban 3D Modeling

Recently, with the expansion of the smart city and autonomous driving-related technologies within complex urban structures, there has been an increase in the demand for precise 3D modeling technology. Wearable sensor systems can contribute to the construction of seamless 3D models for complex urban environments, as they can be utilized in various environments that are difficult to access using other sensor systems. Consequently, various studies have developed and utilized wearable sensor systems suitable for different target sites and purposes. However, studies have not yet suggested an overall framework for building a wearable system, including a system design method and an optimal calibration process. Therefore, this study aims to propose a framework for wearable system development, by presenting guidelines for wearable sensor system design and a calibration framework optimized for wearable sensor systems. Furthermore, calibration based on point–plane correspondences is proposed. A wearable sensor system was developed based on the proposed guidelines and it efficiently acquired data; the system calibration and data fusion results for the proposed framework showed improved performance in a comparative evaluation.

[1]  Rainer Stiefelhagen,et al.  HIDA: Towards Holistic Indoor Understanding for the Visually Impaired via Semantic Instance Segmentation with a Wearable Solid-State LiDAR Sensor , 2021, 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW).

[2]  François Pomerleau,et al.  Mapping in unstructured natural environment: a sensor fusion framework for wearable sensor suites , 2021, SN Applied Sciences.

[3]  Changjae Kim,et al.  Proposed New AV-Type Test-Bed for Accurate and Reliable Fish-Eye Lens Camera Self-Calibration , 2021, Sensors.

[4]  Changjae Kim,et al.  Kinematic In Situ Self-Calibration of a Backpack-Based Multi-Beam LiDAR System , 2021, Applied Sciences.

[5]  Yang Yu,et al.  A Novel Dual-Lidar Calibration Algorithm Using Planar Surfaces , 2019, 2019 IEEE Intelligent Vehicles Symposium (IV).

[6]  Yecheng Lyu,et al.  An Interactive LiDAR to Camera Calibration , 2019, 2019 IEEE High Performance Extreme Computing Conference (HPEC).

[7]  Changjae Kim,et al.  Analysis of Fish-Eye Lens Camera Self-Calibration , 2019, Sensors.

[8]  Babak Majidi,et al.  3D Modeling of Urban Environment for Efficient Renewable Energy Production in the Smart City , 2019, 2019 7th Iranian Joint Congress on Fuzzy and Intelligent Systems (CFIS).

[9]  Diego González-Aguilera,et al.  Use of a Wearable Mobile Laser System in Seamless Indoor 3D Mapping of a Complex Historical Site , 2018, Remote. Sens..

[10]  Martin Lauer,et al.  Automatic Calibration of Multiple Cameras and Depth Sensors with a Spherical Target , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[11]  Zhenhua Xiong,et al.  A Novel Method for LiDAR Camera Calibration by Plane Fitting , 2018, 2018 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM).

[12]  Levente Hajder,et al.  Accurate Calibration of Multi-LiDAR-Multi-Camera Systems , 2018, Sensors.

[13]  Yongil Kim,et al.  Comprehensive Analysis of System Calibration between Optical Camera and Range Finder , 2018, ISPRS Int. J. Geo Inf..

[14]  Diego González-Aguilera,et al.  Comparing Terrestrial Laser Scanning (TLS) and Wearable Laser Scanning (WLS) for Individual Tree Modeling at Plot Level , 2018, Remote. Sens..

[15]  Levente Hajder,et al.  Accurate Calibration of LiDAR-Camera Systems Using Ordinary Boxes , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[16]  Choi,et al.  Development of LiDAR Simulator for Backpack-mounted Mobile Indoor Mapping System , 2017 .

[17]  Radu Horaud,et al.  An overview of depth cameras and range scanners based on time-of-flight technologies , 2016, Machine Vision and Applications.

[18]  Fabio Morbidi,et al.  Practical and accurate calibration of RGB-D cameras using spheres , 2015, Comput. Vis. Image Underst..

[19]  Silvio Savarese,et al.  Automatic Extrinsic Calibration of Vision and Lidar by Maximizing Mutual Information , 2015, J. Field Robotics.

[20]  David Johnson,et al.  Multi‐Modal Sensor Calibration Using a Gradient Orientation Measure , 2015, J. Field Robotics.

[21]  Javier González,et al.  Extrinsic calibration of a 2d laser-rangefinder and a camera based on scene corners , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[22]  Wang Weimin,et al.  A Mobile System for 3D Indoor Mapping Using LiDAR and Panoramic Camera , 2015 .

[23]  In-So Kweon,et al.  Sensor Fusion of Cameras and a Laser for City-Scale 3D Reconstruction , 2014, Sensors.

[24]  Kyungeun Cho,et al.  Calibration between Color Camera and 3D LIDAR Instruments with a Polygonal Planar Board , 2014, Sensors.

[25]  M. Gross,et al.  Time-of-flight sensor and color camera calibration for multi-view acquisition , 2012, The Visual Computer.

[26]  Ying Zhang,et al.  Walk&Sketch: create floor plans with an RGB-D camera , 2012, UbiComp.

[27]  Andreas Geiger,et al.  Automatic camera and range sensor calibration using a single shot , 2012, 2012 IEEE International Conference on Robotics and Automation.

[28]  Dimitrios G. Kottas,et al.  3D LIDAR–camera intrinsic and extrinsic calibration: Identifiability and analytical least-squares-based initialization , 2012, Int. J. Robotics Res..

[29]  José-Joel Gonzalez-Barbosa,et al.  LIDAR Velodyne HDL-64E Calibration Using Pattern Planes , 2011 .

[30]  Derek D. Lichti,et al.  Static Calibration and Analysis of the Velodyne HDL-64E S2 for High Accuracy Mobile Scanning , 2010, Remote. Sens..

[31]  John R. Spletzer,et al.  On-line calibration of multiple LIDARs on a mobile vehicle platform , 2010, 2010 IEEE International Conference on Robotics and Automation.

[32]  In-So Kweon,et al.  Capturing Village-level Heritages with a Hand-held Camera-Laser Fusion Sensor , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[33]  Gabriele Guidi,et al.  A Multi-Resolution Methodology for the 3D Modeling of Large and Complex Archeological Areas , 2009 .

[34]  Wolfgang Förstner,et al.  Fish-Eye-Stereo Calibration and Epipolar Rectification , 2005 .

[35]  Robert Pless,et al.  Extrinsic calibration of a camera and laser range finder (improves camera calibration) , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[36]  H.A. Beyer,et al.  Accurate calibration of CCD-cameras , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[37]  Homer H. Chen,et al.  Pose determination from line-to-plane correspondences: existence condition and closed-form solutions , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[38]  M. Hämäläinen.  Smart City Development with Digital Twin Technology , 2020, Bled eConference.

[39]  Nina Danilina,et al.  Smart city: automatic reconstruction of 3D building models to support urban development and planning , 2018 .

[40]  Paulo Dias,et al.  Automatic Calibration of Multiple LIDAR Sensors Using a Moving Sphere as Target , 2015, ROBOT.

[41]  Derek D. Lichti,et al.  A rigorous cylinder-based self-calibration approach for terrestrial laser scanners , 2015 .

[42]  Adam Herout,et al.  Calibration of RGB camera with velodyne LiDAR , 2014 .

[43]  Avideh Zakhor,et al.  Automatic Generation of 3 D Thermal Maps of Building Interiors , 2014 .

[44]  Marcus A. Magnor,et al.  A Survey on Time-of-Flight Stereo Fusion , 2013, Time-of-Flight and Depth Imaging.

[45]  Derek D. Lichti,et al.  Error modelling, calibration and analysis of an AM–CW terrestrial laser scanner system , 2007 .

[46]  C. Fraser,et al.  Digital camera calibration methods: Considerations and comparisons , 2006 .

[47]  Dean Brown,et al.  Decentering distortion of lenses , 1966 .