A Method for Estimating Surveillance Video Georeferences

The integration of a surveillance camera video with a three-dimensional (3D) geographic information system (GIS) requires the georeferencing of that video. Since a video consists of separate frames, each frame must be georeferenced. To georeference a video frame, we rely on the information about the camera view at the moment that the frame was captured. A camera view in 3D space is completely determined by the camera position, orientation, and field-of-view. Since the accurate measuring of these parameters can be extremely difficult, in this paper we propose a method for their estimation based on matching video frame coordinates of certain point features with their 3D geographic locations. To obtain these coordinates, we rely on high-resolution orthophotos and digital elevation models (DEM) of the area of interest. Once an adequate number of points are matched, Levenberg–Marquardt iterative optimization is applied to find the most suitable video frame georeference, i.e., position and orientation of the camera.

[1]  Suya You,et al.  Augmented virtual environments (AVE): dynamic fusion of imagery and 3D models , 2003, IEEE Virtual Reality, 2003. Proceedings..

[2]  Richard P. Wildes,et al.  Video georegistration: algorithm and quantitative evaluation , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[3]  Antonio Sánchez-Esguevillas,et al.  A Semantic Autonomous Video Surveillance System for Dense Camera Networks in Smart Cities , 2012, Sensors.

[4]  Bratislav Predic,et al.  Integration of GIS and video surveillance , 2016, Int. J. Geogr. Inf. Sci..

[5]  K. Madhava Krishna,et al.  Realtime multibody visual SLAM with a smoothly moving monocular camera , 2011, 2011 International Conference on Computer Vision.

[6]  Frits H. Post,et al.  Spatial Navigation for Context-Aware Video Surveillance , 2010, IEEE Computer Graphics and Applications.

[7]  Xuejun Liu,et al.  Camera Coverage Estimation Based on Multistage Grid Subdivision , 2017, ISPRS Int. J. Geo Inf..

[8]  Kenneth Levenberg.  A METHOD FOR THE SOLUTION OF CERTAIN NON – LINEAR PROBLEMS IN LEAST SQUARES , 1944 .

[9]  Ramakant Nevatia,et al.  Robust camera calibration tool for video surveillance camera in urban environment , 2011, CVPR 2011 WORKSHOPS.

[10]  Stephan Nebiker,et al.  UAV-based Augmented Monitoring - Real-time Georeferencing and Integration of Video Imagery with Virtual Globes , 2008 .

[11]  Richard Szeliski,et al.  Building Rome in a day , 2009, ICCV.

[12]  Michael A. Goodrich,et al.  UAV video coverage quality maps and prioritized indexing for wilderness search and rescue , 2010, HRI 2010.

[13]  Takai Yoshiaki,et al.  Video Monitoring System for Security Surveillance based on Augmented Reality , 2002 .

[14]  Xiaogang Wang,et al.  Intelligent multi-camera video surveillance: A review , 2013, Pattern Recognit. Lett..

[15]  Manolis I. A. Lourakis.  A Brief Description of the Levenberg-Marquardt Algorithm Implemented by levmar , 2005 .

[16]  Steven M. Seitz,et al.  Accurate Geo-Registration by Ground-to-Aerial Image Matching , 2014, 2014 2nd International Conference on 3D Vision.

[17]  Abdelhamid Tayebi,et al.  Attitude stabilization of a VTOL quadrotor aircraft , 2006, IEEE Transactions on Control Systems Technology.

[18]  Suya You,et al.  3D video surveillance with Augmented Virtual Environments , 2003, IWVS '03.

[19]  Xuejun Liu,et al.  Video surveillance GIS: A novel application , 2013, 2013 21st International Conference on Geoinformatics.

[20]  Andrés F. Osorio,et al.  Environmental applications of camera images calibrated by means of the Levenberg-Marquardt method , 2013, Comput. Geosci..

[21]  Justin Simpson,et al.  Handbook for Transformation of Datums, Projections, Grids, and Common Coordinate Systems , 1996 .

[22]  Qing Zhu,et al.  A NoSQL-SQL Hybrid Organization and Management Approach for Real-Time Geospatial Data: A Case Study of Public Security Video Surveillance , 2017, ISPRS Int. J. Geo Inf..

[23]  Aleksandar Milosavljevic,et al.  GIS-augmented video surveillance , 2010, Int. J. Geogr. Inf. Sci..

[24]  D. Marquardt.  An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[25]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Reda Yaagoubi,et al.  HybVOR: A Voronoi-Based 3D GIS Approach for Camera Surveillance Network Placement , 2015, ISPRS Int. J. Geo Inf..

[27]  Xuejun Liu,et al.  Integration of GIS and Moving Objects in Surveillance Video , 2017, ISPRS Int. J. Geo Inf..

[28]  James W. Davis,et al.  A Fast Linear Registration Framework for Multi-camera GIS Coordination , 2008, 2008 IEEE Fifth International Conference on Advanced Video and Signal Based Surveillance.

[29]  Adam C. Winstanley,et al.  Spatial video and GIS , 2011, Int. J. Geogr. Inf. Sci..

[30]  Stephan Nebiker,et al.  REAL-TIME GEOREGISTRATION OF VIDEO STREAMS FROM MINI OR MICRO UAS USING DIGITAL 3D CITY MODELS , 2009 .

[31]  Ralf Reulke,et al.  Traffic Surveillance using Multi-Camera Detection and Multi-Target Tracking , 2007 .

[32]  James R. Bergen,et al.  Visual odometry , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[33]  Pascal Fua,et al.  Worldwide Pose Estimation Using 3D Point Clouds , 2012, ECCV.

[34]  Impyeong Lee,et al.  CCTV Coverage Index Based on Surveillance Resolution and Its Evaluation Using 3D Spatial Analysis , 2015, Sensors.