Real-time video merging method and system, visual surveillance system and virtual visual tour system using the real-time video merging

The present invention relates to a method and a system for real-time video merging. The system for real-time video merging according to the present invention includes: a background three-dimensional coordinate calculating unit for calculating the three-dimensional coordinates of a background, based on videos received from a plurality of cameras, and storing the background and the three-dimensional coordinates thereof; a real-time background texture updating unit for updating the texture of the background in real time; an inflow object detecting unit for detecting an external object flowing into the background; an inflow object three-dimensional coordinate calculating unit for calculating the three-dimensional coordinates of the detected external object; an object transforming unit for transforming the three-dimensional coordinates of the external object to be suited to the background and mapping the texture to the object; a background generating unit for generating a final background; a final image generating unit for inserting the texture-mapped object in the final background, merging the final background with the background of an adjacent camera to generate a final image; and a control unit for controlling at least one among the components. According to the present invention, the system can enable a user to easily grasp the whole situation in real time by reconstructing a plurality of screens recorded by each camera into one integrated screen and displaying it, and can enable a person, who cannot directly visit a surveillance area, to indirectly experience the surveillance area in real time by reconstructing a video independently recorded by cameras and displaying the video, according to the vision of a virtual experient, when the virtual experient moves along a path in the surveillance area. [Reference numerals] (400) Real-time background texture updating unit; (410) Background three-dimensional coordinate calculating unit; (420) Background generating unit; (430) Inflow object detecting unit; (44) User terminal; (440) Inflow object three-dimensional coordinate calculating unit; (450) Object transforming unit; (46) Network; (460) Final image generating unit; (470) Control unit