Interactive manipulation through augmented virtuality using processed video contents

Describes an interactive manipulation technique for objects in video images extracted by an efficient algorithm. An object contained in a video image has to be able to be extracted at a reasonable speed and a moving object is able to be tracked within a sufficient accuracy. Moreover, any interaction method for real objects with such functions has to be established using a technique for manipulating objects in virtual worlds. An interactive digital fishtank is described as one example application of the proposed technique. In this application, the user is able to obtain various video sequences of fishtanks from any video sequence.