Int his paper, we present a new method for video sequence segmentation which can be used in video indexation applications. Our approach uses the image content as indices of segmentation. As for most video sequences, the images contain 3D hints. In order to detect these indices efficiently, we develop a two step Hough transformation (HT). The first HT tries to find all lines contained in video image. The second one according to the theory of projective geometry, gives the possible focus of expansion (FOE) point. Once we have all possible FOE positions, simple comparison of these positions tells the difference of video sequences. This method is robust not only for the images taken from well structured objects in the scene as buildings, roads and other man made entities, but also for the scene containing the flower field or other aligned natural objects. The results of the approach are shown at final part of the paper.