Apparatus and method of encoding video and apparatus and method of decoding encoded video

An apparatus and method for encoding images and an apparatus and method for decoding encoded images are provided to encode a main image and a sub-images by using the same encoding scheme, and combine the encoded main image with the sub-image to generate a bit stream. An image encoding apparatus includes an encoder(130) and a bit stream packing unit(150). The encoder encodes a main image and a sub-image to generate main image data and sub-image data, and a bit stream packing unit for combining the encoded main image data with the encoded sub-image data to pack a single bit stream. An image decoding apparatus includes a bit stream unpacking unit and a decoder. The unpacking unit unpacks the packed bit stream to separate the encoded main image data from the encoded sub-image data. The decoder decodes the encoded main image data and the encoded sub-image data to generate a restored image.