Ultra-fast live video-in-video insertion for H.264/AVC

In this work, an ultra-fast live video-in-video (ViV) insertion scheme is presented, according to which a predefined video content, such as a video advertisement, can be inserted in real-time into a predefined location within a pre-encoded video stream. According to the proposed scheme, the video insertion process is performed in two steps. The first step includes the modification of a conventional H.264/AVC video encoder to support the visual content insertion by using either the Flexible Macroblock Ordering (FMO) technique or by using the Variable Length Coding (VLC)/Variable Length Decoding (VLD). In the second step, the ViV insertion is performed separately for each overlay, while operating in a compressed domain. The presented scheme provides significant improvements in terms of both the bit-rate and insertion run-time: the time period of the proposed ViV insertion process is extremely fast, i.e. up to 8000 times faster compared to JM 17.2 reference software and more than 100 times faster compare to the commercial VSS® (Vanguard Software Solutions®) Streaming Codec Pack 4.5. Also, the bitrate overhead is very low.

[1]  Tamar Shoham,et al.  Fast H.264 Picture in Picture (PIP) transcoder with B-slices and direct mode support , 2010, Melecon 2010 - 2010 15th IEEE Mediterranean Electrotechnical Conference.

[2]  Y. Takishima,et al.  High Quality Logo Insertion Algorithm for H.264/AVC , 2008, 2008 Digest of Technical Papers - International Conference on Consumer Electronics.

[3]  Ofer Hadar,et al.  Efficient Real-Time Video-in-Video Insertion into a Pre-Encoded Video Stream , 2011 .

[4]  Nuno Roma,et al.  A tutorial overview on the properties of the discrete cosine transform for encoded image and video processing , 2011, Signal Process..