Stitching videos streamed by mobile phones in real-time

User generated videos with mobile phone cameras are becoming more and more ubiquitous allowing people to share live content with remote parties, possibly in real-time. However with limited mobile phone capabilities, these videos are usually of small resolution, resulting in a small field of view for acceptable quality. Fortunately with the proliferation of video capture-enabled mobile phones, there is high chance that one or more persons will be shooting the same scene from different views. In this demonstration, we are showing an end-to-end system which receives video streams coming from different mobile phones, time synchronizes the streams and produces a single composite mosaic video, and all of this is done in real-time. The proposed system operates without coordination between users. The system has been tested under various capturing conditions such as indoor, outdoor, day and night conditions.

[1]  Y. Takishima,et al.  A fast video stitching method for motion-compensated frames in compressed video streams , 2006, 2006 Digest of Technical Papers International Conference on Consumer Electronics.

[2]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Shmuel Peleg,et al.  Seamless image stitching by minimizing false edges , 2006, IEEE Transactions on Image Processing.

[4]  Ming-Sui Lee,et al.  DCT-domain image registration techniques for compressed video , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[5]  Ulrich Neumann,et al.  Immersive panoramic video , 2000, ACM Multimedia.