The crowd as a cameraman: on-stage display of crowdsourced mobile video at large-scale events

Recording videos with smartphones at large-scale events such as concerts and festivals is very common nowadays. These videos register the atmosphere of the event as it is experienced by the crowd and offer a perspective that is hard to capture by the professional cameras installed throughout the venue. In this article, we present a framework to collect videos from smartphones in the public and blend these into a mosaic that can be readily mixed with professional camera footage and shown on displays during the event. The video upload is prioritized by matching requests of the event director with video metadata, while taking into account the available wireless network capacity. The proposed framework’s main novelty is its scalability, supporting the real-time transmission, processing and display of videos recorded by hundreds of simultaneous users in ultra-dense Wi-Fi environments, as well as its proven integration in commercial production environments. The framework has been extensively validated in a controlled lab setting with up to 1 000 clients as well as in a field trial where 1 183 videos were collected from 135 participants recruited from an audience of 8 050 people. 90 % of those videos were uploaded within 6.8 minutes.

[1]  Sebastian Boring,et al.  #EpicPlay: crowd-sourcing sports video highlights , 2012, CHI.

[2]  Sem C. Borst User-level performance of channel-aware scheduling algorithms in wireless data networks , 2005, IEEE/ACM Transactions on Networking.

[3]  Rauf Izmailov,et al.  Non-real-time content scheduling algorithms for wireless data networks , 2006, IEEE Transactions on Computers.

[4]  Stefanie Wechtitsch,et al.  Selecting User Generated Content for Use in Media Productions , 2016, MMM.

[5]  Nicu Sebe,et al.  Proceedings of the 21st ACM international conference on Multimedia , 2013, MM 2013.

[6]  Chase Qishi Wu,et al.  Complexity Analysis and Algorithm Design for Advance Bandwidth Scheduling in Dedicated Networks , 2013, IEEE/ACM Transactions on Networking.

[7]  Khaled A. Harras,et al.  NEWSMAN: Uploading Videos over Adaptive Middleboxes to News Servers in Weak Network Infrastructures , 2016, MMM.

[8]  Dirk Merkel,et al.  Docker: lightweight Linux containers for consistent development and deployment , 2014 .

[9]  Ebroul Izquierdo,et al.  Bandwidth-Efficient Packet Scheduling for Live Streaming With Network Coding , 2016, IEEE Transactions on Multimedia.

[10]  Justin Manweiler,et al.  FOCUS: clustering crowdsourced videos by line-of-sight , 2013, SenSys.

[11]  Steven Bohez,et al.  Upstream Content Scheduling in Wi-Fi DenseNets during Large-Scale Events , 2015, 2015 IEEE Globecom Workshops (GC Wkshps).

[12]  Wei Tsang Ooi,et al.  Jiku director: a mobile video mashup system , 2013, MM '13.

[13]  Chase Qishi Wu,et al.  Control Plane for Advance Bandwidth Scheduling in Ultra High-Speed Networks , 2006, Proceedings IEEE INFOCOM 2006. 25TH IEEE International Conference on Computer Communications.

[14]  Wei Tsang Ooi,et al.  The jiku mobile video dataset , 2013, MMSys.

[15]  Carsten Griwodz Proceedings of the 4th ACM Multimedia Systems Conference , 2013 .

[16]  Jenq-Neng Hwang,et al.  Quality-of-content (QoC)-driven rate allocation for video analysis in mobile surveillance networks , 2015, 2015 IEEE 17th International Workshop on Multimedia Signal Processing (MMSP).

[17]  Yaser Sheikh,et al.  Automatic editing of footage from multiple social cameras , 2014, ACM Trans. Graph..

[18]  Justin Manweiler,et al.  FOCUS: clustering crowdsourced videos by line-of-sight , 2013, SenSys '13.

[19]  Marcus Thaler,et al.  Multi-sensor concert recording dataset including professional and user-generated content , 2015, MMSys.

[20]  Patrick Th. Eugster,et al.  Fast, expressive top-k matching , 2014, Middleware.

[21]  Wolfgang Effelsberg,et al.  Video composition by the crowd: a system to compose user-generated videos in near real-time , 2015, MMSys.

[22]  Wei Tsang Ooi,et al.  On Demand Retrieval of Crowdsourced Mobile Video , 2015, IEEE Sensors Journal.