Synchronous playback technology of airborne network video based on RTP

In the flight test, the airborne video data is an important part of the flight test data. In order to solve the problem of synchronous playback of multiple channels of airborne network video data, a synchronous playback scheme of multiple channels of airborne network video data based on the RTP/RTCP protocol is proposed. The network video data streaming and preprocessing mechanism are used in this paper. Firstly, by identifying the data packets, the network video data packets are extracted from the data recorded on the airborne. Then, after unpacking and time calculation of the RTP-encapsulated H.264 video data, it uses FFmpeg’s good decoding capabilities to decode a frame of image, and uses SDL’s excellent video performance to display YUV data. The synchronization mechanism based on timestamp is adopted to realize the fast synchronized playback of multiple airborne network videos. The software adopts modular and multi-threaded design ideas to improve processing efficiency and ensure functional scalability. At present, the system has been successfully applied to the simultaneous playback of multi-channel airborne network video. The actual application effect shows that the system works stably and can effectively improve the efficiency of model flight tests.

[1]  Miska M. Hannuksela,et al.  H.264/AVC video for wireless transmission , 2005, IEEE Wireless Communications.

[2]  Arthur Richards,et al.  AIAA Guidance, Navigation, and Control Conference , 2012 .

[3]  Peng Cheng,et al.  The research of Media streaming technology based on RTP protocol , 2015 .

[4]  Hao Zeng,et al.  Implementation of Video Transcoding Client Based on FFMPEG , 2013 .

[5]  Shuying Li,et al.  A Novel PCM/FM Multi-symbol Detection Algorithm for FPGA Implementation , 2009 .

[6]  Roni Even,et al.  RTP Payload Format for H.264 Video , 2011, RFC.

[7]  Ian F. Akyildiz,et al.  Wireless mesh networks: a survey , 2005, Comput. Networks.

[8]  Gary J. Balas,et al.  Flight Test Evaluation of a Run-time Stability Margin Estimation Tool , 2009 .

[9]  K Li.  Multiple Video Streams Real-time Conversion and Playback Based on FFmpeg and SDL , 2014 .

[10]  Gao Mingyu,et al.  Chinese Display Technology on Embedded Platform Using Simple DirectMedia (SDL) , 2008, 2008 International Workshop on Education Technology and Training & 2008 International Workshop on Geoscience and Remote Sensing.

[11]  Michael Roitzsch.  Slice-balancing H.264 video encoding for improved scalability of multicore decoding , 2007, EMSOFT '07.

[12]  Lei Guo,et al.  Integration of scheduling and network coding in multi-rate wireless mesh networks: Optimization models and algorithms , 2016, Ad Hoc Networks.

[13]  Sanjit K. Mitra,et al.  Demosaicing of images obtained from single-chip imaging sensors in YUV color space , 2005, Pattern Recognit. Lett..