Design of a Large Scale Data Stream Recorder

Presently, digital continuous media (CM) are well established as an integral part of many applications. In recent years, a considerable amount of research has focused on the efficient retrieval of such media. Scant attention has been paid to servers that can record such streams in real time. However, more and more devices produce direct digital output streams. Hence, the need arises to capture and store these streams with an efficient data stream recorder that can handle both recording and playback of many streams simultaneously and provide a central repository for all data. We propose a design for a large scale data stream recorder. Our goal was to introduce a unified architecture that integrates multi-stream recording and retrieval in a coherent manner. The discussion raises practical issues such as support for multizone disk drives, variable bit rate media, and disk drives that have a different write than read bandwidth. We provide initial solutions for some issues while others will need to be investigated further. This paper was published in the Proceedings of the 5th International Conference on Enterprise Information Systems 2003 Conference (ICEIS 2003), 23-26 April 2003, Angers, France, and is made available as an electronic reprint with permission.

[1]  Sooyong Kang,et al.  Statistical admission control for soft real-time VOD servers , 2000, SAC '00.

[2]  Cyrus Shahabi,et al.  Yima: A Second-Generation Continuous Media Server , 2002, Computer.

[3]  Shahram Ghandeharizadeh,et al.  Staggered striping in multimedia information systems , 1994, SIGMOD '94.

[4]  Avideh Zakhor,et al.  Variable bit rate MPEG video storage on parallel disk arrays , 1994, Proceedings of lst IEEE International Workshop on Community Networking.

[5]  Henning Schulzrinne,et al.  Real Time Streaming Protocol (RTSP) , 1998, RFC.

[6]  Shahram Ghandeharizadeh,et al.  Buffer sharing in video-on-demand servers , 1997, PERV.

[7]  Jose Renato Santos,et al.  Performance analysis of the RIO multimedia storage system with heterogeneous disk configurations , 1998, MULTIMEDIA '98.

[8]  Walid G. Aref,et al.  Disk scheduling for displaying and recording video in nonlinear news editing systems , 1997, Electronic Imaging.

[9]  Jose Renato Santos,et al.  RIO: a real-time multimedia object server , 1997, PERV.

[10]  Margo I. Seltzer,et al.  Disk Scheduling Revisited , 1990 .

[11]  Richard R. Muntz,et al.  Randomized data allocation for real-time disk I/O , 1996, COMPCON '96. Technologies for the Information Superhighway Digest of Papers.

[12]  Yitzhak Birk,et al.  A novel video layout strategy for near-video-on-demand servers , 1997, Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[13]  Peter T. Kirstein,et al.  The multicast multimedia conference recorder , 1998, Proceedings 7th International Conference on Computer Communications and Networks (Cat. No.98EX226).

[14]  P. Wallich Digital Hubbub , 2002 .

[15]  A. L. Narasimha Reddy,et al.  Disk scheduling in a multimedia I/O system , 1993, MULTIMEDIA '93.

[16]  Berthier A. Ribeiro-Neto,et al.  Comparing random data allocation and data striping in multimedia servers , 2000, SIGMETRICS '00.

[17]  Henning Schulzrinne,et al.  RTP: A Transport Protocol for Real-Time Applications , 1996, RFC.

[18]  Harrick M. Vin,et al.  A statistical admission control algorithm for multimedia servers , 1994, MULTIMEDIA '94.