Structuring of an Adaptive Multi-channel Audio-Play System Based on the TMO Scheme

This paper presents a modular and easily analyzable design of a flexible sound rendering system called the Adaptive Multi-channel Audio-play System (AMAS). This case-study is a follow-on of the earlier study on the effectiveness of the TMO scheme as an approach for easily analyzable efficient design of a major class of real-time distributed multimedia computing applications. AMAS is an extension of the earlier developed distributed sound system. In AMAS a set of player nodes which are single-board computers equipped with speakers and micro-phones are connected via Ethernet to a controller node equipped with audio file storage and user interfaces. Multi-channel music is played in manners adaptive to the locations of the speakers and the listener. In addition, AMAS possesses the mechanisms for creating the effects of specified sound-generator objects (SGOs), e.g., musical instruments, positioned differently from the positioning that existed at the time of original recording. The TMO-based design and implementation approaches effective for realization of high-quality AMAS are presented. Some experimental evaluation results are also presented.

[1]  Sheng Liu,et al.  Distributed computing based streaming and play of music ensemble realized through TMO programming , 2005, 10th IEEE International Workshop on Object-Oriented Real-Time Dependable Systems.

[2]  Hermann Kopetz,et al.  Real-time systems , 2018, CSC '73.

[3]  K. H. Kim Object Structures for Real-Time Systems and Simulators , 1997, Computer.

[4]  Ville Pulkki,et al.  Virtual Sound Source Positioning Using Vector Base Amplitude Panning , 1997 .

[5]  Akio Ando,et al.  A 22.2 Multichannel Sound System for Ultrahigh-Definition TV (UHDTV) , 2008 .

[6]  Jyri Huopaniemi,et al.  DSP tool to 8-channel audio mixing , 1996 .

[7]  Sheng Liu,et al.  RMMC programming model and support execution engine in the TMO programming scheme , 2005, Eighth IEEE International Symposium on Object-Oriented Real-Time Distributed Computing (ISORC'05).

[8]  Hee Yong Youn,et al.  A middleware model supporting time-triggered message-triggered objects for standard Linux systems , 2007, Real-Time Systems.

[9]  K. H. Kim,et al.  APIs for Real-Time Distributed Object Programming , 2000, Computer.

[10]  K. H. Kim,et al.  Realization of an Adaptive Distributed Sound System Based on Global-Time-Based Coordination and Listener Localization , 2008, 2008 11th IEEE International Symposium on Object and Component-Oriented Real-Time Distributed Computing (ISORC).

[11]  Michael S. Brandstein,et al.  A practical methodology for speech source localization with microphone arrays , 1997, Comput. Speech Lang..