Self-aware distributed AV sensor and actuator networks for improved media adaptation

Most of the existing research work in the area of media adaptation is concentrated on content adaptation, transcoding and delivery mechanisms without addressing the actual input and output of multimedia data. However, it is the I/O stage of media processing that humans are concerned about. Up until now, most multimedia applications have relied on standalone I/O devices (microphone, headphones, monitor, camera) to capture or render multimedia data. This situation is about to change. Nowadays we are surrounded by a vast number of audio/video (AV) sensors and actuators. They are built into our cellular phones, PDAs, tablets, laptops, and surveillance systems. A natural idea that comes out of this fact is to combine multiple I/O devices into a distributed array of sensors and actuators. The paper shows the feasibility of this idea and shifts media adaptation research away from a single device/stream paradigm towards array multimedia processing. We demonstrate how to transform a network of off-the-shelf devices into a distributed I/O array by providing common time (with tens of microseconds precision) and 3D space coordinates (with a few centimetres precision). We also discuss the implications and potentials of self-calibrating distributed AV-sensor/actuator networks for improved media adaptation.

[1]  P. Rousseeuw.  Least Median of Squares Regression , 1984 .

[2]  K. Ramchandran,et al.  A wavelet zerotree-based hybrid compressed/uncompressed framework for wireless image transmission , 1997, Conference Record of the Thirty-First Asilomar Conference on Signals, Systems and Computers (Cat. No.97CB36136).

[3]  Kannan Ramchandran,et al.  Hybrid compressed-uncompressed framework for wireless image transmission , 1997, Proceedings of International Conference on Image Processing.

[4]  Kannan Ramchandran,et al.  Image transmission using arithmetic coding based continuous error detection , 1998, Proceedings DCC '98 Data Compression Conference (Cat. No.98TB100225).

[5]  Kannan Ramchandran,et al.  Robust image transmission over energy-constrained time-varying channels using multiresolution joint source-channel coding , 1998, IEEE Trans. Signal Process..

[6]  Jim Chou,et al.  The role of arithmetic coding based continuous error detection in digital transmission systems , 1998, Proceedings. 1998 IEEE International Symposium on Information Theory (Cat. No.98CH36252).

[7]  Kannan Ramchandran,et al.  Spatially adaptive statistical modeling of wavelet image coefficients and its application to denoising , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[8]  Kannan Ramchandran,et al.  Low-complexity image denoising based on statistical modeling of wavelet coefficients , 1999, IEEE Signal Processing Letters.

[9]  Kannan Ramchandran,et al.  Graphical statistical modeling of wavelet coefficients and its applications , 2000, SPIE Optics + Photonics.

[10]  Kannan Ramchandran,et al.  Stochastic wavelet-based image modeling using factor graphs and its application to denoising , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[11]  Edgar Nett,et al.  Clock synchronization for wireless local area networks , 2000, Proceedings 12th Euromicro Conference on Real-Time Systems. Euromicro RTS 2000.

[12]  Kannan Ramchandran,et al.  On the transmission of a class of hidden Markov sources over Gaussian channels with applications to image communication , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[13]  K. Ramchandran,et al.  A factor graph framework for semantic indexing and retrieval in video , 2000, 2000 Proceedings Workshop on Content-based Access of Image and Video Libraries.

[14]  Kannan Ramchandran,et al.  Continuous error detection (CED) for reliable communication , 2001, IEEE Trans. Commun..

[15]  J. Elson,et al.  Fine-grained network time synchronization using reference broadcasts , 2002, OSDI '02.

[16]  Thomas S. Huang,et al.  Factor graph framework for semantic video indexing , 2002, IEEE Trans. Circuits Syst. Video Technol..

[17]  Kannan Ramchandran,et al.  Robust video multicast under rate and channel variability with applications to wireless LANs , 2002, 2002 IEEE International Symposium on Circuits and Systems. Proceedings (Cat. No.02CH37353).

[18]  Rainer Lienhart,et al.  Position calibration of audio sensors and actuators in a distributed computing platform , 2003, ACM Multimedia.

[19]  Minerva M. Yeung,et al.  Multimedia technology infrastructure for emerging peer-to-peer applications and services , 2003, IS&T/SPIE Electronic Imaging.

[20]  R. Lienhart,et al.  On the importance of exact synchronization for distributed audio signal processing , 2003, 2003 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (IEEE Cat. No.03TH8684).

[21]  Kannan Ramchandran,et al.  Distributed coding for wireless audio sensors , 2003, 2003 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (IEEE Cat. No.03TH8684).

[22]  Rainer Lienhart,et al.  Providing common I/O clock for wireless distributed platforms , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.