Near-ultrasound communication for TV's 2nd screen services

In this paper, we propose a near-ultrasound chirp signal-based communication for the TV's 2nd screen services. While near-ultrasound (with under 20 kHz frequency) communication has been developed for various applications recently, none of the previous work provides a perfect solution for 2nd screen services between TVs and smart devices. This is due mainly to the following real world challenges. The embedded signal in TV contents should be successfully received in a typical TV-watching environment by (i) delivering information at least at 15 bps with significantly low volume to avoid human perception, (ii) despite the presence of ambient noise, e.g., a tick, a snap, or a knock. To fulfill (i), we design chirp quaternary orthogonal keying (QOK) symbols. Especially, we aim to minimize inter-symbol interference (ISI) effects by symbol design in order to completely eliminate guard intervals. To resolve (ii), we propose the novel J-shape detection algorithms for both frame synchronization and carrier sensing. The proposed modem achieves almost zero frame error rate on a smartphone 2.7 m away from the TV even with minimal receive sound pressure level of 35 dBSPL, i.e., the noise level in a very quiet room. Moreover, throughout experiments and log analysis of 2nd screen service deployed in a nation-wide TV broadcasting system, J-shape detection algorithms are proven to achieve highly resilient performance for both frame synchronization and carrier sensing compared to previous schemes.

[1]  Anthony Rowe,et al.  Indoor pseudo-ranging of mobile devices using ultrasonic chirps , 2012, SenSys '12.

[2]  Nam Soo Kim,et al.  Acoustic Data Transmission Based on Modulated Complex Lapped Transform , 2010, IEEE Signal Processing Letters.

[3]  Cristina Videira Lopes,et al.  Aerial acoustic communications , 2001, Proceedings of the 2001 IEEE Workshop on the Applications of Signal Processing to Audio and Acoustics (Cat. No.01TH8575).

[4]  Ramarathnam Venkatesan,et al.  Dhwani: secure peer-to-peer acoustic NFC , 2013, SIGCOMM.

[5]  Yusuke Nakashima,et al.  Acoustic Communication System Using Mobile Terminal Microphones , 2007 .

[6]  A. Rodríguez Valiente,et al.  Extended high-frequency (9–20 kHz) audiometry reference thresholds in 645 healthy subjects , 2014, International journal of audiology.

[7]  Larry F Hughes,et al.  Hearing in laboratory animals: strain differences and nonauditory effects of noise. , 2005, Comparative medicine.

[8]  Shyamnath Gollakota,et al.  Contactless Sleep Apnea Detection on Smartphones , 2015, GetMobile Mob. Comput. Commun..

[9]  Tommaso Melodia,et al.  U-Wear: Software-Defined Ultrasonic Networking for Wearable Devices , 2015, MobiSys.

[10]  B. W. Lawton Damage to human hearing by airborne sound of very high frequency or ultrasonic frequency , 2001 .

[11]  Michael Hanspach,et al.  On Covert Acoustical Mesh Networks in Air , 2014, J. Commun..

[12]  Sunghyun Choi,et al.  Chirp signal-based aerial acoustic communication for smart devices , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[13]  Desney S. Tan,et al.  FingerIO: Using Active Sonar for Fine-Grained Finger Tracking , 2016, CHI.