A Television Channel Real-Time Detector using Smartphones

Recently, people have been interested in sharing what they are watching on TV, allowing the development of Social TV Applications often based on mobile devices. In this context, this paper proposes IRTR (Improved Real-Time TV-channel Recognition): a new method aimed at recognizing in real time (live) what people are watching on TV without any active user interaction. IRTR uses the audio signal of the TV program recorded by smartphones and is performed through two steps: i) fingerprint extraction and ii) TV channel real-time identification. Step i) is based on the computation of the Audio Fingerprint (AF). The AF computation has been taken from the literature and has been improved in terms of power consumption and computation speed to make the smartphone implementation feasible by using an ad hoc cost function aimed at selecting the best set of AF parameters. Step ii) is aimed at deciding the TV channel the user is watching. This step is performed using a likelihood estimation algorithm proposed in this paper. The consumed power, computation and response time, and correct decision rate of IRTR, evaluated through experimental measures, show very satisfying results such as a correct decision rate of about 95%, about 2s of computation time, and above 90% power saving with respect to the literature.

[1]  J. G. Lourens.  Detection and Logging Advertisements using its Sound , 1990, IEEE South African Symposium on Communications and Signal Processing.

[2]  Igor Bisio,et al.  Opportunistic estimation of television audience through smartphones , 2012, 2012 International Symposium on Performance Evaluation of Computer & Telecommunication Systems (SPECTS).

[3]  Helmut Neuschmied,et al.  Robust Sound Modeling for Song Detection in Broadcast Audio , 2002 .

[4]  H. Lilliefors.  On the Kolmogorov-Smirnov Test for Normality with Mean and Variance Unknown , 1967 .

[5]  B. Ripley,et al.  Pattern Recognition , 1968, Nature.

[6]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[7]  P. Mell,et al.  The NIST Definition of Cloud Computing , 2011 .

[8]  Hugo Fastl,et al.  Psychoacoustics: Facts and Models , 1990 .

[9]  Ravi Mathey,et al.  Content Sharing over Smartphone-Based Delay-Tolerant Networks , 2014 .

[10]  Avery Wang,et al.  An Industrial Strength Audio Search Algorithm , 2003, ISMIR.

[11]  Pedro Cano,et al.  A review of algorithms for audio fingerprinting , 2002, 2002 IEEE Workshop on Multimedia Signal Processing..

[12]  J.R. Cerquides,et al.  A Real Time Audio Fingerprinting System for Advertisement Tracking and Reporting in FM Radio , 2007, 2007 17th International Conference Radioelektronika.

[13]  Lei Yang,et al.  Accurate online power estimation and automatic battery behavior based power model generation for smartphones , 2010, 2010 IEEE/ACM/IFIP International Conference on Hardware/Software Codesign and System Synthesis (CODES+ISSS).

[14]  Sergios Theodoridis,et al.  Pattern Recognition, Third Edition , 2006 .

[15]  Yan Feng,et al.  A novel algorithm for audio information retrieval based on audio fingerprint , 2010, 2010 International Conference on Information, Networking and Automation (ICINA).

[16]  Chun-Shien Lu.  Audio fingerprinting based on analyzing time-frequency localization of signals , 2002, 2002 IEEE Workshop on Multimedia Signal Processing..

[17]  Debnath Mukherjee,et al.  An architecture for real time television audience measurement , 2011, 2011 IEEE Symposium on Computers & Informatics.

[18]  Ton Kalker,et al.  A Highly Robust Audio Fingerprinting System With an Efficient Search Strategy , 2003 .

[19]  Margaret Martonosi,et al.  Leveraging Smartphone Cameras for Collaborative Road Advisories , 2012, IEEE Transactions on Mobile Computing.

[20]  Lahouari Ghouti,et al.  A Fingerprinting System for Musical Content , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[21]  Shumeet Baluja,et al.  Content Fingerprinting Using Wavelets , 2006 .

[22]  Frank Kurth,et al.  Identification of Highly Distorted Audio Material for Querying Large Scale Data Bases , 2002 .

[23]  Stephen A. Dyer,et al.  Digital signal processing , 2018, 8th International Multitopic Conference, 2004. Proceedings of INMIC 2004..

[24]  Aravind Srinivasan,et al.  Mobile Data Offloading through Opportunistic Communications and Social Participation , 2012, IEEE Transactions on Mobile Computing.

[25]  Derek Hoiem,et al.  Computer vision for music identification , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[26]  Lin Zhong,et al.  Chameleon: A Color-Adaptive Web Browser for Mobile OLED Displays , 2012, IEEE Transactions on Mobile Computing.

[27]  Seungjae Lee,et al.  Audio fingerprinting based on normalized spectral subband centroids , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[28]  Eric Allamanche,et al.  Content-based Identification of Audio Material Using MPEG-7 Low Level Description , 2001, ISMIR.