A fair scheduler using cloud computing for digital TV program recommendation system

With hundreds of TV channels, a good TV program recommendation system can save time. Hadoop fair scheduler cloud computing is designed to make information processing and filtering effective and scalable. In cloud computing, computers are connected over a network and perform computation simultaneously; more computation power can be obtained by adding more computer nodes. In the present study, cloud computing is used to build a TV program recommendation system. A fair scheduler cloud structure is applied to improve the system performance. For program recommendation, the K-means recursive clustering algorithm is used for user clustering, the term frequency/inverse document frequency algorithm is applied for finding related popular programs, and k-nearest neighbor is used to recommend programs. Most TV program recommendation systems focus on providing a personal recommendation system. The proposed system also considers user groups and the program watching preferences of the majority. The proposed fair scheduler cloud-based architecture is scalable; a massive amount of information can be processed in real-time to obtain program recommendation results that can represent almost all users.

[1]  Liang-Jie Zhang,et al.  The development and prospect of personalized TV program recommendation systems , 2002, Fourth International Symposium on Multimedia Software Engineering, 2002. Proceedings..

[2]  Chin-Feng Lai,et al.  Dynamic adjustable multimedia streaming service architecture over cloud computing , 2012, Comput. Commun..

[3]  Thomas Sandholm,et al.  Dynamic Proportional Share Scheduling in Hadoop , 2010, JSSPP.

[4]  Jeroen Van Barneveld,et al.  Designing Usable Interfaces for TV Recommender Systems , 2004, Personalized Digital Television.

[5]  Noureddine Mouaddib,et al.  A fuzzy linguistic summarization technique for TV recommender systems , 2003, The 12th IEEE International Conference on Fuzzy Systems, 2003. FUZZ '03..

[6]  Quan Chen,et al.  SAMR: A Self-adaptive MapReduce Scheduling Algorithm in Heterogeneous Environment , 2010, 2010 10th IEEE International Conference on Computer and Information Technology.

[7]  Patrick Baudisch,et al.  TV Scout: Lowering the Entry Barrier to Personalized TV Program Recommendation , 2002, From Integrated Publication and Information Systems to Virtual Information and Knowledge Environments.

[8]  Tomohiro Tsunoda,et al.  Automatic metadata expansion and indirect collaborative filtering for TV program recommendation system , 2006, Multimedia Tools and Applications.

[9]  Hongguang Zhang,et al.  A personalized TV guide system compliant with MHP , 2005, IEEE Trans. Consumer Electron..

[10]  Kyoung-jae Kim,et al.  A recommender system using GA K-means clustering in an online shopping market , 2008, Expert Syst. Appl..

[11]  Laurence T. Yang,et al.  Grid job scheduling using Route with Genetic Algorithm support , 2008, Telecommun. Syst..

[12]  Chun-Chia Lee,et al.  AIMED- A Personalized TV Recommendation System , 2006, EuroITV.

[13]  Judith Masthoff,et al.  Group Modeling: Selecting a Sequence of Television Items to Suit a Group of Viewers , 2004, User Modeling and User-Adapted Interaction.

[14]  Xingshe Zhou,et al.  A Hybrid Learning Approach for TV Program Personalization , 2004, KES.

[15]  R. Tibshirani,et al.  An introduction to the bootstrap , 1993 .

[16]  Veselina G. Jecheva,et al.  Some similarity coefficients and application of data mining techniques to the anomaly-based IDS , 2012, Telecommun. Syst..

[17]  Roberto J. Bayardo,et al.  PLANET: Massively Parallel Learning of Tree Ensembles with MapReduce , 2009, Proc. VLDB Endow..

[18]  Athanasios V. Vasilakos,et al.  Joint Forensics-Scheduling Strategy for Delay-Sensitive Multimedia Applications over Heterogeneous Networks , 2011, IEEE Journal on Selected Areas in Communications.

[19]  Noriyoshi Uratani,et al.  Development and features of a TV navigation system , 2003, IEEE Trans. Consumer Electron..

[20]  Sungyoung Lee,et al.  k-means discriminant maps for data visualization and classification , 2008, SAC '08.

[21]  Rebecca N. Wright,et al.  Privacy-preserving distributed k-means clustering over arbitrarily partitioned data , 2005, KDD '05.

[22]  Xiaowei Liu,et al.  Multiple-Job Optimization in MapReduce for Heterogeneous Workloads , 2010, 2010 Sixth International Conference on Semantics, Knowledge and Grids.

[23]  Robin D. Burke,et al.  Hybrid Recommender Systems: Survey and Experiments , 2002, User Modeling and User-Adapted Interaction.

[24]  Yun Tian,et al.  Improving MapReduce performance through data placement in heterogeneous Hadoop clusters , 2010, 2010 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW).

[25]  F. Girosi,et al.  Some Extensions of the K-Means Algorithm for Image Segmentation and Pattern Classification , 1993 .

[26]  Chao Tian,et al.  A Dynamic MapReduce Scheduler for Heterogeneous Workloads , 2009, 2009 Eighth International Conference on Grid and Cooperative Computing.

[27]  Paul Resnick,et al.  Recommender systems , 1997, CACM.

[28]  John Zimmerman,et al.  Personalization: Improving Ease-of-Use, Trust and Accuracy of a TV Show Recommender , 2002 .

[29]  Hsiao-Hwa Chen,et al.  On Distributed Multimedia Scheduling With Constrained Control Channels , 2011, IEEE Transactions on Multimedia.

[30]  Xingshe Zhou,et al.  TV3P: an adaptive assistant for personalized TV , 2004, IEEE Transactions on Consumer Electronics.

[31]  Liang Zhou,et al.  Multimedia traffic security architecture for the internet of things , 2011, IEEE Network.

[32]  David G. Stork,et al.  Pattern Classification , 1973 .

[33]  R. J. Kuo,et al.  Integration of self-organizing feature map and K-means algorithm for market segmentation , 2002, Comput. Oper. Res..

[34]  Douglas Stott Parker,et al.  Map-reduce-merge: simplified relational data processing on large clusters , 2007, SIGMOD '07.

[35]  Barry Smyth,et al.  Let's Get Personal : Personalised TV Listings on the Web , 1998 .

[36]  BurkeRobin.  Hybrid Recommender Systems , 2002 .

[37]  Ethem Alpaydin,et al.  Introduction to machine learning , 2004, Adaptive computation and machine learning.

[38]  Mostafa Bamha,et al.  Semi-join computation on distributed file systems using map-reduce-merge model , 2010, SAC '10.

[39]  Jie Pan,et al.  Parallelizing Multiple Group-by queries using MapReduce: optimization and cost estimation , 2013, Telecommun. Syst..

[40]  José Juan Pazos-Arias,et al.  A multi-agent open architecture for a TV recommender system: a case study using a Bayesian strategy , 2004, IEEE Sixth International Symposium on Multimedia Software Engineering.

[41]  Wei Tu,et al.  Distributed scheduling scheme for video streaming over multi-channel multi-radio multi-hop wireless networks , 2010, IEEE Journal on Selected Areas in Communications.

[42]  Randy H. Katz,et al.  Topology-aware resource allocation for data-intensive workloads , 2010, APSys '10.

[43]  Xingshe Zhou,et al.  TV Program Recommendation for Multiple Viewers Based on user Profile Merging , 2006, User Modeling and User-Adapted Interaction.

[44]  Dina Goren-Bar,et al.  FIT-recommend ing TV programs to family members , 2004, Comput. Graph..

[45]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .