NetClust: A Framework for Scalable and Pareto-Optimal Media Server Placement

Effective media server placement strategies are critical for the quality and cost of multimedia services. Existing studies have primarily focused on optimization-based algorithms to select server locations from a small pool of candidates based on the entire topological information and thus these algorithms are not scalable due to unavailability of the small pool of candidates and low-efficiency of gathering the topological information in large-scale networks. To overcome this limitation, a novel scalable framework called NetClust is proposed in this paper. NetClust takes advantage of the latest network coordinate technique to reduce the workloads when obtaining the global network information for server placement, adopts a new K-means-clustering-based algorithm to select server locations and identify the optimal matching between clients and servers. The key contribution of this paper is that the proposed framework optimizes the trade-off between the service delay performance and the deployment cost under the constraints of client location distribution and the computing/storage/bandwidth capacity of each server simultaneously. To evaluate the performance of the proposed framework, a prototype system is developed and deployed in a real-world large-scale Internet. Experimental results demonstrate that 1) NetClust achieves the lower deployment cost and lower delay compared to the traditional server selection method; and 2) NetClust offers a practical and feasible solution for multimedia service providers.

[1]  Robert Tappan Morris,et al.  Vivaldi: a decentralized network coordinate system , 2004, SIGCOMM '04.

[2]  Miguel Castro,et al.  PIC: practical Internet coordinates for distance estimation , 2004, 24th International Conference on Distributed Computing Systems, 2004. Proceedings..

[3]  Aman Shaikh,et al.  Placing Relay Nodes for Intra-Domain Path Diversity , 2006, Proceedings IEEE INFOCOM 2006. 25TH IEEE International Conference on Computer Communications.

[4]  Lakshminarayanan Subramanian,et al.  An investigation of geographic mapping techniques for internet hosts , 2001, SIGCOMM 2001.

[5]  Bobby Bhattacharjee,et al.  Decentralized, accurate, and low-cost network bandwidth prediction , 2011, 2011 Proceedings IEEE INFOCOM.

[6]  Yuval Shavitt,et al.  Constrained mirror placement on the Internet , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).

[7]  Lili Qiu,et al.  On the placement of Web server replicas , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).

[8]  Pangfeng Liu,et al.  Optimizing server placement in distributed systems in the presence of competition , 2011, J. Parallel Distributed Comput..

[9]  Amin Vahdat,et al.  Service Placement in a Shared Wide-Area Platform , 2006, USENIX Annual Technical Conference, General Track.

[10]  Sudipto Guha,et al.  Improved combinatorial algorithms for the facility location and k-median problems , 1999, 40th Annual Symposium on Foundations of Computer Science (Cat. No.99CB37039).

[11]  Chuang Lin,et al.  Content delivery networks: a bridge between emerging applications and future IP networks , 2010, IEEE Network.

[12]  Alan Sussman,et al.  Searching for Bandwidth-Constrained Clusters , 2011, 2011 31st International Conference on Distributed Computing Systems.

[13]  Yuval Shavitt,et al.  Big-bang simulation for embedding network distances in Euclidean space , 2004, IEEE/ACM Transactions on Networking.

[14]  Michael Dahlin,et al.  End-to-end WAN service availability , 2001, TNET.

[15]  Sang-goo Lee,et al.  A Server Placement Algorithm Conscious of Communication Delays and Relocation Costs , 2002, NETWORKING Workshops.

[16]  Randy H. Katz,et al.  Dynamic Replica Placement for Scalable Content Delivery , 2002, IPTPS.

[17]  Kalyanmoy Deb,et al.  Multi-objective Optimization , 2014 .

[18]  Aditya Akella,et al.  On the treeness of internet latency and bandwidth , 2009, SIGMETRICS '09.

[19]  Sven Buchholz,et al.  Replica placement in adaptive content distribution networks , 2004, SAC '04.

[20]  Pavlin Radoslavov,et al.  Topology-informed Internet replica placement , 2002, Comput. Commun..

[21]  Azer Bestavros,et al.  Distributed Placement of Service Facilities in Large-Scale Networks , 2007, IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications.

[22]  Jon Crowcroft,et al.  Lighthouses for Scalable Distributed Location , 2003, IPTPS.

[23]  Hui Zhang,et al.  Predicting Internet network distance with coordinates-based approaches , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[24]  Bo Li,et al.  On the Optimal Placement of Web Proxies in the Internet: The Linear Topology , 1998, HPN.

[25]  Lúcia Maria de A. Drummond,et al.  Solving Replica Placement and Request Distribution in Content Distribution Networks , 2010, Electron. Notes Discret. Math..

[26]  Gabi Nakibly,et al.  A Traffic Engineering Approach for Placement and Selection of Network Services , 2007 .

[27]  Jianliang Xu,et al.  Placement problems for transparent data replication proxy services , 2002, IEEE J. Sel. Areas Commun..

[28]  L. B. Wilson,et al.  The stable marriage problem , 1971, Commun. ACM.