Scalable e-business social network using MultiCrawler agent

Social networking is a big buzz phrase nowadays. It refers to the practice of interacting with others online via blogs, forums, social media sites and other outlets. The importance of social networking is to let others know that we are exists. Social network can show how people in our extended network are related to each other. In this paper, we are focusing on e-business network since e-business is sprouting on the Internet these days like wild mushrooms. Moreover, with the rapid growth of the e-business in the Web, searching the popular web page of e-business and its relationship with others web page becomes an interesting and important issue for the user especially for the firms. Currently, we realized which of the e-business having the highest popularity via the newspaper, magazines and Internet. However, the e-business having a lack of information - the quality of the connection. In order to collect the e-business web sites from the Internet, crawler agent is used. The crawler will obtain information in the links and keeps the information in the repository for later processing. Here, we proposed the MultiCrawler agent to develop a scalable e-business social network. The genetic algorithm is used to optimize the e-business web pages fetched by the crawler based on the user profiles. The result is the visualization of e-business social network mapping that related to the Multimedia Super Corridor (MSC) companies in Malaysia.

[1]  Ali Selamat,et al.  Multi-agent crawling systems (MACS) architecture for effective web retrieval , 2007 .

[2]  Debora Donato,et al.  The Web as a graph: How far we are , 2007, TOIT.

[3]  C. Steglich,et al.  Partners in Power: Job Mobility and Dynamic Deal‐Making , 2007 .

[4]  George Luger,et al.  Artificial Intelligence: Structures and Strategies for Complex Problem Solving (5th Edition) , 2004 .

[5]  Ali Selamat,et al.  Web page feature selection and classification using neural networks , 2004, Inf. Sci..

[6]  Filippo Menczer,et al.  Crawling the Web , 2004, Web Dynamics.

[7]  Lee Zhi Sam,et al.  Features extraction for illicit web pages identifications using independent component analysis , 2007, 2007 International Conference on Intelligent and Advanced Systems.

[8]  Lawrence B. Holder,et al.  Mining Graph Data: Cook/Mining Graph Data , 2006 .

[9]  Meindert Fennema,et al.  Civic Community, Political Participation and Political Trust of Ethnic Groups , 2001 .

[10]  Richard Rothenberg,et al.  From Whole Cloth : Making up the terrorist network , 2002 .

[11]  A. Dekker,et al.  Applying Social Network Analysis Concepts to Military C 4 ISR Architectures 1 , 2002 .

[12]  Sung-Bae Cho,et al.  Personalized mining of web documents using link structures and fuzzy concept networks , 2007, Appl. Soft Comput..

[13]  Mitsuru Ishizuka,et al.  Extracting Inter-Firm Networks fromWorldWideWeb , 2007, The 9th IEEE International Conference on E-Commerce Technology and The 4th IEEE International Conference on Enterprise Computing, E-Commerce and E-Services (CEC-EEE 2007).

[14]  Ali Selamat,et al.  Features extraction for illicit web pages identification using identification component analysis , 2007 .

[15]  Haluk Bingol,et al.  Community Detection in Complex Networks Using Genetic Algorithms , 2006, 0711.0491.

[16]  Karl M. van Meter,et al.  Terrorists / Liberators : Researching and dealing with adversary social networks 1 , 2002 .

[17]  Padmini Srinivasan,et al.  Learning to crawl: Comparing classification schemes , 2005, TOIS.