Design of a low cost and convenient Hadoop application for extracting consumer behavior

Access Log of an e-commerce website contains the movement of the consumers. This movement carries valuable information about the needs, choices and purchase history of the consumers. This information can be extracted to influence the purchase of the consumers through appropriate ads, offers and discounts. Moreover, this information has interesting correlations with various business parameters, which helps to make a strong prediction for business intelligence. To make these insights more sensible, log data should be as big as possible. It makes big data analytics suitable for such application. Hadoop is an open source platform for big data analysis and can be used for the benefit of the e-commerce companies. But without proper tools like Pig, Hive etc, Hadoop applications are difficult to access. In this article, a unique and convenient system called Command Line Interface for Consumer Behavior is presented to solve this particular problem. One can easily find the consumer behavior using the access logs with this system. It has used command line feature of Hadoop to pass the IP or Hostname to extract consumer behavior.

[1]  Sultan Aljahdali,et al.  Web Mining Techniques in E-Commerce Applications , 2013, ArXiv.

[2]  Lan Huang,et al.  Extraction of User Profile Based on the Hadoop Framework , 2009, 2009 5th International Conference on Wireless Communications, Networking and Mobile Computing.

[3]  Toran Verma,et al.  A distributed framework for event log analysis using MapReduce , 2016, 2016 International Conference on Advanced Communication Control and Computing Technologies (ICACCCT).

[4]  Qi Fu,et al.  The Survey of Big Data , 2015 .

[5]  S. Saravanan,et al.  Analyzing Large Web Log Files in a Hadoop Distributed Cluster Environment , 2014 .

[6]  Oana Barbu,et al.  Advertising, Microtargeting and Social Media , 2014 .

[7]  C AshokKashyapG,et al.  A SURVEY ON BIG DATA , 2013 .

[8]  S. Suguna,et al.  Big data analysis in e-commerce system using HadoopMapReduce , 2016, 2016 International Conference on Inventive Computation Technologies (ICICT).

[9]  R. H. Goudar,et al.  Big data: Mining of log file through hadoop , 2013, 2013 International Conference on Human Computer Interactions (ICHCI).

[10]  Debajyoti Mukhopadhyay,et al.  Analyzing web application log files to find hit count through the utilization of Hadoop MapReduce in cloud computing environment , 2014, 2014 Conference on IT in Business, Industry and Government (CSIBIG).

[11]  Yanhua Zhang,et al.  A MapReduce-Based Framework for Analyzing Web Logs in Offline Streams , 2016, 2016 IEEE 14th Intl Conf on Dependable, Autonomic and Secure Computing, 14th Intl Conf on Pervasive Intelligence and Computing, 2nd Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress(DASC/PiCom/DataCom/CyberSciTech).