Conversational Analytics using Apache Spark: Acquisition of user engagement characteristics and providing recommendations of products and service

With the increasing popularity of development of chatbots to overcome restrictions of complex user interface design and inconvenience to the user in requesting data and services, we felt that there is a strong need for an analytics platform for chatbot developers through which they can implement analytics on the information collected by the chatbot to better understand the needs of the user. The paper tries to identify and find solutions for two types of analytics needed by the chatbot. One is to summarize the reviews and nature of a product or service from multiple sources on the internet. Other caters to capture and analyse user engagement characteristics to provide better recommendations.