Apache storm based on topology for real-time processing of streaming data from social networks
暂无分享,去创建一个
In recent years Big Data has become one of the hottest topic in software engineering. Necessity to deal with huge amount of data brings new challenges and, of course, new opportunities. Big Data requires revising approaches to designing software architecture. In particular, the Lambda Architecture pattern distinguishes the components that process recent data only in real-time (“speed layer”). In practice, such data items come continuously from so-called data streams. The aim of this paper is to represent concept of the implemented by the authors Apache Storm based topology for real-time processing of data streams from social networks.
[1] Wei Fan,et al. Mining big data: current status, and forecast to the future , 2013, SKDD.
[2] T. Longstaff,et al. Quality Attributes , 1995 .
[3] Nathan Marz,et al. Big Data: Principles and best practices of scalable realtime data systems , 2015 .