Demo: elastic mapreduce-style processing of fast data

MapReduce is a popular scalable processing framework for large-scale data. In this paper we demonstrate Enorm, which represents our efforts on rectifying the traditional batch-oriented MapReduce framework for low-latency data stream processing. Most existing work have focused on how to extend the MapReduce framework for low-latency data stream processing, but overlooked the problem of obtaining runtime elasticity. The demonstration focuses on two important features in Enorm. (1) sharing aggregate computations among overlapping windows and (2) runtime elasticity.

[1]  Michael J. Franklin,et al.  On-the-fly sharing for streamed aggregation , 2006, SIGMOD Conference.

[2]  Joseph M. Hellerstein,et al.  MapReduce Online , 2010, NSDI.

[3]  Lu Liu,et al.  Muppet: MapReduce-Style Processing of Fast Data , 2012, Proc. VLDB Endow..