Cloud based social and sensor data fusion

As mobile cloud computing facilitates a wide spectrum of smart applications, the need for fusing various types of data available in the cloud grows rapidly. In particular, social and sensor data lie at the core in such applications, but typically processed separately. This paper explores the potential of fusing social and sensor data in the cloud, presenting a practice - a travel recommendation system that offers the predicted mood information of people on where and when users wish to travel. The system is built upon a conceptual framework that allows to blend the heterogeneous social and sensor data for integrated analysis, extracting weather-dependent people's mood information from Twitter and meteorological sensor data streams. In order to handle massively streaming data, the system employs various cloud-serving systems, such as Hadoop, HBase, and GSN. Using this scalable system, we performed heavy ETL as well as filtering jobs, resulting in 12 million tweets over four months. We then derived a rich set of interesting findings through the data fusion, proving that our approach is effective and scalable, which can serve as an important basis in fusing social and sensor data in the cloud.

[1]  M. Bradley,et al.  Affective Norms for English Words (ANEW): Instruction Manual and Affective Ratings , 1999 .

[2]  Mike Thelwall,et al.  Sentiment in Twitter events , 2011, J. Assoc. Inf. Sci. Technol..

[3]  Franco Zambonelli,et al.  Social sensors and pervasive services: Approaches and perspectives , 2011, 2011 IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops).

[4]  Johan Bollen,et al.  Twitter mood predicts the stock market , 2010, J. Comput. Sci..

[5]  Michael S. Bernstein,et al.  Twitinfo: aggregating and visualizing microblogs for event exploration , 2011, CHI.

[6]  Karl Aberer,et al.  The Global Sensor Networks middleware for efficient and flexible deployment and interconnection of sensor networks , 2006 .

[7]  Shivakant Mishra,et al.  Fusing mobile, sensor, and social data to fully enable context-aware computing , 2010, HotMobile '10.

[8]  Bu-Sung Lee,et al.  Event Detection in Twitter , 2011, ICWSM.

[9]  이상훈,et al.  트위터 트랜딩 토픽을 이용한 HBase 기반 자동 요약 시스템 , 2014 .

[10]  Tom White,et al.  Hadoop: The Definitive Guide , 2009 .

[11]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[12]  Karl Aberer,et al.  What have fruits to do with technology?: the case of Orange, Blackberry and Apple , 2011, WIMS '11.

[13]  Karl Aberer,et al.  A middleware for fast and flexible sensor network deployment , 2006, VLDB.

[14]  David Pollington,et al.  The calendar as a sensor: analysis and improvement using data fusion with social networks and location , 2010, UbiComp.

[15]  Yutaka Matsuo,et al.  Earthquake shakes Twitter users: real-time event detection by social sensors , 2010, WWW '10.

[16]  Patrick Paroubek,et al.  Twitter as a Corpus for Sentiment Analysis and Opinion Mining , 2010, LREC.

[17]  Grace Ellison,et al.  THE PULSE OF THE NATION , 2012 .

[18]  Amit P. Sheth,et al.  Citizen sensor data mining, social media analytics and development centric web applications , 2011, WWW.