Organic streams: Data aggregation and integration based on individual needs

With the high accessibility of the social media, more and more people have been accustomed to sharing their personal contents across the social networks, which results in an explosive increase of data scale. In this study, in order to support information and knowledge discovery in big data, we propose an approach to aggregation and integration of personal big data from life logs in accordance with individual needs, which can benefit the sustainable information utilization process. In details, the organic stream, which is designed as an extensible data carrier, is introduced and developed to formulize and organize the personal big data, in order to extract dynamical individual needs from the tremendous amount of data posted through social media, and further aggregate and integrate the related data in a meaningful way, which can also facilitate the personalized information retrieval and reuse process. The architecture of the system with the foundational modules is given, and the experiment result is presented to demonstrate the usability and effectiveness of our approach.

[1]  Sheikh Iqbal Ahamed,et al.  Preserving privacy in wireless sensor networks using reliable data aggregation , 2011, SIAP.

[2]  Keqiu Li,et al.  Big Data Processing in Cloud Computing Environments , 2012, 2012 12th International Symposium on Pervasive Systems, Algorithms and Networks.

[3]  J.R. Getta,et al.  Optimization of online data integration , 2006, 2006 7th International Baltic Conference on Databases and Information Systems.

[4]  Alon Y. Halevy,et al.  Data integration with dependent sources , 2011, EDBT/ICDT '11.

[5]  Young-Bae Ko,et al.  Efficient clustering-based data aggregation techniques for wireless sensor networks , 2011, Wirel. Networks.

[6]  Yi Pan,et al.  Parallel rough set based knowledge acquisition using MapReduce from big data , 2012, BigMine '12.

[7]  Athanasios V. Vasilakos,et al.  Prediction-based data aggregation in wireless sensor networks: Combining grey model and Kalman Filter , 2011, Comput. Commun..

[8]  Duoduo Liao,et al.  On clusterization of "big data" streams , 2012, COM.Geo '12.

[9]  Hyoung-Gon Kim,et al.  Metadata for efficient storage and retrieval of life log media , 2008, 2008 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems.

[10]  Chuang Lin,et al.  Attribute-Aware Data Aggregation Using Potential-Based Dynamic Routing in Wireless Sensor Networks , 2013, IEEE Transactions on Parallel and Distributed Systems.

[11]  Ladislav Hluchý,et al.  Distributed data integration and mining , 2011, iiWAS '11.

[12]  Sung-Bae Cho,et al.  Life log management based on machine learning technique , 2008, 2008 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems.

[13]  Minoru Uehara,et al.  Applied System of the Social Life Log for Ecological Lifestyle in the Home , 2009, 2009 International Conference on Network-Based Information Systems.

[14]  Nobuhiko Nishio,et al.  User profile generation reflecting user's temporal preference through web life-log , 2012, UbiComp '12.

[15]  Rong Jin,et al.  Online feature selection for mining big data , 2012, BigMine '12.

[16]  Torben Bach Pedersen,et al.  A rule-based tool for gradual granular data aggregation , 2011, DOLAP '11.

[17]  Aravind Menon,et al.  Big data @ facebook , 2012 .

[18]  Masahide Nakamura,et al.  Implementing and evaluating life-log mashup platform using RDB and web services , 2011, iiWAS '11.

[19]  Minsoo Lee,et al.  A Big Data Model Supporting Information Recommendation in Social Networks , 2012, 2012 Second International Conference on Cloud and Green Computing.

[20]  Malcolm P. Atkinson,et al.  A distributed architecture for data mining and integration , 2009, DADC '09.

[21]  Chen Li,et al.  ASTERIX: An Open Source System for "Big Data" Management and Analysis , 2012, Proc. VLDB Endow..

[22]  Suat Özdemir,et al.  Functional reputation based reliable data aggregation and transmission for wireless sensor networks , 2008, Comput. Commun..

[23]  Kiyoharu Aizawa,et al.  Capturing life-log and retrieval based on contexts , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[24]  David Dagan Feng,et al.  Dynamic adapter generation for data integration middleware , 2005, SEM '05.