Data adapter for querying and transformation between SQL and NoSQL database

As the growing of applications with big data in cloud computing become popular, many existing systems expect to expand their service to support the explosive increase of data. We propose a data adapter system to support hybrid database architecture including a relational database (RDB) and NoSQL database. It can support query from application and deal with database transformation at the same time. We provide three modes of query approach in data adapter system: blocking transformation mode (BT mode), blocking dump mode (BD mode), and direct access mode (DA mode). We provide a data synchronization mechanism and describe the design and implementation in detail. This paper focuses on velocity with proposed three modes and partly variety with data stored in RDB, NoSQL database and temporary files. With the proposed data adapter system, we can provide a seamless mechanism to use RDB and NoSQL database at the same time. This paper presents data adapter to make possible the automated transformation of multi-structured data in Relational Database (RDB) and NoSQL systems.With the proposed data adapter, a seamless mechanism is provided for constructing hybrid database systems.With the proposed data adapter, hybrid database systems can be performed in an elastic manner, i.e., access can be either RDB or NoSQL, depending on the size of data.

[1]  N. B. Anuar,et al.  The rise of "big data" on cloud computing: Review and open research issues , 2015, Inf. Syst..

[2]  Antonio Puliafito,et al.  The Need of a Hybrid Storage Approach for IoT in PaaS Cloud Federation , 2014, 2014 28th International Conference on Advanced Information Networking and Applications Workshops.

[3]  C. L. Philip Chen,et al.  Data-intensive applications, challenges, techniques and technologies: A survey on Big Data , 2014, Inf. Sci..

[4]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[5]  Prashant Malik,et al.  Cassandra: a decentralized structured storage system , 2010, OPSR.

[6]  John Roijackers Bridging SQL and NoSQL , 2012 .

[7]  Neal Leavitt,et al.  Will NoSQL Databases Live Up to Their Promise? , 2010, Computer.

[8]  J. Manyika Big data: The next frontier for innovation, competition, and productivity , 2011 .

[9]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[10]  Chongxin Li,et al.  Transforming relational database into HBase: A case study , 2010, 2010 IEEE International Conference on Software Engineering and Service Sciences.

[11]  Taewon Kim,et al.  Cost-based join processing scheme in a hybrid RDBMS and hive system , 2014, 2014 International Conference on Big Data and Smart Computing (BIGCOMP).

[12]  Mauro Iacono,et al.  Performance evaluation of NoSQL big-data applications using multi-formalism models , 2014, Future Gener. Comput. Syst..

[13]  Muthu Ramachandran,et al.  Cloud Computing Adoption Framework – a security framework for business clouds , 2015 .

[14]  Tao Zhong,et al.  Blending SQL and NewSQL Approaches: Reference Architectures for Enterprise Big Data Challenges , 2013, 2013 International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery.

[15]  Juha Heinanen,et al.  OF DATA INTENSIVE APPLICATIONS , 1986 .

[16]  Wilson C. Hsieh,et al.  Bigtable: A Distributed Storage System for Structured Data , 2006, TOCS.

[17]  Klaus Meyer-Wegener,et al.  Speaking in tongues: SQL access to NoSQL systems , 2014, SAC.

[18]  Hector Garcia-Molina,et al.  Synchronizing a database to improve freshness , 2000, SIGMOD '00.

[19]  Ognjen V. Joldzic,et al.  The impact of cluster characteristics on HiveQL query optimization , 2013, 2013 21st Telecommunications Forum Telfor (TELFOR).

[20]  Guan Le,et al.  Survey on NoSQL database , 2011, 2011 6th International Conference on Pervasive Computing and Applications.

[21]  Yeh-Ching Chung,et al.  JackHare: a framework for SQL to NoSQL translation using MapReduce , 2013, Automated Software Engineering.

[22]  Athanasios V. Vasilakos,et al.  Security in cloud computing: Opportunities and challenges , 2015, Inf. Sci..

[23]  M. N. Vora,et al.  Hadoop-HBase for large-scale data , 2011, Proceedings of 2011 International Conference on Computer Science and Network Technology.

[24]  Kristina Chodorow,et al.  MongoDB: The Definitive Guide , 2010 .

[26]  Paolo Papotti,et al.  Nested mappings: schema mapping reloaded , 2006, VLDB.

[27]  Rick Cattell,et al.  Scalable SQL and NoSQL data stores , 2011, SGMD.