Toward RDB to NoSQL: transforming data with metamorfose framework

The emergence of applications dealing with structured, semi structured, and non-structured data created demands on new data storage systems. The relational model, widely used to store data from diverse applications, does not meet all the imposed scenarios. In response, NoSQL databases have emerged as an option. As a consequence, new approaches for converting the relational model to NoSQL models have been created. However, most of them target a specific NoSQL model and provide little (or none) support for customization for transformations with different cardinalities. In this paper we present a novel approach to convert relational databases (RDB) to document and column family NoSQLs. Our approach receives as input a set of directed acyclic graphs (DAG) representing the target NoSQL model. The DAGs are used to generate commands to transform the input RDB data. The approach supports different cardinalities, and the commands can be customized. We have developed a tool to interpret the DAGs and that supports different transformation strategies. We performed experiments to validate our solution, with different configurations, where conversions were carried out to document and column-family storage.

[1]  Zijing Li,et al.  Multiple Nested Schema of HBase for Migration from SQL , 2014, 2014 Ninth International Conference on P2P, Parallel, Grid, Cloud and Internet Computing.

[2]  Maribel Yasmina Santos,et al.  Data Models in NoSQL Databases for Big Data Contexts , 2016, DMBD.

[3]  Alistair A. Young,et al.  Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) , 2017, MICCAI 2017.

[4]  Zijing Li,et al.  Schema Conversion Model of SQL Database to NoSQL , 2014, 2014 Ninth International Conference on P2P, Parallel, Grid, Cloud and Internet Computing.

[5]  Ana Carolina Salgado,et al.  Conceptual Mappings to Convert Relational into NoSQL Databases , 2016, ICEIS.

[6]  Eleni Stroulia,et al.  From Relations to Multi-dimensional Maps: Towards an SQL-to-HBase Transformation Methodology , 2015, 2015 IEEE 8th International Conference on Cloud Computing.

[7]  Reynold Xin,et al.  Apache Spark , 2016 .

[8]  Yu-Lin Zheng,et al.  SQL-to-NoSQL Schema Denormalization and Migration: A Study on Content Management Systems , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[9]  Ronaldo dos Santos Mello,et al.  SQLtoKeyNoSQL: a layer for relational to key-based NoSQL database mapping , 2015, iiWAS.

[10]  Zheng Wang,et al.  Model Transformation and Data Migration from Relational Database to MongoDB , 2016, 2016 IEEE International Congress on Big Data (BigData Congress).

[11]  Liana Stanescu,et al.  Automatic mapping of MySQL databases to NoSQL MongoDB , 2016, 2016 Federated Conference on Computer Science and Information Systems (FedCSIS).

[12]  Martin Fowler,et al.  NoSQL Distilled: A Brief Guide to the Emerging World of Polyglot Persistence , 2012 .

[13]  Ramon Lawrence Integration and Virtualization of Relational SQL and NoSQL Systems Including MySQL and MongoDB , 2014, 2014 International Conference on Computational Science and Computational Intelligence.

[14]  Guntis Arnicans,et al.  Migration of Relational Database to Document-Oriented Database: Structure Denormalization and Data Transformation , 2015, 2015 7th International Conference on Computational Intelligence, Communication Systems and Networks.

[15]  Hassan Charaf,et al.  Denormalizing data into schema-free databases , 2013, 2013 IEEE 4th International Conference on Cognitive Infocommunications (CogInfoCom).

[16]  Ronaldo dos Santos Mello,et al.  On Providing DDL Support for a Relational Layer over a Document NoSQL Database , 2013, IIWAS '13.

[17]  Michael Stonebraker,et al.  The End of an Architectural Era (It's Time for a Complete Rewrite) , 2007, VLDB.