DDBJ Database updates and computational infrastructure enhancement

Abstract The Bioinformation and DDBJ Center (https://www.ddbj.nig.ac.jp) in the National Institute of Genetics (NIG) maintains a primary nucleotide sequence database as a member of the International Nucleotide Sequence Database Collaboration (INSDC) in partnership with the US National Center for Biotechnology Information and the European Bioinformatics Institute. The NIG operates the NIG supercomputer as a computational basis for the construction of DDBJ databases and as a large-scale computational resource for Japanese biologists and medical researchers. In order to accommodate the rapidly growing amount of deoxyribonucleic acid (DNA) nucleotide sequence data, NIG replaced its supercomputer system, which is designed for big data analysis of genome data, in early 2019. The new system is equipped with 30 PB of DNA data archiving storage; large-scale parallel distributed file systems (13.8 PB in total) and 1.1 PFLOPS computation nodes and graphics processing units (GPUs). Moreover, as a starting point of developing multi-cloud infrastructure of bioinformatics, we have also installed an automatic file transfer system that allows users to prevent data lock-in and to achieve cost/performance balance by exploiting the most suitable environment from among the supercomputer and public clouds for different workloads.

[1]  Rasko Leinonen,et al.  The sequence read archive: explosive growth of sequencing data , 2011, Nucleic Acids Res..

[2]  Tazro Ohta,et al.  Accumulating computational resource usage of genomic data analysis workflow to optimize cloud computing instance selection , 2019, GigaScience.

[3]  Cetin Sahin,et al.  Importance of Application-Level Resource Management in Multi-Cloud Deployments , 2019, 2019 IEEE International Conference on Cloud Engineering (IC2E).

[4]  Howard Y. Chang,et al.  Functional annotation of human long noncoding RNAs via molecular phenotyping , 2019, bioRxiv.

[5]  Greg Thorson,et al.  SGI® UV2: A fused computation and data analysis machine , 2012, 2012 International Conference for High Performance Computing, Networking, Storage and Analysis.

[6]  Guy Cochrane,et al.  The International Nucleotide Sequence Database Collaboration , 2012, Nucleic Acids Res..

[7]  Tanya Barrett,et al.  The Gene Expression Omnibus Database , 2016, Statistical Genomics.

[8]  A. Sivachenko,et al.  Sensitive detection of somatic point mutations in impure and heterogeneous cancer samples , 2013, Nature Biotechnology.

[9]  Yusheng Ji,et al.  SINET5: A low-latency and high-bandwidth backbone network for SDN/NFV Era , 2017, 2017 IEEE International Conference on Communications (ICC).

[10]  Hidemasa Bono,et al.  All of gene expression (AOE): An integrated index for public gene expression databases , 2019, bioRxiv.

[11]  Toshihisa Takagi,et al.  The DDBJ Japanese Genotype-phenotype Archive for genetic and phenotypic human data , 2014, Nucleic Acids Res..

[12]  David A. Patterson,et al.  Computer Architecture: A Quantitative Approach , 1969 .

[13]  Masaharu Munetomo,et al.  Towards a small diverse pareto-optimal solutions set generator for multiobjective optimization problems , 2018, GECCO.

[14]  M. DePristo,et al.  A framework for variation discovery and genotyping using next-generation DNA sequencing data , 2011, Nature Genetics.

[15]  Thomas M. Keane,et al.  The European Nucleotide Archive in 2018 , 2018, Nucleic Acids Res..

[16]  Guy Cochrane,et al.  The International Nucleotide Sequence Database Collaboration , 2010, Nucleic Acids Res..

[17]  Vanessa Sochat,et al.  Singularity: Scientific containers for mobility of compute , 2017, PloS one.

[18]  Guy Cochrane,et al.  Toward richer metadata for microbial sequences: replacing strain-level NCBI taxonomy taxids with BioProject, BioSample and Assembly records , 2014, Standards in genomic sciences.

[19]  Robert Petryszak,et al.  ArrayExpress update—simplifying data submissions , 2014, Nucleic Acids Res..

[20]  Guy Cochrane,et al.  The International Nucleotide Sequence Database Collaboration , 2011, Nucleic Acids Res..

[21]  Kazushige Saga,et al.  Dynamic Framework for Reconfiguring Computing Resources in the Inter-cloud and Its Application to Genome Analysis Workflows , 2018, IDCS.

[22]  T. Matise,et al.  Nucleotide Sequence Database Policies , 2002, Science.

[23]  Masaharu Munetomo,et al.  Optimal Cloud Resource Selection Method Considering Hard and Soft Constraints and Multiple Conflicting Objectives , 2018, 2018 IEEE 11th International Conference on Cloud Computing (CLOUD).

[24]  Laura Lyman Rodriguez,et al.  The dbGaP data browser: a new tool for browsing dbGaP controlled-access genomic data , 2016, Nucleic Acids Res..

[25]  Dennis A. Benson,et al.  GenBank , 2018, Nucleic Acids Res..

[26]  David Haussler,et al.  Federated discovery and sharing of genomic data using Beacons , 2019, Nature Biotechnology.

[27]  Osamu Ogasawara,et al.  DDBJ update: the Genomic Expression Archive (GEA) for functional genomics data , 2018, Nucleic Acids Res..

[28]  Tazro Ohta,et al.  Accumulating computational resource usage of genomic data analysis workflow to optimize cloud computing instance selection , 2018, bioRxiv.

[29]  Toshihisa Takagi,et al.  DDBJ new system and service refactoring , 2012, Nucleic Acids Res..

[30]  Arcadi Navarro,et al.  The European Genome-phenome Archive of human data consented for biomedical research , 2015, Nature Genetics.

[31]  Robert Petryszak,et al.  Discovering and linking public omics data sets using the Omics Discovery Index , 2017, Nature Biotechnology.

[32]  Masaharu Munetomo,et al.  Optimal and Feasible Cloud Resource Configurations Generation Method for Genomic Analytics Applications , 2018, 2018 IEEE International Conference on Cloud Computing Technology and Science (CloudCom).

[33]  Ying Cheng,et al.  The European Nucleotide Archive , 2010, Nucleic Acids Res..