TY  - JOUR
T1  - Parallelization of Genome Sequence Data Pre-Processing on Big Data and HPC Framework
AU  - Byun, Eun-Kyu 
AU  - Kwak, Jae-Hyuck 
AU  - Mun, Jihyeob 
JO  - KIPS Transactions on Computer and Communication Systems
PY  - 2019
DA  - 2019/1/30
DO  - 10.3745/KTCCS.2019.8.10.231
KW  - Genome Sequence Data Preprocessing
KW  - NGS
KW  - Big Data
KW  - Hadoop
KW  - HPC
KW  - Parallelization
AB  - Analyzing next-generation genome sequencing data in a conventional way using single server may take several tens of hours depending on the data size. However, in order to cope with emergency situations where the results need to be known within a few hours, it is required to improve the performance of a single genome analysis. In this paper, we propose a parallelized method for pre-processing genome sequence data which can reduce the analysis time by utilizing the big data technology and the high- performance computing cluster which is connected to the high-speed network and shares the parallel file system. For the reliability of analytical data, we have chosen a strategy to parallelize the existing analytical tools and algorithms to the new environment. Parallelized processing, data distribution, and parallel merging techniques have been developed and performance improvements have been confirmed through experiments.