Deployment and Performance Analysis of Data Transfer Node Cluster for HPC Environment


KIPS Transactions on Computer and Communication Systems, Vol. 9, No. 9, pp. 197-206, Sep. 2020
https://doi.org/10.3745/KTCCS.2020.9.9.197,   PDF Download:  
Keywords: DTN Cluster, Wide Area Network, Data Transfer, Science DMZ, Parallel Filesystem
Abstract

Collaborative research in science applications based on HPC service needs rapid transfers of massive data between research colleagues over wide area network. With regard to this requirement, researches on enhancing data transfer performance between major superfacilities in the U.S. have been conducted recently. In this paper, we deploy multiple data transfer nodes(DTNs) over high-speed science networks in order to move rapidly large amounts of data in the parallel filesystem of KISTI’s Nurion supercomputer, and perform transfer experiments between endpoints with approximately 130ms round trip time. We have shown the results of transfer throughput in different size file sets and compared them. In addition, it has been confirmed that the DTN cluster with three nodes can provide about 1.8 and 2.7 times higher transfer throughput than a single node in two types of concurrency and parallelism settings.


Statistics
Show / Hide Statistics

Statistics (Cumulative Counts from September 1st, 2017)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.


Cite this article
[IEEE Style]
W. Hong, D. An, J. Lee, J. Moon, W. Seok, "Deployment and Performance Analysis of Data Transfer Node Cluster for HPC Environment," KIPS Transactions on Computer and Communication Systems, vol. 9, no. 9, pp. 197-206, 2020. DOI: https://doi.org/10.3745/KTCCS.2020.9.9.197.

[ACM Style]
Wontaek Hong, Dosik An, Jaekook Lee, Jeonghoon Moon, and Woojin Seok. 2020. Deployment and Performance Analysis of Data Transfer Node Cluster for HPC Environment. KIPS Transactions on Computer and Communication Systems, 9, 9, (2020), 197-206. DOI: https://doi.org/10.3745/KTCCS.2020.9.9.197.