GPU Memory Management Technique to Improve the Performance of GPGPUTask of Virtual Machines in RPC-Based GPU Virtualization Environments


KIPS Transactions on Computer and Communication Systems, Vol. 10, No. 5, pp. 123-136, May. 2021
https://doi.org/10.3745/KTCCS.2021.10.5.123,   PDF Download:
Keywords: GPU Virtualization, GPU Memory, Resource Managements, Cloud computing, HPC Cloud
Abstract

RPC (Remote Procedure Call)-based Graphics Processing Unit (GPU) virtualization technology is one of the technologies for sharing GPUs with multiple user virtual machines. However, in a cloud environment, unlike CPU or memory, general GPUs do not provide a resource isolation technology that can limit the resource usage of virtual machines. In particular, in an RPC-based virtualization environment, since GPU tasks executed in each virtual machine are performed in the form of multi-process, the lack of resource isolation technology causes performance degradation due to resource competition. In addition, the GPU memory competition accelerates the performance degradation as the resource demand of the virtual machines increases, and the fairness decreases because it cannot guarantee equal performance between virtual machines. This paper, in the RPC-based GPU virtualization environment, analyzes the performance degradation problem caused by resource contention when the GPU memory requirement of virtual machines exceeds the available GPU memory capacity and proposes a GPU memory management technique to solve this problem. Also, experiments show that the GPU memory management technique proposed in this paper can improve the performance of GPGPU tasks.


Statistics
Show / Hide Statistics

Statistics (Cumulative Counts from September 1st, 2017)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.


Cite this article
[IEEE Style]
J. Kang, "GPU Memory Management Technique to Improve the Performance of GPGPUTask of Virtual Machines in RPC-Based GPU Virtualization Environments," KIPS Transactions on Computer and Communication Systems, vol. 10, no. 5, pp. 123-136, 2021. DOI: https://doi.org/10.3745/KTCCS.2021.10.5.123.

[ACM Style]
Jihun Kang. 2021. GPU Memory Management Technique to Improve the Performance of GPGPUTask of Virtual Machines in RPC-Based GPU Virtualization Environments. KIPS Transactions on Computer and Communication Systems, 10, 5, (2021), 123-136. DOI: https://doi.org/10.3745/KTCCS.2021.10.5.123.