A model-driven partitioning and auto-tuning integrated framework for sparse matrix-vector multiplication on GPUs

Ping Guo, He Huang, Qichang Chen, Liqiang Wang, En-Jui Lee, Po Chen

研究成果: Conference contribution

27 引文 斯高帕斯(Scopus)

摘要

Sparse Matrix-Vector Multiplication (SpMV) is very common to scientific computing. The Graphics Processing Unit (GPU) has recently emerged as a high-performance computing platform due to its massive processing capability. This paper presents an innovative performance-model driven approach for partitioning sparse matrix into appropriate formats, and auto-tuning configurations of CUDA kernels to improve the performance of SpMV on GPUs. This paper makes the following contributions: (1) Propose an empirical CUDA performance model to predict the execution time of SpMV CUDA kernels. (2) Design and implement a model-driven partitioning framework to predict how to partition the target sparse matrix into one or more partitions and transform each partition into appropriate storage format, which is based on the fact that the different storage formats of sparse matrix can significantly affect the performance of SpMV. (3) Integrate the model-driven partitioning with our previous auto-tuning framework to automatically adjust CUDA-specific parameters to optimize performance on specific GPUs. Compared to the NVIDIA's existing implementations, our approach shows a substantial performance improvement. It has 222%, 197%, and 33% performance improvement on the average for CSR vector kernel, ELL kernel and HYB kernel, respectively.

原文English
主出版物標題Proceedings of the TeraGrid 2011 Conference
主出版物子標題Extreme Digital Discovery, TG'11
DOIs
出版狀態Published - 2011 九月 7
事件TeraGrid 2011 Conference: Extreme Digital Discovery, TG'11 - Salt Lake City, UT, United States
持續時間: 2011 七月 182011 七月 21

出版系列

名字Proceedings of the TeraGrid 2011 Conference: Extreme Digital Discovery, TG'11

Other

OtherTeraGrid 2011 Conference: Extreme Digital Discovery, TG'11
國家United States
城市Salt Lake City, UT
期間11-07-1811-07-21

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Hardware and Architecture

指紋 深入研究「A model-driven partitioning and auto-tuning integrated framework for sparse matrix-vector multiplication on GPUs」主題。共同形成了獨特的指紋。

引用此