A model-driven partitioning and auto-tuning integrated framework for sparse matrix-vector multiplication on GPUs

Ping Guo, He Huang, Qichang Chen, Liqiang Wang, En-Jui Lee, Po Chen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

27 Citations (Scopus)

Abstract

Sparse Matrix-Vector Multiplication (SpMV) is very common to scientific computing. The Graphics Processing Unit (GPU) has recently emerged as a high-performance computing platform due to its massive processing capability. This paper presents an innovative performance-model driven approach for partitioning sparse matrix into appropriate formats, and auto-tuning configurations of CUDA kernels to improve the performance of SpMV on GPUs. This paper makes the following contributions: (1) Propose an empirical CUDA performance model to predict the execution time of SpMV CUDA kernels. (2) Design and implement a model-driven partitioning framework to predict how to partition the target sparse matrix into one or more partitions and transform each partition into appropriate storage format, which is based on the fact that the different storage formats of sparse matrix can significantly affect the performance of SpMV. (3) Integrate the model-driven partitioning with our previous auto-tuning framework to automatically adjust CUDA-specific parameters to optimize performance on specific GPUs. Compared to the NVIDIA's existing implementations, our approach shows a substantial performance improvement. It has 222%, 197%, and 33% performance improvement on the average for CSR vector kernel, ELL kernel and HYB kernel, respectively.

Original languageEnglish
Title of host publicationProceedings of the TeraGrid 2011 Conference
Subtitle of host publicationExtreme Digital Discovery, TG'11
DOIs
Publication statusPublished - 2011 Sep 7
EventTeraGrid 2011 Conference: Extreme Digital Discovery, TG'11 - Salt Lake City, UT, United States
Duration: 2011 Jul 182011 Jul 21

Publication series

NameProceedings of the TeraGrid 2011 Conference: Extreme Digital Discovery, TG'11

Other

OtherTeraGrid 2011 Conference: Extreme Digital Discovery, TG'11
CountryUnited States
CitySalt Lake City, UT
Period11-07-1811-07-21

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Hardware and Architecture

Fingerprint Dive into the research topics of 'A model-driven partitioning and auto-tuning integrated framework for sparse matrix-vector multiplication on GPUs'. Together they form a unique fingerprint.

Cite this