Development of an Open ISA GPGPU for Edge Device Machine Learning Applications

Yu Xiang Su, Jhi Han Jheng, Dun Jie Chen, Chung Ho Chen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Hosting the deep learning model on the cloud may not be the best solution in many cases, for instance, IoT applications or autonomous system where low latency or enhanced security is desirable. Deep learning on the edge alleviates the above issues, and provides benefits of local computation. In this paper, we present the development of an open ISA (instruction set architecture) general purpose GPU aimed at edge computation. Our GPU, CASLab GPU, uses license-free, royalty-free HSAIL ISA specification and supports OpenCL1.2/2.0 APIs for heterogeneous computing. CASLab GPU also supports TensorFlow framework with CUDA-on-CL technology. CASLab GPU IP with configurable SIMT Core design tailors directly to the computing need of on-device learning and inference. The GPU is developed in ESL design methodology which incorporates GPU micro-architecture exploration, power modelling of the GPU, and the co-simulation of the GPU software stack.

Original languageEnglish
Title of host publicationICUFN 2019 - 11th International Conference on Ubiquitous and Future Networks
PublisherIEEE Computer Society
Pages214-217
Number of pages4
ISBN (Electronic)9781728113395
DOIs
Publication statusPublished - 2019 Jul
Event11th International Conference on Ubiquitous and Future Networks, ICUFN 2019 - Zagreb, Croatia
Duration: 2019 Jul 22019 Jul 5

Publication series

NameInternational Conference on Ubiquitous and Future Networks, ICUFN
Volume2019-July
ISSN (Print)2165-8528
ISSN (Electronic)2165-8536

Conference

Conference11th International Conference on Ubiquitous and Future Networks, ICUFN 2019
CountryCroatia
CityZagreb
Period19-07-0219-07-05

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Computer Science Applications
  • Hardware and Architecture

Fingerprint Dive into the research topics of 'Development of an Open ISA GPGPU for Edge Device Machine Learning Applications'. Together they form a unique fingerprint.

  • Cite this

    Su, Y. X., Jheng, J. H., Chen, D. J., & Chen, C. H. (2019). Development of an Open ISA GPGPU for Edge Device Machine Learning Applications. In ICUFN 2019 - 11th International Conference on Ubiquitous and Future Networks (pp. 214-217). [8806196] (International Conference on Ubiquitous and Future Networks, ICUFN; Vol. 2019-July). IEEE Computer Society. https://doi.org/10.1109/ICUFN.2019.8806196