ADC-PIM: Accelerating Convolution on the GPU via In-Memory Approximate Data Comparison

Jungwoo Choi, Hyuk Jae Lee, Chae Eun Rhee

Research output: Contribution to journalArticlepeer-review

2 Scopus citations

Abstract

Recently, convolutional neural networks (CNN) have been widely used in image processing and computer vision. GPUs are often used to accelerate the CNN, but performance is limited by high computational costs and memory usage of the convolution. Prior studies exploited approximate computing to reduce the computational costs. However, they only reduced the amount of the computation, thereby its performance is bottlenecked by the memory bandwidth due to an increased memory intensity. In addition, load imbalance between warps caused by approximation also inhibits the performance improvement. In this paper, we propose a processing-in-memory (PIM) solution that reduces the amount of data movement and computation through the Approximate Data Comparison (ADC-PIM). Instead of determining the value similarity after loading the data to the GPU, the ADC-PIM unit located on 3D-stacked memory compares the similarity and transfers only the selected representative data to the GPU. The GPU performs convolution on the representative data transferred from the ADC-PIM, and reuses the calculated results based on the similarity information. To reduce the increase in memory latency caused by the in-memory data comparison, we propose a two-level PIM architecture that exploits both the DRAM bank and TSV stage. By dividing the comparisons into multiple banks and then merging the results on the TSV stage, the ADC-PIM effectively hides the delay caused by the comparisons. To ease the load balancing on the GPU, the ADC-PIM performs data reorganization by assigning the representative data to addresses that are computed based on the comparison result. Experimental results show that the proposed ADC-PIM provides a 43% speedup and 32% energy saving with less than a 1% accuracy drop.

Original languageEnglish
Pages (from-to)458-471
Number of pages14
JournalIEEE Journal on Emerging and Selected Topics in Circuits and Systems
Volume12
Issue number2
DOIs
StatePublished - 1 Jun 2022

Bibliographical note

Publisher Copyright:
© 2011 IEEE.

Keywords

  • GPU
  • Processing-in-memory
  • approximate computing
  • convolutional neural networks

Fingerprint

Dive into the research topics of 'ADC-PIM: Accelerating Convolution on the GPU via In-Memory Approximate Data Comparison'. Together they form a unique fingerprint.

Cite this