Effect of Program Error in Memristive Neural Network With Weight Quantization

Tae Hyeon Kim, Sungjoon Kim, Kyungho Hong, Jinwoo Park, Sangwook Youn, Jong Ho Lee, Byung Gook Park, Hyungjin Kim

Research output: Contribution to journalArticlepeer-review

22 Scopus citations

Abstract

Recently, various memory devices have been actively studied as suitable candidates for synaptic devices, which are important memory and computing units in neuromorphic systems. One of the ways to manage these devices is off-chip training, where it is essential to transfer the pretrained weights accurately. Previous studies, however, have a few limitations, such as a lack of consideration of program errors that occur during the transfer process. Although the smaller the program error, the higher the accuracy, the corresponding increase in the program time must be considered. To evaluate the practical applicability, we fabricated Al2O3/TiOx-based resistive random access memory (RRAM) and investigated the effect of program errors on program time and system degradation. It was confirmed that for smaller program errors, the program time was exponentially longer. Furthermore, we examined the effect of variation with respect to the number of quantized weight states ( ${N}_{state}$ ) through system-level simulation. We observed that the optimized ${N}_{state}$ varies depending on whether the program error is small or large. This result is meaningful as it experimentally shows the tradeoff between the program error, program time, and system performance. We expect it to be useful in the development of neuromorphic systems.

Original languageEnglish
Pages (from-to)3151-3157
Number of pages7
JournalIEEE Transactions on Electron Devices
Volume69
Issue number6
DOIs
StatePublished - 1 Jun 2022

Bibliographical note

Publisher Copyright:
© 1963-2012 IEEE.

Keywords

  • Neuromorphic computing
  • off-chip training
  • program error
  • program time
  • quantization aware training (QAT)
  • resistive random access memory (RRAM)
  • synaptic device
  • variation
  • weight quantization
  • weight transfer

Fingerprint

Dive into the research topics of 'Effect of Program Error in Memristive Neural Network With Weight Quantization'. Together they form a unique fingerprint.

Cite this