SeFAct2: Selective Feature Activation for Energy-Efficient CNNs using Optimized Thresholds

Farhana Sharmin Snigdha, Susmita Dey Manasi, Jiang Hu, Sachin S. Sapatnekar

Research output: Contribution to journalArticlepeer-review

Abstract

This work presents a framework for dynamic energy reduction in hardware accelerators for convolutional neural networks (CNN). The key idea is based on the early prediction of the features that may be important, with the deactivation of computations related to unimportant features and static bitwidth reduction. The former is applied in late layers of the CNN, while the latter is more effective in the early layers. The procedure includes a methodology for automated threshold tuning to detect feature activation. For various state-of-the-art neural networks, the results show that energy savings of up to about 30% are achievable, after accounting for all implementation overheads, with a small loss in the accuracy.

Keywords

  • Biological neural networks
  • CNN
  • Computer architecture
  • deep learning
  • energy optimization.
  • Feature extraction
  • Hardware
  • Low-power design
  • neural network
  • Neurons
  • Testing
  • Training

Fingerprint Dive into the research topics of 'SeFAct2: Selective Feature Activation for Energy-Efficient CNNs using Optimized Thresholds'. Together they form a unique fingerprint.

Cite this